Commit
•
f6338f8
1
Parent(s):
6dbcda5
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,9 +10,10 @@ tags:
|
|
| 10 |
- code
|
| 11 |
- llama-cpp
|
| 12 |
- gguf-my-repo
|
|
|
|
| 13 |
inference:
|
| 14 |
parameters:
|
| 15 |
-
temperature: 0
|
| 16 |
widget:
|
| 17 |
- messages:
|
| 18 |
- role: user
|
|
@@ -61,4 +62,4 @@ Step 3: Run inference through the main binary.
|
|
| 61 |
or
|
| 62 |
```
|
| 63 |
./llama-server --hf-repo NikolayKozloff/Phi-3-mini-4k-instruct-Q8_0-GGUF --hf-file phi-3-mini-4k-instruct-q8_0.gguf -c 2048
|
| 64 |
-
```
|
|
|
|
| 10 |
- code
|
| 11 |
- llama-cpp
|
| 12 |
- gguf-my-repo
|
| 13 |
+
- text-generation-inference
|
| 14 |
inference:
|
| 15 |
parameters:
|
| 16 |
+
temperature: 0
|
| 17 |
widget:
|
| 18 |
- messages:
|
| 19 |
- role: user
|
|
|
|
| 62 |
or
|
| 63 |
```
|
| 64 |
./llama-server --hf-repo NikolayKozloff/Phi-3-mini-4k-instruct-Q8_0-GGUF --hf-file phi-3-mini-4k-instruct-q8_0.gguf -c 2048
|
| 65 |
+
```
|