ngxson
commited on
Commit
•
7c161c9
1
Parent(s):
ae1a83e
update readme
Browse files
README.md
CHANGED
@@ -31,6 +31,10 @@ The user’s message goes here
|
|
31 |
|
32 |
The recommended way is to use the GGUF `vistral-7b-chatml-Q4_K_M.gguf` file included in this repository. Run it via llama.cpp (remember to pass `-cml` argument to use chatml template)
|
33 |
|
|
|
|
|
|
|
|
|
34 |
Run the `python3 run.py` inside this repository to try the model using transformers library. You may need to change some params inside in order to make it work.
|
35 |
|
36 |
This is an example of a conversation using llama.cpp:
|
|
|
31 |
|
32 |
The recommended way is to use the GGUF `vistral-7b-chatml-Q4_K_M.gguf` file included in this repository. Run it via llama.cpp (remember to pass `-cml` argument to use chatml template)
|
33 |
|
34 |
+
```bash
|
35 |
+
./main -m vistral-7b-chatml-Q4_K_M.gguf -p "Bạn là một trợ lí Tiếng Việt nhiệt tình và trung thực." -cml
|
36 |
+
```
|
37 |
+
|
38 |
Run the `python3 run.py` inside this repository to try the model using transformers library. You may need to change some params inside in order to make it work.
|
39 |
|
40 |
This is an example of a conversation using llama.cpp:
|