shisa-ai
/

shisa-v1-llama3-8b-gguf

Inference Endpoints

Model card Files Files and versions Community

leonardlin commited on May 27

Commit

bb57f22

•

1 Parent(s): d459485

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,4 +1,4 @@
-Tested to work correctly with multiturn w/ the llama3 chat_template:
 ```
 ./server -ngl 99 -m shisa-v1-llama3-8b.Q5_K_M.gguf --chat-template llama3 -fa -v
 ```

+There are some stray llama2 `</s>` tokens for some reason, but tested to work correctly with multiturn w/ the llama3 chat_template:
 ```
 ./server -ngl 99 -m shisa-v1-llama3-8b.Q5_K_M.gguf --chat-template llama3 -fa -v
 ```