asiansoul
/

SmartLlama-3-Ko-8B-GGUF

Inference Endpoints

Model card Files Files and versions Community

asiansoul commited on Apr 30

Commit

4d9c3c6

•

1 Parent(s): 431ccc2

Update Modelfile_Q5_K_M

Files changed (1) hide show

Modelfile_Q5_K_M +1 -1

Modelfile_Q5_K_M CHANGED Viewed

@@ -16,7 +16,7 @@ SYSTEM """
 """
 PARAMETER temperature 0.7
-PARAMETER num_predict 256
 PARAMETER num_ctx 4096
 PARAMETER stop "<s>"
 PARAMETER stop "</s>"

 """
 PARAMETER temperature 0.7
+PARAMETER num_predict 3000
 PARAMETER num_ctx 4096
 PARAMETER stop "<s>"
 PARAMETER stop "</s>"