Hugging Face's logo

Spaces:
harshitv804
/
MedChat
Sleeping

App Files
harshitv804 commited on
Commit
1a74581
•
1 Parent(s): fde604e

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -0
app.py CHANGED
@@ -58,6 +58,7 @@ model_path="stablelm-zephyr-3b.Q4_K_M.gguf",
58
  temperature=0.75,
59
  max_tokens=2000,
60
  n_ctx = 4000,
 
61
  top_p=1)
62
 
63
 
 
58
  temperature=0.75,
59
  max_tokens=2000,
60
  n_ctx = 4000,
61
+ n_batch=126,
62
  top_p=1)
63
 
64