saiga-api-13b

Sleeping

muryshev commited on Dec 4, 2023

Commit

defe6c2

•

1 Parent(s): aeda258

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -21,7 +21,7 @@ ROLE_TOKENS = {
     "system": SYSTEM_TOKEN
 }
-CONTEXT_SIZE = 4000
 ENABLE_GPU = True
 GPU_LAYERS = 70

     "system": SYSTEM_TOKEN
 }
+CONTEXT_SIZE = 2000
 ENABLE_GPU = True
 GPU_LAYERS = 70