Spaces:

Zhengyi
/

LLaMA-Mesh

Running on Zero

vivekvar commited on 10 days ago

Commit

17bb699

•

1 Parent(s): 6c027d9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -139,7 +139,7 @@ def chat_llama3_8b(message: str,
     streamer = TextIteratorStreamer(tokenizer, timeout=10.0, skip_prompt=True, skip_special_tokens=True)
     # print(max_new_tokens)
-    max_new_tokens=4096
     temperature=0.9
     generate_kwargs = dict(
         input_ids= input_ids,

     streamer = TextIteratorStreamer(tokenizer, timeout=10.0, skip_prompt=True, skip_special_tokens=True)
     # print(max_new_tokens)
+    max_new_tokens=5000000
     temperature=0.9
     generate_kwargs = dict(
         input_ids= input_ids,