piercemaloney
/

llemma_7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Pierce Maloney commited on Apr 9

Commit

e1040a6

•

1 Parent(s): 26070b4

testing high temperature

Files changed (1) hide show

handler.py +2 -2

handler.py CHANGED Viewed

@@ -29,8 +29,8 @@ class EndpointHandler():
             max_new_tokens=50,
             return_full_text=False,
             bad_words_ids=[[3070], [313, 334]],
-            temperature=0.8,
-            top_k=20,
         )
         return prediction

             max_new_tokens=50,
             return_full_text=False,
             bad_words_ids=[[3070], [313, 334]],
+            temperature=0.99,
+            top_k=40,
         )
         return prediction