piercemaloney
/

llemma_7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Pierce Maloney commited on Apr 9

Commit

cb274aa

•

1 Parent(s): e1040a6

num ret seqs 2

Files changed (1) hide show

handler.py +1 -0

handler.py CHANGED Viewed

@@ -31,6 +31,7 @@ class EndpointHandler():
             bad_words_ids=[[3070], [313, 334]],
             temperature=0.99,
             top_k=40,
         )
         return prediction

             bad_words_ids=[[3070], [313, 334]],
             temperature=0.99,
             top_k=40,
+            num_return_sequences=2
         )
         return prediction