Spaces:

arcee-ai
/

Benchmarks

Running

Julien Simon commited on Sep 13

Commit

ce1f985

•

1 Parent(s): 7f6d9bd

8K/16K works with SuperNova-AWQ on g5

Files changed (1) hide show

results_arcee_supernova.py CHANGED Viewed

@@ -10,7 +10,7 @@ results_arcee_supernova = {
             "container": "TGI 2.2.0",
             "status": "OK",
             "tokensPerSecond": "33",
-            "notes": "8K/16K",
         },
         {
             "instanceType": "inf2.24xlarge",

             "container": "TGI 2.2.0",
             "status": "OK",
             "tokensPerSecond": "33",
+            "notes": "MAX_INPUT_TOKENS: 8192, MAX_TOTAL_TOKENS: 16384",
         },
         {
             "instanceType": "inf2.24xlarge",