Spaces:

arcee-ai
/

Benchmarks

Running

Julien Simon commited on Sep 13

Commit

3a66d4b

•

1 Parent(s): 58285ac

Add SuperNova AWQ benchmarks

Files changed (1) hide show

results_arcee_supernova.py CHANGED Viewed

@@ -25,7 +25,7 @@ results_arcee_supernova = {
             "quantization": "awq",
             "container": "TGI 2.2.0",
             "status": "OK",
-            "tokensPerSecond": "???",
             "notes": "MAX_INPUT_TOKENS: 16384, MAX_TOTAL_TOKENS: 32768",
         },
         {

             "quantization": "awq",
             "container": "TGI 2.2.0",
             "status": "OK",
+            "tokensPerSecond": "73",
             "notes": "MAX_INPUT_TOKENS: 16384, MAX_TOTAL_TOKENS: 32768",
         },
         {