Spaces:

arcee-ai
/

Benchmarks

Running

Julien Simon commited on Sep 22

Commit

2ac5435

•

1 Parent(s): bf877db

Update

Files changed (1) hide show

results_arcee_supernova.py CHANGED Viewed

@@ -17,8 +17,8 @@ results_arcee_supernova = {
             "quantization": "Q4_0_4_8",
             "container": "llama.cpp 9/19/24",
             "status": "OK",
-            "tokensPerSecond": "10",
-            "notes": "",
         },
         {
             "instanceType": "g5.12xlarge",

             "quantization": "Q4_0_4_8",
             "container": "llama.cpp 9/19/24",
             "status": "OK",
+            "tokensPerSecond": "9.8",
+            "notes": "With Flash Attention",
         },
         {
             "instanceType": "g5.12xlarge",