MTSAIR
/

Cotype-Nano-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

AlanRobotics commited on Nov 22, 2024

Commit

bc24af0

·

verified ·

1 Parent(s): b25b51c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -100,7 +100,7 @@ print(res[0]['generated_text'][1])
 | **Model**                                   | **Score** | **95% CI**      | **Avg Tokens** |
 | ------------------------------------------- | --------- | --------------- | -------------- |
 | storm-7b                                    | 20.62     | +2.0 / -1.6     | 419.32         |
-| **Llama-3-Cotype-Nano-4bit**                  | **20.3**     | **+1.6 / -1.4**     | **629**         |
 | neural-chat-7b-v3-3                         | 19.04     | +2.0 / -1.7     | 927.21         |
 | Vikhrmodels-Vikhr-Llama-3.2-1B-instruct | 19.04 | +1.3 / -1.6 | 958.63     |
 | gigachat_lite                               | 17.2      | +1.4 / -1.4     | 276.81         |

 | **Model**                                   | **Score** | **95% CI**      | **Avg Tokens** |
 | ------------------------------------------- | --------- | --------------- | -------------- |
 | storm-7b                                    | 20.62     | +2.0 / -1.6     | 419.32         |
+| **Llama-3-Cotype-Nano-4bit**                  | **20.3**     | **+1.6 / -1.4**     | **588**         |
 | neural-chat-7b-v3-3                         | 19.04     | +2.0 / -1.7     | 927.21         |
 | Vikhrmodels-Vikhr-Llama-3.2-1B-instruct | 19.04 | +1.3 / -1.6 | 958.63     |
 | gigachat_lite                               | 17.2      | +1.4 / -1.4     | 276.81         |