mirlab
/

AkaLlama-llama3-70b-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Steamout commited on May 8

Commit

c8978b9

•

1 Parent(s): 8897e20

Update README.md

Files changed (1) hide show

README.md +8 -4

README.md CHANGED Viewed

@@ -93,10 +93,14 @@ print(outputs[0]["generated_text"][len(prompt):])
 ## Evaluation
-|               Model              | #Parameter | Qunatized? | LogicKor* |
-|:--------------------------------:|:----------:|------------|:---------:|
-| AkaLlama-llama3-70b-v0.1-GGUF.Q4 |     70B    |    4bit    |    6.56   |
-| AkaLlama-llama3-70b-v0.1-GGUF.Q8 |     70B    |    8bit    |    6.34   |
 *mean over 3 random seeds

 ## Evaluation
+|          Model           | Precision | LogicKor single turn* | LogicKor multi turn* | Overall* |
+|:------------------------:|:---------:|:--------------------:|:---------------------:|:--------:|
+| AkaLlama-llama3-70b-v0.1 |  float64  |         6.873        |          7.207        |   7.04   |
+<!--
+| AkaLlama-llama3-70b-v0.1 |   bf16    |         6.873        |          7.206        |   7.04   |
+-->
 *mean over 3 random seeds