mirlab
/

AkaLlama-llama3-70b-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Steamout commited on May 6

Commit

ee6dc22

•

1 Parent(s): 017e081

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -93,10 +93,10 @@ print(outputs[0]["generated_text"][len(prompt):])
 ## Evaluation
-|             Model             | #Parameter | Qunatized? | Logikor |
-|:-----------------------------:|:----------:|------------|:-------:|
-|    AkaLlama-llama3-70b-v0.1   |     70B    | No         |   0.0   |
-| AkaLlama-llama3-70b-v0.1-GGUF |     70B    | Yes        |   0.0   |
 ## Training Details
 ### Training Procedure

 ## Evaluation
+|               Model              | #Parameter | Qunatized? | LogicKor |
+|:--------------------------------:|:----------:|------------|:--------:|
+| AkaLlama-llama3-70b-v0.1-GGUF.Q4 |     70B    | 4bit       |   6.56   |
+| AkaLlama-llama3-70b-v0.1-GGUF.Q8 |     70B    | 8bit       |   6.34   |
 ## Training Details
 ### Training Procedure