OPEA
/

Llama-3.3-70B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 11 days ago

Commit

44f1cc3

•

1 Parent(s): 76c80ef

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -97,7 +97,7 @@ prompt = "Once upon a time,"
 pip3 install lm-eval==0.4.5
 ```bash
- auto-round --eval --model_name "OPEA/Llama-3.3-70B-Instruct-int4-sym-inc" --eval_bs 16  --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
 ```
 | Metric                      | BF16                     | INT4                     |

 pip3 install lm-eval==0.4.5
 ```bash
+ auto-round --eval --model "OPEA/Llama-3.3-70B-Instruct-int4-sym-inc" --eval_bs 16  --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
 ```
 | Metric                      | BF16                     | INT4                     |