m-polignano-uniba commited on
Commit
8a46cc2
1 Parent(s): 18b3fcb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -245,6 +245,11 @@ For direct use with `unsloth`, you can easily get started with the following ste
245
  **Open LLM Leaderboard:**
246
 
247
  Evaluated with lm-evaluation-benchmark-harness for the [**Open Italian LLMs Leaderboard**](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard)
 
 
 
 
 
248
  | Metric | Value |
249
  |-----------------------|---------------------------|
250
  | Avg. | **--** |
 
245
  **Open LLM Leaderboard:**
246
 
247
  Evaluated with lm-evaluation-benchmark-harness for the [**Open Italian LLMs Leaderboard**](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard)
248
+ ```
249
+ lm_eval --model hf --model_args pretrained=HUGGINGFACE_MODEL_ID --tasks hellaswag_it,arc_it --device cuda:0 --batch_size auto:2
250
+ lm_eval --model hf --model_args pretrained=HUGGINGFACE_MODEL_ID --tasks m_mmlu_it --num_fewshot 5 --device cuda:0 --batch_size auto:2
251
+ ```
252
+
253
  | Metric | Value |
254
  |-----------------------|---------------------------|
255
  | Avg. | **--** |