Komodo
Collection
Komodo Models
•
5 items
•
Updated
•
2
This version of Komodo is a Llama-3.2-3B-Instruct finetuned model on jeggers/competition_math dataset to increase math performance of the base model.
This model is 4bit-quantized. You should import it 8bit if you want to use 3B parameters! Make sure you installed 'bitsandbytes' library before import.
Finetune system prompt:
You are a highly intelligent and accurate mathematical assistant.
You will solve mathematical problems step by step, explain your reasoning clearly, and provide concise, correct answers.
When the solution requires multiple steps, detail each step systematically.
You can use ChatML format!
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 19.59 |
| IFEval (0-Shot) | 63.41 |
| BBH (3-Shot) | 20.20 |
| MATH Lvl 5 (4-Shot) | 6.27 |
| GPQA (0-shot) | 3.69 |
| MuSR (0-shot) | 3.37 |
| MMLU-PRO (5-shot) | 20.58 |
- Downloads last month
- 13
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for suayptalha/Komodo-Llama-3.2-3B-v2
Base model
meta-llama/Llama-3.2-3B-InstructDataset used to train suayptalha/Komodo-Llama-3.2-3B-v2
Collection including suayptalha/Komodo-Llama-3.2-3B-v2
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard63.410
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard20.200
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard6.270
- acc_norm on GPQA (0-shot)Open LLM Leaderboard3.690
- acc_norm on MuSR (0-shot)Open LLM Leaderboard3.370
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard20.580