---
license: apache-2.0
datasets:
- mlabonne/orpo-dpo-mix-40k
language:
- en
base_model:
- meta-llama/Llama-3.2-1B
library_name: transformers
pipeline_tag: text-generation
model-index:
- name: week2-llama3-1B
  results:
  - task:
      type: text-generation
    dataset:
      name: mlabonne/orpo-dpo-mix-40k
      type: mlabonne/orpo-dpo-mix-40k
    metrics:
    - name: EQ-Bench (0-Shot)
      type: EQ-Bench (0-Shot)
      value: 1.5355
---
## Model Overview  
This model is a fine-tuned variant of **Llama-3.2-1B**, leveraging **ORPO** (Optimized Regularization for Prompt Optimization) for enhanced performance. It has been fine-tuned using the **mlabonne/orpo-dpo-mix-40k** dataset as part of the *Finetuning Open Source LLMs Course - Week 2 Project*. 

## Intended Use  
This model is optimized for general-purpose language tasks, including text parsing, understanding contextual prompts, and enhanced interpretability in natural language processing applications. 

## Evaluation Results (EQ-Bench v2.1)  
The model was evaluated on the EQ-Bench dataset, with the following performance metrics:
| Tasks  |Version|Filter|n-shot|     Metric      |   | Value |   |Stderr|
|--------|------:|------|-----:|-----------------|---|------:|---|-----:|
|eq_bench|    2.1|none  |     0|eqbench          |↑  | 1.5355|±  |0.9174|
|        |       |none  |     0|percent_parseable|↑  |16.9591|±  |2.8782|

## Key Features  
- **Model Size**: 1 Billion parameters  
- **Fine-tuning Method**: ORPO  
- **Dataset**: mlabonne/orpo-dpo-mix-40k  
- **Benchmark**: EQ-Bench (v2.1), no shot