Update README.md
Browse files
README.md
CHANGED
@@ -22,7 +22,7 @@ This LLAMA-3.1 model was finetuned to enhance capabilities in text generation fo
|
|
22 |
## Finetuning Process
|
23 |
The model was finetuned using the Unsloth library, leveraging its efficient training capabilities. The process included the following steps:
|
24 |
|
25 |
-
1. **Data Preparation:** Loaded and preprocessed
|
26 |
2. **Model Loading:** Utilized `unsloth/llama-3-8b-bnb-4bit` as the base model.
|
27 |
3. **LoRA Patching:** Applied LoRA (Low-Rank Adaptation) for efficient training.
|
28 |
4. **Training:** Finetuned the model using Hugging Face's TRL library with optimized hyperparameters.
|
|
|
22 |
## Finetuning Process
|
23 |
The model was finetuned using the Unsloth library, leveraging its efficient training capabilities. The process included the following steps:
|
24 |
|
25 |
+
1. **Data Preparation:** Loaded and preprocessed turkish-related data.
|
26 |
2. **Model Loading:** Utilized `unsloth/llama-3-8b-bnb-4bit` as the base model.
|
27 |
3. **LoRA Patching:** Applied LoRA (Low-Rank Adaptation) for efficient training.
|
28 |
4. **Training:** Finetuned the model using Hugging Face's TRL library with optimized hyperparameters.
|