Update README.md
Browse files
README.md
CHANGED
|
@@ -3,4 +3,11 @@ datasets:
|
|
| 3 |
- Open-Orca/OpenOrca
|
| 4 |
- baaghi124/Llama2-OpenOrca-Clean
|
| 5 |
- baaghi124/OpenOrca-Clean
|
| 6 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
- Open-Orca/OpenOrca
|
| 4 |
- baaghi124/Llama2-OpenOrca-Clean
|
| 5 |
- baaghi124/OpenOrca-Clean
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
## Model Details
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
- **Finetuned from model :** [Llama-2-7b-chat-hf](https://huggingface.co/NousResearch/Llama-2-7b-chat-hf)
|
| 12 |
+
- **Finetuning Technique**: Fine-tuned using the 4-bit quantization [QLoRA](https://arxiv.org/pdf/2305.14314.pdf) technique
|
| 13 |
+
- **Dataset Used**: [Llama2-OpenOrca-Clean](https://huggingface.co/datasets/baaghi124/Llama2-OpenOrca-Clean)
|