File size: 576 Bytes
c8a326f 2addcbd ce0916b af11063 2addcbd af11063 2addcbd af11063 2addcbd ce0916b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: apache-2.0
language:
- fr
pipeline_tag: text-generation
---
- Model : https://huggingface.co/GeneZC/MiniChat-1.5-3B
- FT : @teilomillet
- Instruction tune using QLoRA on a french dataset for 1 epoch.
The aim was to test and try the dataset. Implementing a customization via a dataset and fine-tuning on it.
The way to respond is also important to see if it's taken from the dataset and add to the customization.
This is the first of a long serie of multiple models. Aimed to be minuscule as possible.
- Batch : 6
- Gradient step : 1
- Epoch : 1
- Lr : 0.0002 |