Commit
•
0ce55af
1
Parent(s):
3bec671
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,7 @@ datasets:
|
|
| 9 |
**Data :** 100k from 1M Gpt-4 Orca data
|
| 10 |
|
| 11 |
**Training Params :**
|
|
|
|
| 12 |
batch_size_training: '16'
|
| 13 |
checkpoint_type: StateDictType.FULL_STATE_DICT
|
| 14 |
dataset: orca_dolphin_100k_gpt4
|
|
@@ -42,3 +43,4 @@ use_fp16: 'False'
|
|
| 42 |
use_peft: 'False'
|
| 43 |
val_batch_size: '16'
|
| 44 |
weight_decay: '0.0'
|
|
|
|
|
|
| 9 |
**Data :** 100k from 1M Gpt-4 Orca data
|
| 10 |
|
| 11 |
**Training Params :**
|
| 12 |
+
```
|
| 13 |
batch_size_training: '16'
|
| 14 |
checkpoint_type: StateDictType.FULL_STATE_DICT
|
| 15 |
dataset: orca_dolphin_100k_gpt4
|
|
|
|
| 43 |
use_peft: 'False'
|
| 44 |
val_batch_size: '16'
|
| 45 |
weight_decay: '0.0'
|
| 46 |
+
```
|