Fizzarolli
commited on
Commit
•
e4a986c
1
Parent(s):
d8a7108
Update README.md
Browse files
README.md
CHANGED
@@ -31,4 +31,8 @@ alpaca-like:
|
|
31 |
```
|
32 |
|
33 |
## Training details
|
34 |
-
Rank 64 QDoRA, trained on
|
|
|
|
|
|
|
|
|
|
31 |
```
|
32 |
|
33 |
## Training details
|
34 |
+
Rank 64 QDoRA, trained on the following data mix:
|
35 |
+
- All of [kalomaze/Opus_Instruct_3k](kalomaze/Opus_Instruct_3k)
|
36 |
+
- All of [Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered](Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered)
|
37 |
+
- 50k of [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned](Gryphe/Sonnet3.5-SlimOrcaDedupCleaned)
|
38 |
+
- All stories above 4.7 rating and published before 2020 in [Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered](Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered)
|