Fizzarolli commited on
Commit
e4a986c
1 Parent(s): d8a7108

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -31,4 +31,8 @@ alpaca-like:
31
  ```
32
 
33
  ## Training details
34
- Rank 64 QDoRA, trained on primarily Claude and Gemma 2 multiturn data (it's midnight and I'll probably write more details tomorrow)
 
 
 
 
 
31
  ```
32
 
33
  ## Training details
34
+ Rank 64 QDoRA, trained on the following data mix:
35
+ - All of [kalomaze/Opus_Instruct_3k](kalomaze/Opus_Instruct_3k)
36
+ - All of [Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered](Magpie-Align/Magpie-Gemma2-Pro-Preview-Filtered)
37
+ - 50k of [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned](Gryphe/Sonnet3.5-SlimOrcaDedupCleaned)
38
+ - All stories above 4.7 rating and published before 2020 in [Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered](Fizzarolli/FallingThroughTheSkies-592k-Filtered-Filtered)