andysalerno commited on
Commit
5f47b4f
1 Parent(s): 2e3fef2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -31,4 +31,7 @@ Summary of versions:
31
  - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
32
 
33
  **[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
34
- - 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
 
 
 
 
31
  - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
32
 
33
  **[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
34
+ - 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
35
+
36
+ **[openchat-nectar-0.6](https://huggingface.co/andysalerno/openchat-nectar-0.6)**
37
+ - 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate. Same as 0.5 but with 1/10th the steps, and 10x the learning rate