andysalerno
commited on
Commit
•
5f47b4f
1
Parent(s):
2e3fef2
Update README.md
Browse files
README.md
CHANGED
@@ -31,4 +31,7 @@ Summary of versions:
|
|
31 |
- 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
|
32 |
|
33 |
**[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
|
34 |
-
- 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
|
|
|
|
|
|
|
|
31 |
- 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate
|
32 |
|
33 |
**[openchat-nectar-0.5](https://huggingface.co/andysalerno/openchat-nectar-0.5)**
|
34 |
+
- 5000 steps (over a full epoch), filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-6 learning rate. Same as 0.4 but with 10x the steps, and 1/10th the learning rate
|
35 |
+
|
36 |
+
**[openchat-nectar-0.6](https://huggingface.co/andysalerno/openchat-nectar-0.6)**
|
37 |
+
- 500 steps, filtered dataset to only include multi-chat-turn examples, used 4th ranking response as the "rejected" instead of 3rd, filtered out "good_natured=False", 5e-5 learning rate. Same as 0.5 but with 1/10th the steps, and 10x the learning rate
|