brucethemoose
commited on
Commit
•
107ece1
1
Parent(s):
601af45
Update README.md
Browse files
README.md
CHANGED
@@ -56,7 +56,7 @@ USER: {prompt}
|
|
56 |
ASSISTANT:
|
57 |
|
58 |
```
|
59 |
-
Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP if output doesn't seem right.
|
60 |
|
61 |
Sometimes the model "spells out" the stop token as `</s>` like Capybara, so you may need to add `</s>` as an additional stopping condition. It also might respond to the llama-2 chat format.
|
62 |
|
|
|
56 |
ASSISTANT:
|
57 |
|
58 |
```
|
59 |
+
Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP (and no other samplers) if output doesn't seem right. Yi tends to run "hot" by default.
|
60 |
|
61 |
Sometimes the model "spells out" the stop token as `</s>` like Capybara, so you may need to add `</s>` as an additional stopping condition. It also might respond to the llama-2 chat format.
|
62 |
|