Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ This model was trained with a WizardCoder base, which itself uses a StarCoder ba
|
|
20 |
|
21 |
The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
|
22 |
|
23 |
-
It comes in at 39% on HumanEval, with WizardCoder at 57%. This is
|
24 |
|
25 |
However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
|
26 |
|
|
|
20 |
|
21 |
The model is truly great at code, but, it does come with a tradeoff though. While far better at code than the original Nous-Hermes built on Llama, it is worse than WizardCoder at pure code benchmarks, like HumanEval.
|
22 |
|
23 |
+
It comes in at 39% on HumanEval, with WizardCoder at 57%. This is a preliminary experiment, and we are exploring improvements now.
|
24 |
|
25 |
However, it does seem better at non-code than WizardCoder on a variety of things, including writing tasks.
|
26 |
|