update
Browse files- evaluation/intro.txt +1 -1
evaluation/intro.txt
CHANGED
@@ -16,7 +16,7 @@ In most papers, 200 candidate program completions are sampled, and pass@1, pass@
|
|
16 |
|GPT-neo (1.5B)| 4.79% | 7.47% | 16.30% |
|
17 |
|GPT-J (6B)| 11.62% | 15.74% | 27.74% |
|
18 |
|
19 |
-
We can load HumanEval dataset and pass@k metric from 🤗 `datasets`
|
20 |
|
21 |
```python
|
22 |
from datasets import load_dataset, load_metric
|
|
|
16 |
|GPT-neo (1.5B)| 4.79% | 7.47% | 16.30% |
|
17 |
|GPT-J (6B)| 11.62% | 15.74% | 27.74% |
|
18 |
|
19 |
+
We can load HumanEval dataset and pass@k metric from 🤗 [`datasets`](https://huggingface.co/docs/datasets/index)
|
20 |
|
21 |
```python
|
22 |
from datasets import load_dataset, load_metric
|