add table
Browse files- evaluation/intro.txt +1 -0
evaluation/intro.txt
CHANGED
@@ -5,6 +5,7 @@ For most models, we sample 200 candidate program completions, and compute pass@1
|
|
5 |
|-------|--------|---------|---------|
|
6 |
|CodeParrot π¦ (110M) | 3.80% | 6.57% | 12.78% |
|
7 |
|CodeParrot π¦ (1.5B) | 3.58% | 8.03% | 14.96% |
|
|
|
8 |
|InCoder π¦ (6.7B) | 15.2% | 27.8% | 47.00% |
|
9 |
|||||
|
10 |
|Codex (25M)| 3.21% | 7.1% | 12.89%|
|
|
|
5 |
|-------|--------|---------|---------|
|
6 |
|CodeParrot π¦ (110M) | 3.80% | 6.57% | 12.78% |
|
7 |
|CodeParrot π¦ (1.5B) | 3.58% | 8.03% | 14.96% |
|
8 |
+
|||||
|
9 |
|InCoder π¦ (6.7B) | 15.2% | 27.8% | 47.00% |
|
10 |
|||||
|
11 |
|Codex (25M)| 3.21% | 7.1% | 12.89%|
|