Hugging Face's logo

Spaces:
codeparrot
/
code-generation-models
Running

App Files Community
10
loubnabnl HF staff commited on
Commit
73353ee
•
1 Parent(s): d0597c3

Update evaluation/intro.txt

Browse files
Files changed (1) hide show
  1. evaluation/intro.txt +1 -0
evaluation/intro.txt CHANGED
@@ -16,6 +16,7 @@ In most papers, 200 candidate program completions are sampled, and pass@1, pass@
16
  |||||
17
  |CodeGen-Mono (350M)| 12.76% | 23.11% | 35.19% |
18
  |CodeGen-Mono (2.7B)| 23.70% | 36.64% | 57.01% |
 
19
  |CodeGen-Mono (16.1B)| **29.28%** | **49.86%** | **75.00%** |
20
  |||||
21
  |Codex (25M)| 3.21% | 7.1% | 12.89%|
 
16
  |||||
17
  |CodeGen-Mono (350M)| 12.76% | 23.11% | 35.19% |
18
  |CodeGen-Mono (2.7B)| 23.70% | 36.64% | 57.01% |
19
+ |CodeGen-Mono (6.1B)| 26.13% | 42.29% | 65.82% |
20
  |CodeGen-Mono (16.1B)| **29.28%** | **49.86%** | **75.00%** |
21
  |||||
22
  |Codex (25M)| 3.21% | 7.1% | 12.89%|