sahil2801 commited on
Commit
652196c
1 Parent(s): c21e0f1
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -5,6 +5,19 @@ metrics:
5
  pipeline_tag: text-generation
6
  tags:
7
  - code
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
  # Model Card for instruct-codegen-16B
10
 
@@ -14,7 +27,7 @@ Instruct-codegen-16B is an instruction following codegen model based on [Salesfo
14
 
15
  The data was not generated using any commercial LLM api.
16
 
17
- The model achieves a new SoTA result of 36.1% pass@1 on the HumanEval benchmark.
18
 
19
  ## Generation
20
 
 
5
  pipeline_tag: text-generation
6
  tags:
7
  - code
8
+ model-index:
9
+ - name: instruct-codegen-16B
10
+ results:
11
+ - task:
12
+ type: text-generation
13
+ dataset:
14
+ type: openai_humaneval
15
+ name: HumanEval
16
+ metrics:
17
+ - name: pass@1
18
+ type: pass@1
19
+ value: 0.371
20
+ verified: false
21
  ---
22
  # Model Card for instruct-codegen-16B
23
 
 
27
 
28
  The data was not generated using any commercial LLM api.
29
 
30
+ The model achieves a result of 37.1% pass@1 on the HumanEval benchmark.
31
 
32
  ## Generation
33