lewtun HF staff autoevaluator HF staff commited on
Commit
36985dd
1 Parent(s): f66377d

Add evaluation results on the default config of xsum (#6)

Browse files

- Add evaluation results on the default config of xsum (3ee105e5f16c573eeb5793008576fa3cbda941db)
- Merge branch 'main' into pr/6 (663310a2a342766f4b7f91119c4060729c298335)


Co-authored-by: Evaluation Bot <autoevaluator@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -78,6 +78,39 @@ model-index:
78
  type: gen_len
79
  value: 210.4762
80
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81
  ---
82
 
83
  # BigBirdPegasus model (large)
 
78
  type: gen_len
79
  value: 210.4762
80
  verified: true
81
+ - task:
82
+ type: summarization
83
+ name: Summarization
84
+ dataset:
85
+ name: xsum
86
+ type: xsum
87
+ config: default
88
+ split: test
89
+ metrics:
90
+ - name: ROUGE-1
91
+ type: rouge
92
+ value: 4.9787
93
+ verified: true
94
+ - name: ROUGE-2
95
+ type: rouge
96
+ value: 0.3527
97
+ verified: true
98
+ - name: ROUGE-L
99
+ type: rouge
100
+ value: 4.3679
101
+ verified: true
102
+ - name: ROUGE-LSUM
103
+ type: rouge
104
+ value: 4.1723
105
+ verified: true
106
+ - name: loss
107
+ type: loss
108
+ value: .nan
109
+ verified: true
110
+ - name: gen_len
111
+ type: gen_len
112
+ value: 230.4886
113
+ verified: true
114
  ---
115
 
116
  # BigBirdPegasus model (large)