Add evaluation results on the samsum config of samsum

#2
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -217,6 +217,39 @@ model-index:
217
  type: gen_len
218
  value: 63.4493
219
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
220
  ---
221
 
222
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2
 
217
  type: gen_len
218
  value: 63.4493
219
  verified: true
220
+ - task:
221
+ type: summarization
222
+ name: Summarization
223
+ dataset:
224
+ name: samsum
225
+ type: samsum
226
+ config: samsum
227
+ split: test
228
+ metrics:
229
+ - name: ROUGE-1
230
+ type: rouge
231
+ value: 26.8026
232
+ verified: true
233
+ - name: ROUGE-2
234
+ type: rouge
235
+ value: 6.0656
236
+ verified: true
237
+ - name: ROUGE-L
238
+ type: rouge
239
+ value: 20.0098
240
+ verified: true
241
+ - name: ROUGE-LSUM
242
+ type: rouge
243
+ value: 21.9115
244
+ verified: true
245
+ - name: loss
246
+ type: loss
247
+ value: 2.317471981048584
248
+ verified: true
249
+ - name: gen_len
250
+ type: gen_len
251
+ value: 19.1111
252
+ verified: true
253
  ---
254
 
255
  # README - long-t5-tglobal-base-16384-booksum-V11-big_patent-V2