lewtun HF staff commited on
Commit
48570df
1 Parent(s): d68838b

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-launch__gov_report-plain_text-c8c9c8-1465553968).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -218,6 +218,39 @@ model-index:
218
  type: gen_len
219
  value: 54.2357
220
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
221
  ---
222
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
223
 
 
218
  type: gen_len
219
  value: 54.2357
220
  verified: true
221
+ - task:
222
+ type: summarization
223
+ name: Summarization
224
+ dataset:
225
+ name: launch/gov_report
226
+ type: launch/gov_report
227
+ config: plain_text
228
+ split: test
229
+ metrics:
230
+ - name: ROUGE-1
231
+ type: rouge
232
+ value: 37.0538
233
+ verified: true
234
+ - name: ROUGE-2
235
+ type: rouge
236
+ value: 8.1512
237
+ verified: true
238
+ - name: ROUGE-L
239
+ type: rouge
240
+ value: 17.6645
241
+ verified: true
242
+ - name: ROUGE-LSUM
243
+ type: rouge
244
+ value: 33.4275
245
+ verified: true
246
+ - name: loss
247
+ type: loss
248
+ value: 2.6052205562591553
249
+ verified: true
250
+ - name: gen_len
251
+ type: gen_len
252
+ value: 201.5951
253
+ verified: true
254
  ---
255
  # pszemraj/long-t5-tglobal-base-16384-booksum-V12
256