autoevaluator HF staff commited on
Commit
81bb00f
1 Parent(s): cc842da

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-342ce6-2376174529).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -177,6 +177,39 @@ model-index:
177
  type: gen_len
178
  value: 233.8107
179
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
180
  ---
181
 
182
  # BigBirdPegasus model (large)
 
177
  type: gen_len
178
  value: 233.8107
179
  verified: true
180
+ - task:
181
+ type: summarization
182
+ name: Summarization
183
+ dataset:
184
+ name: kmfoda/booksum
185
+ type: kmfoda/booksum
186
+ config: kmfoda--booksum
187
+ split: test
188
+ metrics:
189
+ - name: ROUGE-1
190
+ type: rouge
191
+ value: 9.4741
192
+ verified: true
193
+ - name: ROUGE-2
194
+ type: rouge
195
+ value: 0.6261
196
+ verified: true
197
+ - name: ROUGE-L
198
+ type: rouge
199
+ value: 7.6203
200
+ verified: true
201
+ - name: ROUGE-LSUM
202
+ type: rouge
203
+ value: 8.8656
204
+ verified: true
205
+ - name: loss
206
+ type: loss
207
+ value: 7.033373832702637
208
+ verified: true
209
+ - name: gen_len
210
+ type: gen_len
211
+ value: 189.2068
212
+ verified: true
213
  ---
214
 
215
  # BigBirdPegasus model (large)