autoevaluator HF staff commited on
Commit
a939822
·
1 Parent(s): c418955

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-ba6080-1564655701).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -47,6 +47,39 @@ model-index:
47
  type: gen_len
48
  value: 213.8849
49
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ---
51
 
52
 
 
47
  type: gen_len
48
  value: 213.8849
49
  verified: true
50
+ - task:
51
+ type: summarization
52
+ name: Summarization
53
+ dataset:
54
+ name: kmfoda/booksum
55
+ type: kmfoda/booksum
56
+ config: kmfoda--booksum
57
+ split: test
58
+ metrics:
59
+ - name: ROUGE-1
60
+ type: rouge
61
+ value: 35.4324
62
+ verified: true
63
+ - name: ROUGE-2
64
+ type: rouge
65
+ value: 5.9586
66
+ verified: true
67
+ - name: ROUGE-L
68
+ type: rouge
69
+ value: 16.134
70
+ verified: true
71
+ - name: ROUGE-LSUM
72
+ type: rouge
73
+ value: 32.4141
74
+ verified: true
75
+ - name: loss
76
+ type: loss
77
+ value: 3.050943374633789
78
+ verified: true
79
+ - name: gen_len
80
+ type: gen_len
81
+ value: 279.8735
82
+ verified: true
83
  ---
84
 
85