autoevaluator HF staff commited on
Commit
297476b
1 Parent(s): df1b051

Add evaluation results on the default config and test split of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and test split of the [xsum](https://huggingface.co/datasets/xsum) dataset by

@dfantasy

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-xsum-default-01da82-33500145018).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- language:
3
  - en
4
  - fr
5
  - ro
@@ -11,6 +11,48 @@ tags:
11
  - translation
12
  datasets:
13
  - c4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  # Model Card for T5 Small
 
1
  ---
2
+ language:
3
  - en
4
  - fr
5
  - ro
 
11
  - translation
12
  datasets:
13
  - c4
14
+ model-index:
15
+ - name: t5-small
16
+ results:
17
+ - task:
18
+ type: summarization
19
+ name: Summarization
20
+ dataset:
21
+ name: xsum
22
+ type: xsum
23
+ config: default
24
+ split: test
25
+ metrics:
26
+ - type: rouge
27
+ value: 16.5377
28
+ name: ROUGE-1
29
+ verified: true
30
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTJjNDQxYTQyN2UyYmIzNWI4MzQ1YWRlMjQ0ZmRiZTFhYmFmYzY3M2Q2Y2ExODI4YjNhNDM4OTUwNzdhMWFlZCIsInZlcnNpb24iOjF9.VtMR0VAVgjRDvWZR0AeACKUnFLQPL5ksc2J2fvB1c1e3uUF5lWctvs649tXu0_ff8yo0p4K5jrOzKggl9P4jDw
31
+ - type: rouge
32
+ value: 2.0455
33
+ name: ROUGE-2
34
+ verified: true
35
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTBlNjY5MGZlODM0MWE2NjgzMjgyMjdiNjIwNTJhNWZkMmFhMzNkMWRmZjA0YzEyYmU4NmZhMWUwY2ZjMTJjMCIsInZlcnNpb24iOjF9.B1x3TI2JPq3vY5oXcU6YkR2i4q3_6wu4v72Mn0wXjgHlPfha2BLtsZEiMxZp4Qec5jQYM2K8GVwVdCBSatiJBg
36
+ - type: rouge
37
+ value: 13.0009
38
+ name: ROUGE-L
39
+ verified: true
40
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDlmYjIyMzIwZWNmNzMwNmRlY2Q1MzViYTAwNDIzOTE3Y2U4NGViMGIzYjFiNjU1Y2Q5YmNhYTM1MGUwMTk2ZCIsInZlcnNpb24iOjF9.mz77cnSSY6UcYT15ZlpafSrSxz61GbyPlq5zMJj1SqwC6gcyZ0VL-AY9lZDn9O71m7jgxRk8Vcr-kKYDLaNYBA
41
+ - type: rouge
42
+ value: 13.3011
43
+ name: ROUGE-LSUM
44
+ verified: true
45
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmY1OGUwODg5NDZkNTBiYzE4MWZkMWI5YzlmZDk4ZGZmMzU2MGMwODhkMGRkYTVmYzFlN2ZjZTEwNGQzOWE3MSIsInZlcnNpb24iOjF9.VSvfgSZ4Spl_2adC7XTCczv62ilS0_-fj2NKysnLlCKG7vNnQ6U4ZrstPNzHuL6B2MBKN58kqnGoRqj_YaIcCw
46
+ - type: loss
47
+ value: 3.8955957889556885
48
+ name: loss
49
+ verified: true
50
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYmQ3N2IxMTY0Y2NmMmU4Y2RhZDAwMjc1NTk4ODMzMjEyZjE1ODAxMTBjYjg4ZWJlODkyMjI0Njg4OGE5NDNlYiIsInZlcnNpb24iOjF9.naeDnPJkewRtLbtmdLDp7Gapk3tzIQD6krs-zPdHgLDTSyZ05S6GIPRGCN8PT3gosnawG9fEEk_O09v9r4luCw
51
+ - type: gen_len
52
+ value: 18.9674
53
+ name: gen_len
54
+ verified: true
55
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGYxOGNjNGM5YTc4YTk1M2VhZDE4ZmNlNTUwY2JkN2Q5NjhmZGY1NzRmZDIyZDUyNTQ1MmE5Yzk3NjhjOTdiNiIsInZlcnNpb24iOjF9.yemtSqIGeaGgrVZOIB6ahuZMhP1J-fDIbMbjve9G3e90uOPCOpmc16jFHEB19A4s5MLMQVdn-pDqgP5h706JDg
56
  ---
57
 
58
  # Model Card for T5 Small