autoevaluator HF staff commited on
Commit
69ca2c1
1 Parent(s): 30cefb0

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-launch__gov_report-plain_text-45e121-1564955705).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +37 -2
README.md CHANGED
@@ -10,8 +10,43 @@ license:
10
  - bsd-3-clause
11
  datasets:
12
  - kmfoda/booksum
13
-
14
- inference: False
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ---
16
 
17
 
 
10
  - bsd-3-clause
11
  datasets:
12
  - kmfoda/booksum
13
+ inference: false
14
+ model-index:
15
+ - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP17
16
+ results:
17
+ - task:
18
+ type: summarization
19
+ name: Summarization
20
+ dataset:
21
+ name: launch/gov_report
22
+ type: launch/gov_report
23
+ config: plain_text
24
+ split: test
25
+ metrics:
26
+ - name: ROUGE-1
27
+ type: rouge
28
+ value: 36.8427
29
+ verified: true
30
+ - name: ROUGE-2
31
+ type: rouge
32
+ value: 8.4234
33
+ verified: true
34
+ - name: ROUGE-L
35
+ type: rouge
36
+ value: 17.774
37
+ verified: true
38
+ - name: ROUGE-LSUM
39
+ type: rouge
40
+ value: 33.2901
41
+ verified: true
42
+ - name: loss
43
+ type: loss
44
+ value: 3.765686511993408
45
+ verified: true
46
+ - name: gen_len
47
+ type: gen_len
48
+ value: 213.8849
49
+ verified: true
50
  ---
51
 
52