Add evaluation results on the default config and test split of xsum
Browse filesBeep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config and test split of the [xsum](https://huggingface.co/datasets/xsum) dataset by
@oh
aziz principle asadza e akram aur mere aziz sathion, alslam o alikum mera naam nadia akram hai aur main jmat e nahm ki tulba hun meri aaj ki tkrir ka unwaan hai ustaad ka mukaam. aj jo hamari dars gahon main ustaad hoty hain hakikat main aik quom ki buniad hoty hain. Sathion aik ustaad ka kaam hai ke woh humein jahalat ki tarikiyon sy nikal kr Ilm ki norani dunia main laty hain ustaad humain achhy bure ka fark btate hain akl o shaur ko nikharty hain aur humin is qabil banaty hain ke zindagi ke mrahl sy asani se guzar sakein., using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-xsum-default-80767e-59416145366).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).
@@ -6,7 +6,46 @@ datasets:
|
|
6 |
- samsum
|
7 |
model-index:
|
8 |
- name: pegasus-samsum
|
9 |
-
results:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
---
|
11 |
|
12 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
6 |
- samsum
|
7 |
model-index:
|
8 |
- name: pegasus-samsum
|
9 |
+
results:
|
10 |
+
- task:
|
11 |
+
type: summarization
|
12 |
+
name: Summarization
|
13 |
+
dataset:
|
14 |
+
name: xsum
|
15 |
+
type: xsum
|
16 |
+
config: default
|
17 |
+
split: test
|
18 |
+
metrics:
|
19 |
+
- type: rouge
|
20 |
+
value: 21.9916
|
21 |
+
name: ROUGE-1
|
22 |
+
verified: true
|
23 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGM1NDhjZDQ0M2ZjZTgxMTg1OWM4NjdmMGI4ODQyNTU2OTQ0OTY2ODc4MWNhNzU4MWM2NTBhZTQ1YzdlMTllMSIsInZlcnNpb24iOjF9.JZWxpX_rKcfTW-QhTsI_TqhL8GdENnfRXPpB8P4W0u3VSS4WC133IqeP9SvD8gWXxeKxYEcjwRDd864v46kBCA
|
24 |
+
- type: rouge
|
25 |
+
value: 4.4258
|
26 |
+
name: ROUGE-2
|
27 |
+
verified: true
|
28 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODE4ZjM2ZTg2MmRlZTYwNmY4NTU2OWUwODhiODI3ZDQ2MmFkNGI0MGRlOTBlYmJhZTVjNzM2Y2E4ZTBjMjBhNCIsInZlcnNpb24iOjF9.4KVR6h7JIHwDX0EbzS503EhVKIFY7MhMU9xLm5OzboYKRnI_8UrjijIVGkT68k20LdFfcVv2oddtcZkrM0CcBw
|
29 |
+
- type: rouge
|
30 |
+
value: 14.9274
|
31 |
+
name: ROUGE-L
|
32 |
+
verified: true
|
33 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGU0ZTRhODdlYWNhOGU5YmRkNjU4YWU1MDlhOWZjODI1NGEzMDZkYWI4ZGE0YzBmYTk3ZTljOWM2MGI1NTQ5YiIsInZlcnNpb24iOjF9.0IwWROcDNkQOJ4reQd0zpjyMAeTV5_SG5mydpQZlTVzLlt1SpC6BhitaQFa3_eXcJ_H91JUjJIz9Gjqcow7KDQ
|
34 |
+
- type: rouge
|
35 |
+
value: 16.6553
|
36 |
+
name: ROUGE-LSUM
|
37 |
+
verified: true
|
38 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGQ2YmFiZWU4ZGY0NzZiNjk1NjMxOTk4NzI0MTU1MDIwNjdmMGYzMWJiYWJhZTMzZjU3NWNiMDVhNTlmYWNmOCIsInZlcnNpb24iOjF9.GjiA4KFUWw1IWn5q1qRWo-B4BEg04xAe0Lkoi_2zlFcyDoJZUgk1_VHzpmK1F72NO5a55lE-GiMRRxJcES5vCA
|
39 |
+
- type: loss
|
40 |
+
value: 2.3909709453582764
|
41 |
+
name: loss
|
42 |
+
verified: true
|
43 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzMxYTE4ZWUxZWU4ZGZhNWY0ZjA2ZGU2ZTc5N2FjMjA0ZjI5YTFmMzZmMGI0MDEyMGYzZTllM2I2ZWIxZGEwZSIsInZlcnNpb24iOjF9.BnmMbMl2n3cGwkb6C5BF7mesa6WmFp0EcoqYCdkIdXYdM8Jo2svmaUz-JniLLGVuj-UoAyvUfYQe1dXPPPZcBg
|
44 |
+
- type: gen_len
|
45 |
+
value: 54.1562
|
46 |
+
name: gen_len
|
47 |
+
verified: true
|
48 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWJiNmZmMTIyNmNjOTExYzYyNmI5OGVjMTQwOGY3NDk1YTUwYzdlZWE4YmMwYWVmOTE0Mjg3MTEzYjEzMTgwNiIsInZlcnNpb24iOjF9.IisBh3s_yDr6nF-VwobRo8Fe63Qc8Ku_2KgNfjwv16yEPQd5kX8rCg056rT_DhtXzxTxNRMyXLKCodIewbaPAQ
|
49 |
---
|
50 |
|
51 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|