IlyaGusev
/

mbart_ru_sum_gazeta

text2text-generation

Inference Endpoints

Model card Files Files and versions Community

IlyaGusev commited on Nov 20, 2021

Commit

22472c2

•

1 Parent(s): 37a48b2

Update README.md

Files changed (1) hide show

README.md +11 -1

README.md CHANGED Viewed

@@ -67,9 +67,19 @@ print(summary)
 ## Eval results
 | Model                     | R-1-f | R-2-f | R-L-f | METEOR | BLEU |
 |:--------------------------|:------|:------|:------|:-------|:-----|
-| gazeta_mbart              | 32.3  | 14.3  | 27.9  | 25.5   | 12.4 |
 Predicting all summaries:
 ```python

 ## Eval results
+Gazeta v1 train -> Gazeta v1 test
+| Model                     | R-1-f | R-2-f | R-L-f | METEOR | BLEU |
+|:--------------------------|:------|:------|:------|:-------|:-----|
+| mbart_ru_sum_gazeta       | 32.1  | 14.3  | **27.9**  | **25.7**   | **12.4** |
+| rut5_base_sum_gazeta      | **32.3**  | **14.5**  | 27.9  | 25.1   | 11.5 |
+Gazeta v1 train -> Gazeta v2 test
 | Model                     | R-1-f | R-2-f | R-L-f | METEOR | BLEU |
 |:--------------------------|:------|:------|:------|:-------|:-----|
+| mbart_ru_sum_gazeta       | **28.8**  | **11.1**  | **24.5**  | **22.7**   | **9.5** |
+| rut5_base_sum_gazeta      | 28.5  | 11.0  | 24.2  | 21.2   | 8.6 |
 Predicting all summaries:
 ```python