| Model description: ita-cat | |
| Date: 2024-08-29 | |
| TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0 | |
| Test data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 41.0 (μ = 41.0 ± 0.6) 68.3/47.6/35.7/27.2 (BP = 0.972 ratio = 0.972 hyp_len = 181416 ref_len = 186644) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 64.2 (μ = 64.2 ± 0.5) | |
| Flores data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 27.0 (μ = 26.9 ± 0.9) 58.3/33.1/20.7/13.3 (BP = 1.000 ratio = 1.034 hyp_len = 28237 ref_len = 27304) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 56.6 (μ = 56.6 ± 0.6) | |