| Model description: fra-cat | |
| Date: 2024-08-29 | |
| TF version 2.11.0, OpenNMT version 2.32.0, CTranslate2 version 3.22.0 | |
| Test data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 43.0 (μ = 43.0 ± 0.4) 69.5/49.4/37.7/29.3 (BP = 0.975 ratio = 0.975 hyp_len = 261302 ref_len = 267951) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 66.0 (μ = 66.0 ± 0.3) | |
| Flores data set | |
| BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 33.8 (μ = 33.7 ± 1.1) 63.1/39.8/27.2/19.0 (BP = 1.000 ratio = 1.006 hyp_len = 27479 ref_len = 27304) | |
| chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 60.0 (μ = 60.0 ± 0.7) | |