Update README.md

README.md

@@ -124,41 +124,43 @@ We compare our solution with both open automatic spell checkers and the ChatGPT
 **RUSpellRU**
 | Model | Pr. (spell) | Rec. (spell) | F1 (spell) | Pr. (punc) | Rec. (punc) | F1 (punc) | Pr. (case) | Rec. (case) | F1 (case) |
 | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | 
-| M2M100-1.2B | 59.4 | 43.3 | 50.1 | 59.4 | 43.3 | 50.1 | 59.4 | 43.3 | 50.1 |
+| sage-fredt5-large | x | x | x | x | x | x | x | x | x |
+| sage-fredt5-large (ft) | 88.4 | 80.9 | 84.5 | 88.2 | 85.3 | 86.8 | 95.5 | 94.0 | 94.7 |
+| sage-ai-service | 90.3 | 86.3 | 88.2 | 90.3 | 86.6 | 88.4 | 95.2 | 95.9 | 95.6 |
+| gpt-3.5-turbo | 33.6 | 58.5 | 42.7 | 85.9 | 64.6 | 73.7 | 84.9 | 73.9 | 79.0 |
+| gpt-4 | 54.9 | 76.7 | 64.0 | 84.0 | 82.3 | 83.2 | 91.5 | 90.2 | 90.9 |
 
 
 **MultidomainGold**
-| Model | Precision | Recall | F1 |
-| --- | --- | --- | --- |
-| M2M100-1.2B | 56.4 | 44.8 | 49.9 |
-| ChatGPT gpt-3.5-turbo-0301 | 33.8 | 72.1 | 46.0 |
-| ChatGPT gpt-4-0314 | 34.0 | 73.2 | 46.4 |
-| ChatGPT text-davinci-003 | 33.6 | 72.0 | 45.8 |
-| Yandex.Speller | 52.9 | 51.4 | 52.2 |
-| JamSpell | 25.7 | 30.6 | 28.0 |
-| HunSpell | 16.2 | 40.1 | 23.0 |
+| Model | Pr. (spell) | Rec. (spell) | F1 (spell) | Pr. (punc) | Rec. (punc) | F1 (punc) | Pr. (case) | Rec. (case) | F1 (case) |
+| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | 
+| sage-fredt5-large | x | x | x | x | x | x | x | x | x |
+| sage-fredt5-large (ft) | 80.3 | 75.1 | 77.6 | 69.0 | 66.5 | 67.7 | 78.6 | 80.0 | 79.3 |
+| sage-ai-service | 81.6 | 77.7 | 79.6 | 70.2 | 67.5 | 68.8 | 80.5 | 80.5 | 80.5 |
+| gpt-3.5-turbo | 18.8 | 48.1 | 27.1 | 42.0 | 31.8 | 36.2 | 47.1 | 51.3 | 49.1 |
+| gpt-4 | 25.4 | 68.0 | 37.0 | 57.8 | 54.3 | 56.0 | 54.0 | 67.5 | 60.0 |
+
 
 **MedSpellChecker**
-| Model | Precision | Recall | F1 |
-| --- | --- | --- | --- |
-| M2M100-1.2B | 63.7 | 57.8 | 60.6 |
-| ChatGPT gpt-3.5-turbo-0301 | 53.2 | 67.6 | 59.6 |
-| ChatGPT gpt-4-0314 | 54.2 | 69.4 | 60.9 |
-| ChatGPT text-davinci-003 | 47.8 | 68.4 | 56.3 |
-| Yandex.Speller | 80.6 | 47.8 | 60.0 |
-| JamSpell | 24.6 | 29.7 | 26.9 |
-| HunSpell | 10.3 | 40.2 | 16.4 |
+| Model | Pr. (spell) | Rec. (spell) | F1 (spell) | Pr. (punc) | Rec. (punc) | F1 (punc) | Pr. (case) | Rec. (case) | F1 (case) |
+| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | 
+| sage-fredt5-large | x | x | x | x | x | x | x | x | x |
+| sage-fredt5-large (ft) | 72.5 | 72.2 | 72.3 | 74.6 | 66.4 | 70.3 | 79.3 | 85.1 | 82.1 |
+| sage-ai-service | 71.3 | 73.5 | 72.4 | 75.1 | 69.2 | 72.0 | 80.9 | 72.8 | 76.6|
+| gpt-3.5-turbo | 14.7 | 45.9 | 22.3 | 69.9 | 52.3 | 59.8 | 26.4 | 41.8 | 32.3 |
+| gpt-4 | 37.8 | 72.3 | 49.6 | 81.4 | 64.3 | 71.9 | 73.0 | 62.1 | 67.1 |
+
 
 **GitHubTypoCorpusRu**
-| Model | Precision | Recall | F1 |
-| --- | --- | --- | --- |
-| M2M100-1.2B | 45.7 | 41.4 | 43.5 |
-| ChatGPT gpt-3.5-turbo-0301 | 43.8 | 57.0 | 49.6 |
-| ChatGPT gpt-4-0314 | 45.2 | 58.2 | 51.0 |
-| ChatGPT text-davinci-003 | 46.5 | 58.1 | 51.7 |
-| Yandex.Speller | 67.7 | 37.5 | 48.3 |
-| JamSpell | 49.5 | 29.9 | 37.3 |
-| HunSpell | 28.5 | 30.7 | 29.6 |
+| Model | Pr. (spell) | Rec. (spell) | F1 (spell) | Pr. (punc) | Rec. (punc) | F1 (punc) | Pr. (case) | Rec. (case) | F1 (case) |
+| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | 
+| sage-fredt5-large | x | x | x | x | x | x | x | x | x |
+| sage-fredt5-large (ft) | 88.4 | 80.9 | 84.5 | 88.2 | 85.3 | 86.8 | 95.5 | 94.0 | 94.7 |
+| sage-ai-service | 90.3 | 86.3 | 88.2 | 90.3 | 86.6 | 88.4 | 95.2 | 95.9 | 95.6 |
+| gpt-3.5-turbo | 33.6 | 58.5 | 42.7 | 85.9 | 64.6 | 73.7 | 84.9 | 73.9 | 79.0 |
+| gpt-4 | 54.9 | 76.7 | 64.0 | 84.0 | 82.3 | 83.2 | 91.5 | 90.2 | 90.9 |
+
+& \textbf{70.8} & \textbf{56.3} & \textbf{62.7} & \textbf{48.9} & 35.8 & 41.4 & 32.9 & 45.3 & 38.1
 
 ## How to use
 ```python