solemn-leader
commited on
Commit
•
04e4d7e
1
Parent(s):
abb08f6
Update README.md
Browse files
README.md
CHANGED
@@ -9,28 +9,12 @@ The model should be used to produce relevance and specificity of the last messag
|
|
9 |
It is pretrained on corpus of dialog data from social networks and finetuned on [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity).
|
10 |
The performance of the model on validation split [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity) (with the best thresholds for validation samples):
|
11 |
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
</thead>
|
19 |
-
<tbody>
|
20 |
-
<tr>
|
21 |
-
<td><center>f0.5</center></td>
|
22 |
-
<td><center>roc-auc</center></td>
|
23 |
-
<td><center>f0.5</center></td>
|
24 |
-
<td><center>roc-auc</center></td>
|
25 |
-
</tr>
|
26 |
-
<tr>
|
27 |
-
<td><center>0.82</center></td>
|
28 |
-
<td><center>0.74</center></td>
|
29 |
-
<td><center>0.81</center></td>
|
30 |
-
<td><center>0.8</center></td>
|
31 |
-
</tr>
|
32 |
-
</tbody>
|
33 |
-
</table>
|
34 |
|
35 |
The model can be loaded as follows:
|
36 |
|
|
|
9 |
It is pretrained on corpus of dialog data from social networks and finetuned on [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity).
|
10 |
The performance of the model on validation split [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity) (with the best thresholds for validation samples):
|
11 |
|
12 |
+
```
|
13 |
+
| | f0.5 | ROC AUC |
|
14 |
+
|:------------|-------:|----------:|
|
15 |
+
| relevance | 0.82 | 0.74 |
|
16 |
+
| specificity | 0.81 | 0.8 |
|
17 |
+
````
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
The model can be loaded as follows:
|
20 |
|