Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,8 @@ language:
|
|
13 |
- de
|
14 |
- el
|
15 |
- es
|
16 |
-
- fr
|
|
|
17 |
- ru
|
18 |
- sw
|
19 |
- th
|
@@ -53,11 +54,11 @@ sequence_to_classify = "Angela Merkel ist eine Politikerin in Deutschland und Vo
|
|
53 |
candidate_labels = ["politics", "economy", "entertainment", "environment"]
|
54 |
classifier(sequence_to_classify, candidate_labels)
|
55 |
#{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
|
56 |
-
# 'labels': ['politics', 'economy', '
|
57 |
-
# 'scores': [0.
|
58 |
-
# 0.
|
59 |
-
# 0.
|
60 |
-
# 0.
|
61 |
```
|
62 |
|
63 |
If more than one candidate label can be correct, pass `multi_class=True` to calculate each class independently:
|
@@ -66,20 +67,20 @@ If more than one candidate label can be correct, pass `multi_class=True` to calc
|
|
66 |
candidate_labels = ["politics", "economy", "entertainment", "environment"]
|
67 |
classifier(sequence_to_classify, candidate_labels, multi_label=True)
|
68 |
#{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
|
69 |
-
# 'labels': ['politics', 'economy', '
|
70 |
-
# 'scores': [0.
|
71 |
-
# 0.
|
72 |
-
# 0.
|
73 |
-
# 0.
|
74 |
```
|
75 |
|
76 |
### Eval results
|
77 |
-
The model was evaluated using the XNLI test sets on
|
78 |
|
79 |
-
|Datasets|en|ar|bg|de|el|es|fr|ru|sw|th|tr|ur|vi|zh|
|
80 |
-
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
81 |
-
|[multilingual-e5-base-xnli](https://huggingface.co/mjwong/multilingual-e5-base-xnli)|0.849|0.771|0.800|0.796|0.795|0.812|0.801
|
82 |
-
|[multilingual-e5-large-xnli](https://huggingface.co/mjwong/multilingual-e5-large-xnli)|0.867|0.
|
83 |
|
84 |
### Training hyperparameters
|
85 |
|
|
|
13 |
- de
|
14 |
- el
|
15 |
- es
|
16 |
+
- fr
|
17 |
+
- hi
|
18 |
- ru
|
19 |
- sw
|
20 |
- th
|
|
|
54 |
candidate_labels = ["politics", "economy", "entertainment", "environment"]
|
55 |
classifier(sequence_to_classify, candidate_labels)
|
56 |
#{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
|
57 |
+
# 'labels': ['politics', 'economy', 'environment', 'entertainment'],
|
58 |
+
# 'scores': [0.4970444142818451,
|
59 |
+
# 0.3297286927700043,
|
60 |
+
# 0.08716338872909546,
|
61 |
+
# 0.086063452064991]}
|
62 |
```
|
63 |
|
64 |
If more than one candidate label can be correct, pass `multi_class=True` to calculate each class independently:
|
|
|
67 |
candidate_labels = ["politics", "economy", "entertainment", "environment"]
|
68 |
classifier(sequence_to_classify, candidate_labels, multi_label=True)
|
69 |
#{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
|
70 |
+
# 'labels': ['politics', 'economy', 'environment', 'entertainment'],
|
71 |
+
# 'scores': [0.6669772267341614,
|
72 |
+
# 0.4559520483016968,
|
73 |
+
# 0.004513110034167767,
|
74 |
+
# 0.0035143839195370674]}
|
75 |
```
|
76 |
|
77 |
### Eval results
|
78 |
+
The model was evaluated using the XNLI test sets on 15 languages: English (en), Arabic (ar), Bulgarian (bg), German (de), Greek (el), Spanish (es), French (fr), Hindi (hi), Russian (ru), Swahili (sw), Thai (th), Turkish (tr), Urdu (ur), Vietnam (vi) and Chinese (zh). The metric used is accuracy.
|
79 |
|
80 |
+
|Datasets|en|ar|bg|de|el|es|fr|hi|ru|sw|th|tr|ur|vi|zh|
|
81 |
+
| :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
82 |
+
|[multilingual-e5-base-xnli](https://huggingface.co/mjwong/multilingual-e5-base-xnli)|0.849|0.771|0.800|0.796|0.795|0.812|0.801|-|0.783|0.731|0.767|0.771|0.710|0.789|0.786|
|
83 |
+
|[multilingual-e5-large-xnli](https://huggingface.co/mjwong/multilingual-e5-large-xnli)|0.867|0.791|0.832|0.825|0.823|0.837|0.824|0.778|0.806|0.749|0.787|0.793|0.738|0.813|0.808|
|
84 |
|
85 |
### Training hyperparameters
|
86 |
|