mjwong commited on
Commit
6625e2d
1 Parent(s): de2d91d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -16
README.md CHANGED
@@ -13,7 +13,8 @@ language:
13
  - de
14
  - el
15
  - es
16
- - fr
 
17
  - ru
18
  - sw
19
  - th
@@ -53,11 +54,11 @@ sequence_to_classify = "Angela Merkel ist eine Politikerin in Deutschland und Vo
53
  candidate_labels = ["politics", "economy", "entertainment", "environment"]
54
  classifier(sequence_to_classify, candidate_labels)
55
  #{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
56
- # 'labels': ['politics', 'economy', 'entertainment', 'environment'],
57
- # 'scores': [0.6869393587112427,
58
- # 0.18112628161907196,
59
- # 0.07022464275360107,
60
- # 0.06170979142189026]}
61
  ```
62
 
63
  If more than one candidate label can be correct, pass `multi_class=True` to calculate each class independently:
@@ -66,20 +67,20 @@ If more than one candidate label can be correct, pass `multi_class=True` to calc
66
  candidate_labels = ["politics", "economy", "entertainment", "environment"]
67
  classifier(sequence_to_classify, candidate_labels, multi_label=True)
68
  #{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
69
- # 'labels': ['politics', 'economy', 'entertainment', 'environment'],
70
- # 'scores': [0.9068101644515991,
71
- # 0.2646591067314148,
72
- # 0.00299322628416121,
73
- # 0.0016029390972107649]}
74
  ```
75
 
76
  ### Eval results
77
- The model was evaluated using the XNLI test sets on 14 languages: English (en), Arabic (ar), Bulgarian (bg), German (de), Greek (el), Spanish (es), French (fr), Russian (ru), Swahili (sw), Thai (th), Turkish (tr), Urdu (ur), Vietnam (vi) and Chinese (zh). The metric used is accuracy.
78
 
79
- |Datasets|en|ar|bg|de|el|es|fr|ru|sw|th|tr|ur|vi|zh|
80
- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
81
- |[multilingual-e5-base-xnli](https://huggingface.co/mjwong/multilingual-e5-base-xnli)|0.849|0.771|0.800|0.796|0.795|0.812|0.801|0.783|0.731|0.767|0.771|0.710|0.789|0.786|
82
- |[multilingual-e5-large-xnli](https://huggingface.co/mjwong/multilingual-e5-large-xnli)|0.867|0.798|0.829|0.821|0.820|0.838|0.828|0.810|0.752|0.787|0.794|0.726|0.804|0.810|
83
 
84
  ### Training hyperparameters
85
 
 
13
  - de
14
  - el
15
  - es
16
+ - fr
17
+ - hi
18
  - ru
19
  - sw
20
  - th
 
54
  candidate_labels = ["politics", "economy", "entertainment", "environment"]
55
  classifier(sequence_to_classify, candidate_labels)
56
  #{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
57
+ # 'labels': ['politics', 'economy', 'environment', 'entertainment'],
58
+ # 'scores': [0.4970444142818451,
59
+ # 0.3297286927700043,
60
+ # 0.08716338872909546,
61
+ # 0.086063452064991]}
62
  ```
63
 
64
  If more than one candidate label can be correct, pass `multi_class=True` to calculate each class independently:
 
67
  candidate_labels = ["politics", "economy", "entertainment", "environment"]
68
  classifier(sequence_to_classify, candidate_labels, multi_label=True)
69
  #{'sequence': 'Angela Merkel ist eine Politikerin in Deutschland und Vorsitzende der CDU',
70
+ # 'labels': ['politics', 'economy', 'environment', 'entertainment'],
71
+ # 'scores': [0.6669772267341614,
72
+ # 0.4559520483016968,
73
+ # 0.004513110034167767,
74
+ # 0.0035143839195370674]}
75
  ```
76
 
77
  ### Eval results
78
+ The model was evaluated using the XNLI test sets on 15 languages: English (en), Arabic (ar), Bulgarian (bg), German (de), Greek (el), Spanish (es), French (fr), Hindi (hi), Russian (ru), Swahili (sw), Thai (th), Turkish (tr), Urdu (ur), Vietnam (vi) and Chinese (zh). The metric used is accuracy.
79
 
80
+ |Datasets|en|ar|bg|de|el|es|fr|hi|ru|sw|th|tr|ur|vi|zh|
81
+ | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
82
+ |[multilingual-e5-base-xnli](https://huggingface.co/mjwong/multilingual-e5-base-xnli)|0.849|0.771|0.800|0.796|0.795|0.812|0.801|-|0.783|0.731|0.767|0.771|0.710|0.789|0.786|
83
+ |[multilingual-e5-large-xnli](https://huggingface.co/mjwong/multilingual-e5-large-xnli)|0.867|0.791|0.832|0.825|0.823|0.837|0.824|0.778|0.806|0.749|0.787|0.793|0.738|0.813|0.808|
84
 
85
  ### Training hyperparameters
86