Update README.md
Browse files
README.md
CHANGED
@@ -43,9 +43,9 @@ For this purpose, we translated the sentence pairs in these dataset to German.
|
|
43 |
|
44 |
### Performance
|
45 |
|
46 |
-
We evaluated our model for the nli task using the TEST set of the German part of the [xnli](https://huggingface.co/datasets/xnli dataset
|
47 |
|
48 |
-
TEST-Set Accuracy: 86%
|
49 |
|
50 |
|
51 |
## Zeroshot Text Classification Task Benchmark
|
@@ -55,13 +55,14 @@ Specifically, we used all articles that were labeled "Kultur", "Sport", "Web", "
|
|
55 |
|
56 |
The next table shows the results as well as a comparison with other German language zeroshot options performing the same task:
|
57 |
|
58 |
-
| Model |
|
59 |
|
60 |
-
|
|
|
|
|
|
|
|
|
61 |
|
62 |
-
| BM25 | 0.1463 | 0.3451 | 0.4097 | 0.1463 | 0.5424 | 0.7415 |
|
63 |
-
|
64 |
-
| BM25(Top 100) +Ours | 0.6410 | 0.7885 | 0.7943 | 0.6410 | 0.8576 | 0.9024 |
|
65 |
|
66 |
## Other Applications
|
67 |
|
|
|
43 |
|
44 |
### Performance
|
45 |
|
46 |
+
We evaluated our model for the nli task using the TEST set of the German part of the [xnli](https://huggingface.co/datasets/xnli) dataset.
|
47 |
|
48 |
+
XNLI TEST-Set Accuracy: 86%
|
49 |
|
50 |
|
51 |
## Zeroshot Text Classification Task Benchmark
|
|
|
55 |
|
56 |
The next table shows the results as well as a comparison with other German language zeroshot options performing the same task:
|
57 |
|
58 |
+
| Model | Accuracy |
|
59 |
|
60 |
+
|:-------------------:|:------:|
|
61 |
+
| Svalabs/gbert-large-zeroshot-nli | 0.79 |
|
62 |
+
| Sahajtomar/German_Zeroshot | 0.76 |
|
63 |
+
| Symanto/xlm-roberta-base-snli-mnli-anli-xnli | 0.16 |
|
64 |
+
| deepset/gbert-base | 0.65 |
|
65 |
|
|
|
|
|
|
|
66 |
|
67 |
## Other Applications
|
68 |
|