Dehnes commited on
Commit
225fa47
·
1 Parent(s): 7079f3b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -43,9 +43,9 @@ For this purpose, we translated the sentence pairs in these dataset to German.
43
 
44
  ### Performance
45
 
46
- We evaluated our model for the nli task using the TEST set of the German part of the [xnli](https://huggingface.co/datasets/xnli dataset).
47
 
48
- TEST-Set Accuracy: 86%
49
 
50
 
51
  ## Zeroshot Text Classification Task Benchmark
@@ -55,13 +55,14 @@ Specifically, we used all articles that were labeled "Kultur", "Sport", "Web", "
55
 
56
  The next table shows the results as well as a comparison with other German language zeroshot options performing the same task:
57
 
58
- | Model | NDCG@1 | NDCG@5 | NDCG@10 | Recall@1 | Recall@5 | Recall@10 |
59
 
60
- |:-------------------:|:------:|:------:|:-------:|:--------:|:--------:|:---------:|
 
 
 
 
61
 
62
- | BM25 | 0.1463 | 0.3451 | 0.4097 | 0.1463 | 0.5424 | 0.7415 |
63
-
64
- | BM25(Top 100) +Ours | 0.6410 | 0.7885 | 0.7943 | 0.6410 | 0.8576 | 0.9024 |
65
 
66
  ## Other Applications
67
 
 
43
 
44
  ### Performance
45
 
46
+ We evaluated our model for the nli task using the TEST set of the German part of the [xnli](https://huggingface.co/datasets/xnli) dataset.
47
 
48
+ XNLI TEST-Set Accuracy: 86%
49
 
50
 
51
  ## Zeroshot Text Classification Task Benchmark
 
55
 
56
  The next table shows the results as well as a comparison with other German language zeroshot options performing the same task:
57
 
58
+ | Model | Accuracy |
59
 
60
+ |:-------------------:|:------:|
61
+ | Svalabs/gbert-large-zeroshot-nli | 0.79 |
62
+ | Sahajtomar/German_Zeroshot | 0.76 |
63
+ | Symanto/xlm-roberta-base-snli-mnli-anli-xnli | 0.16 |
64
+ | deepset/gbert-base | 0.65 |
65
 
 
 
 
66
 
67
  ## Other Applications
68