Commit
•
9934de3
1
Parent(s):
343f860
Update README.md
Browse files
README.md
CHANGED
|
@@ -65,6 +65,8 @@ dataset | mnli-m-2c | mnli-mm-2c | fever-nli-2c | anli-all-2c | anli-r3-2c | lin
|
|
| 65 |
--------|---------|----------|---------|----------|----------|------
|
| 66 |
accuracy | 0.925 | 0.922 | 0.892 | 0.676 | 0.665 | 0.888
|
| 67 |
speed (text/sec, CPU, 128 batch) | 6.0 | 6.3 | 3.0 | 5.8 | 5.0 | 7.6
|
|
|
|
|
|
|
| 68 |
|
| 69 |
## Limitations and bias
|
| 70 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|
|
|
|
| 65 |
--------|---------|----------|---------|----------|----------|------
|
| 66 |
accuracy | 0.925 | 0.922 | 0.892 | 0.676 | 0.665 | 0.888
|
| 67 |
speed (text/sec, CPU, 128 batch) | 6.0 | 6.3 | 3.0 | 5.8 | 5.0 | 7.6
|
| 68 |
+
speed (text/sec, GPU, 128 batch) | 473 | 487 | 230 | 390 | 340 | 586
|
| 69 |
+
|
| 70 |
|
| 71 |
## Limitations and bias
|
| 72 |
Please consult the original DeBERTa paper and literature on different NLI datasets for potential biases.
|