Add README
Browse files
README.md
ADDED
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language: en
|
3 |
+
---
|
4 |
+
|
5 |
+
# Sparse BERT base model fine tuned to MNLI (uncased)
|
6 |
+
|
7 |
+
Fine tuned sparse BERT base to MNLI (GLUE Benchmark) task from [bert-base-uncased-sparse-70-unstructured](https://huggingface.co/Intel/bert-base-uncased-sparse-70-unstructured).
|
8 |
+
<br><br>
|
9 |
+
Note: This model requires `transformers==2.10.0`
|
10 |
+
|
11 |
+
## Evaluation Results
|
12 |
+
Matched: 82.5%
|
13 |
+
Mismatched: 83.3%
|
14 |
+
|
15 |
+
This model can be further fine-tuned to other tasks and achieve the following evaluation results:
|
16 |
+
|
17 |
+
| Task | QQP (Acc/F1) | QNLI (Acc) | SST-2 (Acc) | STS-B (Pears/Spear) | SQuADv1.1 (Acc/F1) |
|
18 |
+
|------|--------------|------------|-------------|---------------------|--------------------|
|
19 |
+
| | 90.2/86.7 | 90.3 | 91.5 | 88.9/88.6 | 80.5/88.2 |
|