isanvicente
commited on
Commit
•
92e6076
1
Parent(s):
5871b6f
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,42 @@
|
|
1 |
---
|
2 |
license: cc-by-nc-4.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: cc-by-nc-4.0
|
3 |
+
metrics:
|
4 |
+
- accuracy
|
5 |
+
- f1
|
6 |
+
datasets:
|
7 |
+
- orai-nlp/basqueGLUE
|
8 |
+
language:
|
9 |
+
- eu
|
10 |
+
pipeline_tag: token-classification
|
11 |
+
tags:
|
12 |
+
- NERC
|
13 |
---
|
14 |
+
|
15 |
+
|
16 |
+
|
17 |
+
[ElhBERTeu](https://huggingface.co/orai-nlp/ElhBERTeu) model finetuned for NERC BasqueGlue dataset.
|
18 |
+
In Domain and Out-of-domain tasks' train and dev datasets were merge for training. Reported performance results are tested on the merged test dataset after training for 10 epochs (batch size 32, learning rate 3e-5).
|
19 |
+
|
20 |
+
Results on test set:
|
21 |
+
|
22 |
+
* accuracy = 0.9785551028520322
|
23 |
+
* f1 = 0.8665899340797322
|
24 |
+
* loss = 0.11313809949144367
|
25 |
+
* precision = 0.8650511802799248
|
26 |
+
* recall = 0.8681341719077568
|
27 |
+
|
28 |
+
Per class results:
|
29 |
+
|
30 |
+
accuracy: 97.86%; precision: 86.51%; recall: 86.81%; FB1: 86.66
|
31 |
+
LOC: precision: 89.43%; recall: 87.95%; FB1: 88.68 1844
|
32 |
+
MISC: precision: 70.72%; recall: 67.75%; FB1: 69.20 502
|
33 |
+
ORG: precision: 80.04%; recall: 84.32%; FB1: 82.12 1082
|
34 |
+
PER: precision: 93.52%; recall: 94.57%; FB1: 94.04 1359
|
35 |
+
|
36 |
+
|
37 |
+
|
38 |
+
Tagset:
|
39 |
+
["O", "B-ORG", "B-PER", "I-PER", "I-ORG", "B-LOC", "I-LOC", "B-MISC", "I-MISC",]
|
40 |
+
|
41 |
+
|
42 |
+
Finetuning details: 10 epochs, batch size 32, learning rate 3e-5.
|