isanvicente commited on
Commit
92e6076
1 Parent(s): 5871b6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md CHANGED
@@ -1,3 +1,42 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ metrics:
4
+ - accuracy
5
+ - f1
6
+ datasets:
7
+ - orai-nlp/basqueGLUE
8
+ language:
9
+ - eu
10
+ pipeline_tag: token-classification
11
+ tags:
12
+ - NERC
13
  ---
14
+
15
+
16
+
17
+ [ElhBERTeu](https://huggingface.co/orai-nlp/ElhBERTeu) model finetuned for NERC BasqueGlue dataset.
18
+ In Domain and Out-of-domain tasks' train and dev datasets were merge for training. Reported performance results are tested on the merged test dataset after training for 10 epochs (batch size 32, learning rate 3e-5).
19
+
20
+ Results on test set:
21
+
22
+ * accuracy = 0.9785551028520322
23
+ * f1 = 0.8665899340797322
24
+ * loss = 0.11313809949144367
25
+ * precision = 0.8650511802799248
26
+ * recall = 0.8681341719077568
27
+
28
+ Per class results:
29
+
30
+ accuracy: 97.86%; precision: 86.51%; recall: 86.81%; FB1: 86.66
31
+ LOC: precision: 89.43%; recall: 87.95%; FB1: 88.68 1844
32
+ MISC: precision: 70.72%; recall: 67.75%; FB1: 69.20 502
33
+ ORG: precision: 80.04%; recall: 84.32%; FB1: 82.12 1082
34
+ PER: precision: 93.52%; recall: 94.57%; FB1: 94.04 1359
35
+
36
+
37
+
38
+ Tagset:
39
+ ["O", "B-ORG", "B-PER", "I-PER", "I-ORG", "B-LOC", "I-LOC", "B-MISC", "I-MISC",]
40
+
41
+
42
+ Finetuning details: 10 epochs, batch size 32, learning rate 3e-5.