Added model evaluation results
Browse files
README.md
CHANGED
@@ -8,6 +8,9 @@ metrics:
|
|
8 |
model-index:
|
9 |
- name: Sinhala-toxic-bert
|
10 |
results: []
|
|
|
|
|
|
|
11 |
---
|
12 |
|
13 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
@@ -20,17 +23,17 @@ It achieves the following results on the evaluation set:
|
|
20 |
- Loss: 0.2358
|
21 |
- F1: 0.8877
|
22 |
|
23 |
-
## Model description
|
24 |
-
|
25 |
-
More information needed
|
26 |
-
|
27 |
## Intended uses & limitations
|
28 |
|
29 |
More information needed
|
30 |
|
31 |
## Training and evaluation data
|
32 |
|
33 |
-
|
|
|
|
|
|
|
|
|
34 |
|
35 |
## Training procedure
|
36 |
|
@@ -60,10 +63,27 @@ The following hyperparameters were used during training:
|
|
60 |
| 0.2272 | 0.72 | 900 | 0.2424 | 0.8878 |
|
61 |
| 0.2331 | 0.8 | 1000 | 0.2358 | 0.8877 |
|
62 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
|
64 |
### Framework versions
|
65 |
|
66 |
- Transformers 4.35.2
|
67 |
- Pytorch 2.1.0+cu118
|
68 |
- Datasets 2.15.0
|
69 |
-
- Tokenizers 0.15.0
|
|
|
8 |
model-index:
|
9 |
- name: Sinhala-toxic-bert
|
10 |
results: []
|
11 |
+
language:
|
12 |
+
- si
|
13 |
+
pipeline_tag: text-classification
|
14 |
---
|
15 |
|
16 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
23 |
- Loss: 0.2358
|
24 |
- F1: 0.8877
|
25 |
|
|
|
|
|
|
|
|
|
26 |
## Intended uses & limitations
|
27 |
|
28 |
More information needed
|
29 |
|
30 |
## Training and evaluation data
|
31 |
|
32 |
+
Labels
|
33 |
+
```plaintext
|
34 |
+
NEGATIVE: 1
|
35 |
+
POSITIVE: 0
|
36 |
+
```
|
37 |
|
38 |
## Training procedure
|
39 |
|
|
|
63 |
| 0.2272 | 0.72 | 900 | 0.2424 | 0.8878 |
|
64 |
| 0.2331 | 0.8 | 1000 | 0.2358 | 0.8877 |
|
65 |
|
66 |
+
Model performance on validation dataset
|
67 |
+
|
68 |
+
```plaintext
|
69 |
+
precision recall f1-score support
|
70 |
+
|
71 |
+
0 0.95 0.92 0.93 6943
|
72 |
+
1 0.82 0.88 0.84 2913
|
73 |
+
|
74 |
+
accuracy 0.90 9856
|
75 |
+
macro avg 0.88 0.90 0.89 9856
|
76 |
+
weighted avg 0.91 0.90 0.91 9856
|
77 |
+
```
|
78 |
+
|
79 |
+
<img
|
80 |
+
src="https://cdn-uploads.huggingface.co/production/uploads/60f2e10dadf471cbdf8bb661/Yi9TbdOF6CoMfKk40Bcvu.png"
|
81 |
+
alt="Confusion Matrix on Validation Data"
|
82 |
+
width="300">
|
83 |
|
84 |
### Framework versions
|
85 |
|
86 |
- Transformers 4.35.2
|
87 |
- Pytorch 2.1.0+cu118
|
88 |
- Datasets 2.15.0
|
89 |
+
- Tokenizers 0.15.0
|