SharonTudi
commited on
Commit
•
e21679e
1
Parent(s):
0399e96
End of training
Browse files
README.md
CHANGED
@@ -20,10 +20,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
20 |
|
21 |
This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on the None dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
-
- Loss: 1.
|
24 |
-
- Precision: 0.
|
25 |
- Recall: 0.8158
|
26 |
-
- F1: 0.
|
27 |
- Accuracy: 0.8158
|
28 |
|
29 |
## Model description
|
@@ -55,54 +55,54 @@ The following hyperparameters were used during training:
|
|
55 |
|
56 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
57 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
58 |
-
| 1.
|
59 |
-
| 0.
|
60 |
-
| 0.
|
61 |
-
| 0.
|
62 |
-
| 0.
|
63 |
-
| 0.
|
64 |
-
| 0.
|
65 |
-
| 0.
|
66 |
-
| 0.
|
67 |
-
| 0.
|
68 |
-
| 0.
|
69 |
-
| 0.
|
70 |
-
| 0.
|
71 |
-
| 0.
|
72 |
-
| 0.
|
73 |
-
| 0.
|
74 |
-
| 0.
|
75 |
-
| 0.
|
76 |
-
| 0.
|
77 |
-
| 0.
|
78 |
-
| 0.
|
79 |
-
| 0.
|
80 |
-
| 0.
|
81 |
-
| 0.
|
82 |
-
| 0.
|
83 |
-
| 0.
|
84 |
-
| 0.
|
85 |
-
| 0.0013 | 17.5 | 840 | 1.
|
86 |
-
| 0.0011 | 18.12 | 870 |
|
87 |
-
| 0.
|
88 |
-
| 0.
|
89 |
-
| 0.001 | 20.0 | 960 | 1.
|
90 |
-
| 0.
|
91 |
-
| 0.
|
92 |
-
| 0.
|
93 |
-
| 0.
|
94 |
-
| 0.
|
95 |
-
| 0.
|
96 |
-
| 0.0008 | 24.38 | 1170 | 1.
|
97 |
-
| 0.
|
98 |
-
| 0.
|
99 |
-
| 0.
|
100 |
-
| 0.
|
101 |
-
| 0.0007 | 27.5 | 1320 | 1.
|
102 |
-
| 0.
|
103 |
-
| 0.0007 | 28.75 | 1380 | 1.
|
104 |
-
| 0.0007 | 29.38 | 1410 | 1.
|
105 |
-
| 0.0007 | 30.0 | 1440 | 1.
|
106 |
|
107 |
|
108 |
### Framework versions
|
|
|
20 |
|
21 |
This model is a fine-tuned version of [distilbert-base-cased](https://huggingface.co/distilbert-base-cased) on the None dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 1.2483
|
24 |
+
- Precision: 0.8152
|
25 |
- Recall: 0.8158
|
26 |
+
- F1: 0.8141
|
27 |
- Accuracy: 0.8158
|
28 |
|
29 |
## Model description
|
|
|
55 |
|
56 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
57 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
58 |
+
| 1.3127 | 0.62 | 30 | 1.1497 | 0.6818 | 0.5263 | 0.4785 | 0.5263 |
|
59 |
+
| 0.8414 | 1.25 | 60 | 0.8096 | 0.7479 | 0.75 | 0.7472 | 0.75 |
|
60 |
+
| 0.597 | 1.88 | 90 | 0.6579 | 0.7904 | 0.7895 | 0.7873 | 0.7895 |
|
61 |
+
| 0.4417 | 2.5 | 120 | 0.5761 | 0.8072 | 0.8026 | 0.8026 | 0.8026 |
|
62 |
+
| 0.3041 | 3.12 | 150 | 0.6691 | 0.7665 | 0.7632 | 0.7598 | 0.7632 |
|
63 |
+
| 0.2384 | 3.75 | 180 | 0.6736 | 0.7717 | 0.7632 | 0.7645 | 0.7632 |
|
64 |
+
| 0.28 | 4.38 | 210 | 0.7949 | 0.7602 | 0.7632 | 0.7574 | 0.7632 |
|
65 |
+
| 0.22 | 5.0 | 240 | 0.8305 | 0.7917 | 0.7895 | 0.7879 | 0.7895 |
|
66 |
+
| 0.1427 | 5.62 | 270 | 0.7339 | 0.8041 | 0.8026 | 0.8025 | 0.8026 |
|
67 |
+
| 0.1875 | 6.25 | 300 | 0.7198 | 0.8031 | 0.7895 | 0.7909 | 0.7895 |
|
68 |
+
| 0.1216 | 6.88 | 330 | 0.7462 | 0.8315 | 0.8289 | 0.8287 | 0.8289 |
|
69 |
+
| 0.0895 | 7.5 | 360 | 0.8646 | 0.8070 | 0.8026 | 0.8006 | 0.8026 |
|
70 |
+
| 0.0758 | 8.12 | 390 | 1.0129 | 0.7883 | 0.7632 | 0.7642 | 0.7632 |
|
71 |
+
| 0.0636 | 8.75 | 420 | 0.9161 | 0.7893 | 0.7895 | 0.7866 | 0.7895 |
|
72 |
+
| 0.0239 | 9.38 | 450 | 0.9354 | 0.7409 | 0.7368 | 0.7367 | 0.7368 |
|
73 |
+
| 0.0449 | 10.0 | 480 | 1.0156 | 0.7994 | 0.8026 | 0.7980 | 0.8026 |
|
74 |
+
| 0.0089 | 10.62 | 510 | 0.9735 | 0.8125 | 0.8158 | 0.8125 | 0.8158 |
|
75 |
+
| 0.0348 | 11.25 | 540 | 1.0077 | 0.7867 | 0.7895 | 0.7848 | 0.7895 |
|
76 |
+
| 0.0037 | 11.88 | 570 | 1.1631 | 0.7868 | 0.7895 | 0.7857 | 0.7895 |
|
77 |
+
| 0.0022 | 12.5 | 600 | 1.1037 | 0.7998 | 0.8026 | 0.7993 | 0.8026 |
|
78 |
+
| 0.026 | 13.12 | 630 | 1.0309 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
79 |
+
| 0.0118 | 13.75 | 660 | 1.0360 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
80 |
+
| 0.0125 | 14.38 | 690 | 1.2095 | 0.7867 | 0.7895 | 0.7848 | 0.7895 |
|
81 |
+
| 0.0158 | 15.0 | 720 | 1.0658 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
82 |
+
| 0.0072 | 15.62 | 750 | 1.1267 | 0.7708 | 0.7763 | 0.7688 | 0.7763 |
|
83 |
+
| 0.0015 | 16.25 | 780 | 1.1247 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
84 |
+
| 0.0018 | 16.88 | 810 | 1.1386 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
85 |
+
| 0.0013 | 17.5 | 840 | 1.1468 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
86 |
+
| 0.0011 | 18.12 | 870 | 1.1692 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
87 |
+
| 0.0013 | 18.75 | 900 | 1.1734 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
88 |
+
| 0.0011 | 19.38 | 930 | 1.1857 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
89 |
+
| 0.001 | 20.0 | 960 | 1.1890 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
90 |
+
| 0.001 | 20.62 | 990 | 1.1924 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
91 |
+
| 0.0009 | 21.25 | 1020 | 1.2005 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
92 |
+
| 0.0009 | 21.88 | 1050 | 1.2084 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
93 |
+
| 0.0009 | 22.5 | 1080 | 1.2216 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
94 |
+
| 0.0009 | 23.12 | 1110 | 1.2237 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
95 |
+
| 0.0008 | 23.75 | 1140 | 1.2231 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
96 |
+
| 0.0008 | 24.38 | 1170 | 1.2286 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
97 |
+
| 0.0008 | 25.0 | 1200 | 1.2312 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
98 |
+
| 0.0008 | 25.62 | 1230 | 1.2325 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
99 |
+
| 0.0008 | 26.25 | 1260 | 1.2362 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
100 |
+
| 0.0008 | 26.88 | 1290 | 1.2415 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
101 |
+
| 0.0007 | 27.5 | 1320 | 1.2462 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
102 |
+
| 0.0008 | 28.12 | 1350 | 1.2471 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
103 |
+
| 0.0007 | 28.75 | 1380 | 1.2466 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
104 |
+
| 0.0007 | 29.38 | 1410 | 1.2478 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
105 |
+
| 0.0007 | 30.0 | 1440 | 1.2483 | 0.8152 | 0.8158 | 0.8141 | 0.8158 |
|
106 |
|
107 |
|
108 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 263150840
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6d3c41b4017d410532c8b0fb12589c9161c8be00ba1dd3ba20a730e04341e74e
|
3 |
size 263150840
|
runs/Jan29_14-51-37_32576c7247e4/events.out.tfevents.1706539898.32576c7247e4.511.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:72ff217c997afbef9ec11afb32302ecefbca8b0966c908df2c71ed1616f90901
|
3 |
+
size 34952
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4664
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ae7342bd96b9ca53380b39258ba45e713baac4e90ae52857115d48d99d0481cb
|
3 |
size 4664
|