End of training

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [ehsanaghaei/SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.5237
-- Accuracy: 0.8909
+- Loss: 0.6754
+- Accuracy: 0.8977
 
 ## Model description
 
@@ -43,16 +43,20 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 8
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 110  | 0.4404          | 0.8773   |
-| No log        | 2.0   | 220  | 0.4733          | 0.8886   |
-| No log        | 3.0   | 330  | 0.5105          | 0.8864   |
-| No log        | 4.0   | 440  | 0.5237          | 0.8909   |
+| No log        | 1.0   | 110  | 0.5211          | 0.8886   |
+| No log        | 2.0   | 220  | 0.5437          | 0.8932   |
+| No log        | 3.0   | 330  | 0.5760          | 0.8909   |
+| No log        | 4.0   | 440  | 0.6122          | 0.8955   |
+| 0.103         | 5.0   | 550  | 0.6467          | 0.8932   |
+| 0.103         | 6.0   | 660  | 0.6633          | 0.8977   |
+| 0.103         | 7.0   | 770  | 0.6719          | 0.8977   |
+| 0.103         | 8.0   | 880  | 0.6754          | 0.8977   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6ec9e50196d8592cd2e1d8055546a72613e6c7f99424b3ce4e02ffa6ea31a5c1
+oid sha256:e6890e50e57597fb792bbc89b53653d824a6c56d3a5d9d771cbbcb9f6c68419e
 size 498640508