Commit
•
4342fe9
1
Parent(s):
c4c5364
update model card README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the None dataset.
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
-
- Loss: 1.
|
| 18 |
|
| 19 |
## Model description
|
| 20 |
|
|
@@ -39,27 +39,33 @@ The following hyperparameters were used during training:
|
|
| 39 |
- seed: 42
|
| 40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 41 |
- lr_scheduler_type: linear
|
| 42 |
-
- num_epochs:
|
| 43 |
|
| 44 |
### Training results
|
| 45 |
|
| 46 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 47 |
|:-------------:|:-----:|:------:|:---------------:|
|
| 48 |
-
| 1.
|
| 49 |
-
| 1.
|
| 50 |
-
| 1.
|
| 51 |
-
| 1.
|
| 52 |
-
| 1.
|
| 53 |
-
| 1.
|
| 54 |
-
| 1.
|
| 55 |
-
| 1.
|
| 56 |
-
| 1.
|
| 57 |
-
| 1.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
|
| 60 |
### Framework versions
|
| 61 |
|
| 62 |
-
- Transformers 4.22.
|
| 63 |
- Pytorch 1.12.1+cu113
|
| 64 |
- Datasets 2.4.0
|
| 65 |
- Tokenizers 0.12.1
|
|
|
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the None dataset.
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
+
- Loss: 1.1108
|
| 18 |
|
| 19 |
## Model description
|
| 20 |
|
|
|
|
| 39 |
- seed: 42
|
| 40 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 41 |
- lr_scheduler_type: linear
|
| 42 |
+
- num_epochs: 16
|
| 43 |
|
| 44 |
### Training results
|
| 45 |
|
| 46 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 47 |
|:-------------:|:-----:|:------:|:---------------:|
|
| 48 |
+
| 1.5688 | 1.0 | 39865 | 1.4449 |
|
| 49 |
+
| 1.4332 | 2.0 | 79730 | 1.3822 |
|
| 50 |
+
| 1.277 | 3.0 | 119595 | 1.3387 |
|
| 51 |
+
| 1.3483 | 4.0 | 159460 | 1.2833 |
|
| 52 |
+
| 1.2675 | 5.0 | 199325 | nan |
|
| 53 |
+
| 1.2381 | 6.0 | 239190 | 1.2546 |
|
| 54 |
+
| 1.1841 | 7.0 | 279055 | 1.2204 |
|
| 55 |
+
| 1.1608 | 8.0 | 318920 | 1.2095 |
|
| 56 |
+
| 1.2045 | 9.0 | 358785 | 1.1817 |
|
| 57 |
+
| 1.1401 | 10.0 | 398650 | 1.1810 |
|
| 58 |
+
| 1.0748 | 11.0 | 438515 | 1.1499 |
|
| 59 |
+
| 1.0857 | 12.0 | 478380 | 1.1345 |
|
| 60 |
+
| 1.0561 | 13.0 | 518245 | 1.1332 |
|
| 61 |
+
| 1.0431 | 14.0 | 558110 | 1.1127 |
|
| 62 |
+
| 1.0273 | 15.0 | 597975 | 1.1091 |
|
| 63 |
+
| 1.0275 | 16.0 | 637840 | 1.1108 |
|
| 64 |
|
| 65 |
|
| 66 |
### Framework versions
|
| 67 |
|
| 68 |
+
- Transformers 4.22.1
|
| 69 |
- Pytorch 1.12.1+cu113
|
| 70 |
- Datasets 2.4.0
|
| 71 |
- Tokenizers 0.12.1
|