kbberendsen commited on
Commit
a360d1d
1 Parent(s): 5471520

End of training

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.7604
21
- - Matthews Correlation: 0.6799
22
 
23
  ## Model description
24
 
@@ -37,10 +37,10 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 8.402773307129759e-06
41
- - train_batch_size: 4
42
  - eval_batch_size: 16
43
- - seed: 3
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - num_epochs: 3
@@ -49,9 +49,9 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
52
- | 0.4745 | 1.0 | 2138 | 0.6074 | 0.6563 |
53
- | 0.3523 | 2.0 | 4276 | 0.7403 | 0.6752 |
54
- | 0.2013 | 3.0 | 6414 | 0.7604 | 0.6799 |
55
 
56
 
57
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5933
21
+ - Matthews Correlation: 0.6947
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - learning_rate: 2.148295560459091e-05
41
+ - train_batch_size: 16
42
  - eval_batch_size: 16
43
+ - seed: 28
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
  - num_epochs: 3
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Matthews Correlation |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------------------:|
52
+ | 0.3939 | 1.0 | 535 | 0.4206 | 0.6430 |
53
+ | 0.2243 | 2.0 | 1070 | 0.4502 | 0.6676 |
54
+ | 0.1443 | 3.0 | 1605 | 0.5933 | 0.6947 |
55
 
56
 
57
  ### Framework versions