Hugging Face's logo

Tech-oriented
/
Roberta_peft_model

PEFT
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files Metrics Community
Tech-oriented commited on
Commit
5c4ce7f
•
1 Parent(s): 2d15ff7

End of training

Browse files
Files changed (3) hide show
  1. README.md +8 -8
  2. adapter_model.safetensors +1 -1
  3. runs/Mar07_13-41-06_4abb0d9b5b89/events.out.tfevents.1709822746.4abb0d9b5b89.204.6 +2 -2
README.md CHANGED
@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.2003
22
  - Accuracy: 0.9346
23
 
24
  ## Model description
@@ -38,8 +38,8 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 8.076177666053926e-05
42
- - train_batch_size: 32
43
  - eval_batch_size: 16
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -48,11 +48,11 @@ The following hyperparameters were used during training:
48
 
49
  ### Training results
50
 
51
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | 0.2406 | 1.0 | 2105 | 0.2060 | 0.9278 |
54
- | 0.2206 | 2.0 | 4210 | 0.2135 | 0.9266 |
55
- | 0.2058 | 3.0 | 6315 | 0.2003 | 0.9346 |
56
 
57
 
58
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.2535
22
  - Accuracy: 0.9346
23
 
24
  ## Model description
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 7.354779414396935e-05
42
+ - train_batch_size: 8
43
  - eval_batch_size: 16
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 
48
 
49
  ### Training results
50
 
51
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
+ | 0.2488 | 1.0 | 8419 | 0.2511 | 0.9289 |
54
+ | 0.2317 | 2.0 | 16838 | 0.2570 | 0.9312 |
55
+ | 0.2269 | 3.0 | 25257 | 0.2535 | 0.9346 |
56
 
57
 
58
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3eeb23dbdffcd1fd1cf825c9827aa9aa893d06de7e109ad346efea612bc0c2c5
3
  size 3555504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ad8603d93cb8ffed5f3b91d4876ba7a7201e84e5522c375271eade0be565b53
3
  size 3555504
runs/Mar07_13-41-06_4abb0d9b5b89/events.out.tfevents.1709822746.4abb0d9b5b89.204.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:27515a3583f0964066a93c71907604d88e8e6800a5e1ca4d137b02ee5337e0dc
3
- size 12311
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dd1052da41224cc9a613f333eae53208f2e6c2d3702c86df06bde1d0e6e75b4
3
+ size 16655