CyberKitsuneSama commited on
Commit
8514d29
1 Parent(s): 37bd548

Model save

Browse files
README.md CHANGED
@@ -38,12 +38,12 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
- - train_batch_size: 3
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - gradient_accumulation_steps: 2
45
- - total_train_batch_size: 6
46
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
  - num_epochs: 3
@@ -55,7 +55,7 @@ The following hyperparameters were used during training:
55
  ### Framework versions
56
 
57
  - PEFT 0.13.2
58
- - Transformers 4.45.2
59
- - Pytorch 2.4.1+cu121
60
  - Datasets 3.0.2
61
  - Tokenizers 0.20.1
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
+ - train_batch_size: 1
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - gradient_accumulation_steps: 2
45
+ - total_train_batch_size: 2
46
+ - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
  - num_epochs: 3
 
55
  ### Framework versions
56
 
57
  - PEFT 0.13.2
58
+ - Transformers 4.46.0
59
+ - Pytorch 2.5.0+cu121
60
  - Datasets 3.0.2
61
  - Tokenizers 0.20.1
runs/Oct27_14-48-59_c13829df2d8a/events.out.tfevents.1730040550.c13829df2d8a.1511.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:12dcc6d1c26968089e5f7254e8688632ef749e7121b08c76f1569107fcbd23b9
3
- size 6529
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb23c9fdbd334345bd769ceadeb7a2de8fd45238e880ad63e208f3faa90b62ad
3
+ size 6877