Hugging Face's logo

emilykang
/
Gemma_medprob-anatomy_lora

PEFT
Safetensors
trl
sft
Generated from Trainer
Model card Files Community
emilykang commited on
Commit
91839ee
·
verified ·
1 Parent(s): 791a423

End of training

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -38,11 +38,11 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
- - train_batch_size: 1
42
- - eval_batch_size: 8
43
  - seed: 42
44
  - gradient_accumulation_steps: 4
45
- - total_train_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: cosine
48
  - num_epochs: 10
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
+ - train_batch_size: 3
42
+ - eval_batch_size: 24
43
  - seed: 42
44
  - gradient_accumulation_steps: 4
45
+ - total_train_batch_size: 12
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: cosine
48
  - num_epochs: 10