Model save

README.md

@@ -36,12 +36,12 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 4
+- train_batch_size: 2
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 8
+- gradient_accumulation_steps: 16
 - total_train_batch_size: 32
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
 - num_epochs: 3
@@ -53,7 +53,7 @@ The following hyperparameters were used during training:
 ### Framework versions
 
 - PEFT 0.13.0
-- Transformers 4.45.1
-- Pytorch 2.4.0+cu121
+- Transformers 4.46.2
+- Pytorch 2.5.1+cu124
 - Datasets 3.0.1
 - Tokenizers 0.20.1

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e1442a5629ad7c2f09ec309fad5d7075a72d97ec41d521ad7684f34fab982012
+oid sha256:7de34466b39df7011662d89c36d38a70a1445b965b0a0ceae9759ce01f0c0204
 size 23641256

runs/Nov18_20-35-33_tscc-gpu-10-6/events.out.tfevents.1731990934.tscc-gpu-10-6.1071227.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:943e680a868dc41a2c186aa58d2704ad574ce9d6c957cbeb0e313374e00f47e3
-size 85076
+oid sha256:386729db946e83e33fe73ae15a40b1e26cfa568cb7b1e66d1fa2a3fa17499f16
+size 122777