Model save

README.md

@@ -1,6 +1,5 @@
 ---
 library_name: transformers
-base_model: khairi/seq2seq-plm
 tags:
 - generated_from_trainer
 model-index:
@@ -11,10 +10,10 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/flursky/ProteinLanguageModeling/runs/iev7z03n)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/flursky/ProteinLanguageModeling/runs/474iqrlv)
 # seq2seq-plm
 
-This model is a fine-tuned version of [khairi/seq2seq-plm](https://huggingface.co/khairi/seq2seq-plm) on an unknown dataset.
+This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset.
 
 ## Model description
 
@@ -37,10 +36,12 @@ The following hyperparameters were used during training:
 - train_batch_size: 112
 - eval_batch_size: 112
 - seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 224
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 6000
-- num_epochs: 3
+- num_epochs: 5
 
 ### Framework versions