disi-unibo-nlp
/

MedGENIE-fid-flan-t5-base-medqa

Question Answering

text2text-generation

fusion-in-decoder

text-generation-inference

Model card Files Files and versions Community

alecocc commited on Feb 19, 2024

Commit

48937fe

·

verified ·

1 Parent(s): ec0d50b

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -109,9 +109,9 @@ The following hyperparameters were used during training:
 - accumulation_steps: 4
 - total_steps: 40,712
 - eval_freq: 10,178
-- optimizer: adamw
 - scheduler: linear
 - weight_decay: 0.01
-- warmup_ratio: 4,071
 - text_maxlength: 1024

 - accumulation_steps: 4
 - total_steps: 40,712
 - eval_freq: 10,178
+- optimizer: AdamW
 - scheduler: linear
 - weight_decay: 0.01
+- warmup_ratio: 0.1
 - text_maxlength: 1024