Update README.md

README.md

@@ -79,11 +79,13 @@ Use the code below to get started with the model.
 
 #### Training Hyperparameters
 
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
-Training regime: Mixed precision training using bf16
-Number of epochs: 3
-Learning rate: 1e-4
-Batch size: 16
+- **Training regime:** <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+- Training regime: Mixed precision training using bf16
+- Number of epochs: 3
+- Learning rate: 1e-4
+- Batch size: 16
+- Seq length: 512
 
 #### Speeds, Sizes, Times [optional]