Update README.md
Browse files
README.md
CHANGED
@@ -79,8 +79,7 @@ Use the code below to get started with the model.
|
|
79 |
|
80 |
#### Training Hyperparameters
|
81 |
|
82 |
-
|
83 |
-
|
84 |
- Training regime: Mixed precision training using bf16
|
85 |
- Number of epochs: 3
|
86 |
- Learning rate: 1e-4
|
|
|
79 |
|
80 |
#### Training Hyperparameters
|
81 |
|
82 |
+
<!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
|
|
83 |
- Training regime: Mixed precision training using bf16
|
84 |
- Number of epochs: 3
|
85 |
- Learning rate: 1e-4
|