hogru commited on
Commit
81179a6
1 Parent(s): d818554

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -5
README.md CHANGED
@@ -71,9 +71,11 @@ The training data was pre-processed with a `PreTrainedTokenizerFast()` trained o
71
 
72
  - **Batch size:** 64
73
  - **Gradient accumulation steps:** 4
74
- - **Training regime:** fp16
75
- - **Learning rate:** 0.001
76
- - **Optimizer:** AdamW
 
 
77
  - **Number of epochs:** 50
78
 
79
  More configuration (options) can be found in the [`conf`](https://github.com/hogru/MolReactGen/tree/main/src/molreactgen/conf) directory of the repository.
@@ -97,8 +99,14 @@ Please see the slides / the poster mentioned above.
97
 
98
  ## Technical Specifications
99
 
100
- #### Hardware
 
 
 
 
 
 
 
101
 
102
  - Local PC running Ubuntu 22.04
103
  - NVIDIA GEFORCE RTX 3080Ti (12GB)
104
-
 
71
 
72
  - **Batch size:** 64
73
  - **Gradient accumulation steps:** 4
74
+ - **Mixed precision:** fp16, native amp
75
+ - **Learning rate:** 0.0025
76
+ - **LR Scheduler:** Cosine
77
+ - **Learning rate scheduler warmup:** 0.1
78
+ - **Optimizer:** AdamW with betas=(0.9,0.95) and epsilon=1e-08
79
  - **Number of epochs:** 50
80
 
81
  More configuration (options) can be found in the [`conf`](https://github.com/hogru/MolReactGen/tree/main/src/molreactgen/conf) directory of the repository.
 
99
 
100
  ## Technical Specifications
101
 
102
+ ### Framework versions
103
+
104
+ - Transformers 4.27.1
105
+ - Pytorch 1.13.1
106
+ - Datasets 2.10.1
107
+ - Tokenizers 0.13.2
108
+
109
+ ### Hardware
110
 
111
  - Local PC running Ubuntu 22.04
112
  - NVIDIA GEFORCE RTX 3080Ti (12GB)