Update README.md
Browse files
README.md
CHANGED
@@ -71,9 +71,11 @@ The training data was pre-processed with a `PreTrainedTokenizerFast()` trained o
|
|
71 |
|
72 |
- **Batch size:** 64
|
73 |
- **Gradient accumulation steps:** 4
|
74 |
-
- **
|
75 |
-
- **Learning rate:** 0.
|
76 |
-
- **
|
|
|
|
|
77 |
- **Number of epochs:** 50
|
78 |
|
79 |
More configuration (options) can be found in the [`conf`](https://github.com/hogru/MolReactGen/tree/main/src/molreactgen/conf) directory of the repository.
|
@@ -97,8 +99,14 @@ Please see the slides / the poster mentioned above.
|
|
97 |
|
98 |
## Technical Specifications
|
99 |
|
100 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
101 |
|
102 |
- Local PC running Ubuntu 22.04
|
103 |
- NVIDIA GEFORCE RTX 3080Ti (12GB)
|
104 |
-
|
|
|
71 |
|
72 |
- **Batch size:** 64
|
73 |
- **Gradient accumulation steps:** 4
|
74 |
+
- **Mixed precision:** fp16, native amp
|
75 |
+
- **Learning rate:** 0.0025
|
76 |
+
- **LR Scheduler:** Cosine
|
77 |
+
- **Learning rate scheduler warmup:** 0.1
|
78 |
+
- **Optimizer:** AdamW with betas=(0.9,0.95) and epsilon=1e-08
|
79 |
- **Number of epochs:** 50
|
80 |
|
81 |
More configuration (options) can be found in the [`conf`](https://github.com/hogru/MolReactGen/tree/main/src/molreactgen/conf) directory of the repository.
|
|
|
99 |
|
100 |
## Technical Specifications
|
101 |
|
102 |
+
### Framework versions
|
103 |
+
|
104 |
+
- Transformers 4.27.1
|
105 |
+
- Pytorch 1.13.1
|
106 |
+
- Datasets 2.10.1
|
107 |
+
- Tokenizers 0.13.2
|
108 |
+
|
109 |
+
### Hardware
|
110 |
|
111 |
- Local PC running Ubuntu 22.04
|
112 |
- NVIDIA GEFORCE RTX 3080Ti (12GB)
|
|