kaizuberbuehler
commited on
Commit
•
451dbc4
1
Parent(s):
0b82236
Update README.md
Browse files
README.md
CHANGED
@@ -13,11 +13,11 @@ license: llama3
|
|
13 |
## Training Details
|
14 |
|
15 |
Hardware: 1x RTX 4090
|
16 |
-
Duration:
|
17 |
|
18 |
### Hyperparameters
|
19 |
|
20 |
-
Adapter: QLoRA
|
21 |
Precision: 4 bit
|
22 |
Optimizer: adamw_bnb_8bit
|
23 |
LoRA Rank: 256
|
|
|
13 |
## Training Details
|
14 |
|
15 |
Hardware: 1x RTX 4090
|
16 |
+
Duration: 30 hours in total (2 hours for first phase and 28 hours for second phase)
|
17 |
|
18 |
### Hyperparameters
|
19 |
|
20 |
+
Adapter: QLoRA
|
21 |
Precision: 4 bit
|
22 |
Optimizer: adamw_bnb_8bit
|
23 |
LoRA Rank: 256
|