kaizuberbuehler commited on
Commit
451dbc4
1 Parent(s): 0b82236

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -13,11 +13,11 @@ license: llama3
13
  ## Training Details
14
 
15
  Hardware: 1x RTX 4090
16
- Duration: ~30 hours in total (~2 hours for first phase and ~28 hours for second phase)
17
 
18
  ### Hyperparameters
19
 
20
- Adapter: QLoRA\n
21
  Precision: 4 bit
22
  Optimizer: adamw_bnb_8bit
23
  LoRA Rank: 256
 
13
  ## Training Details
14
 
15
  Hardware: 1x RTX 4090
16
+ Duration: 30 hours in total (2 hours for first phase and 28 hours for second phase)
17
 
18
  ### Hyperparameters
19
 
20
+ Adapter: QLoRA
21
  Precision: 4 bit
22
  Optimizer: adamw_bnb_8bit
23
  LoRA Rank: 256