Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ model-index:
|
|
15 |
---
|
16 |
Update @ 2024.03.07
|
17 |
|
18 |
-
## T3Q-platypus-SOLAR
|
19 |
|
20 |
This model is a fine-tuned version of upstage/SOLAR-10.7B-v1.0
|
21 |
|
@@ -41,7 +41,7 @@ The following hyperparameters were used during training:
|
|
41 |
weight_decay = 0.01
|
42 |
max_grad_norm = 1.0
|
43 |
|
44 |
-
# LoRA config
|
45 |
lora_r = 16
|
46 |
lora_alpha = 16
|
47 |
lora_dropout = 0.05
|
|
|
15 |
---
|
16 |
Update @ 2024.03.07
|
17 |
|
18 |
+
## T3Q-platypus-SOLAR
|
19 |
|
20 |
This model is a fine-tuned version of upstage/SOLAR-10.7B-v1.0
|
21 |
|
|
|
41 |
weight_decay = 0.01
|
42 |
max_grad_norm = 1.0
|
43 |
|
44 |
+
# LoRA config(QLoRA)
|
45 |
lora_r = 16
|
46 |
lora_alpha = 16
|
47 |
lora_dropout = 0.05
|