KallistiTMR
commited on
Commit
•
977b429
1
Parent(s):
ec328dc
Upload model
Browse files- README.md +24 -0
- adapter_model.bin +1 -1
README.md
CHANGED
@@ -191,6 +191,28 @@ The following `bitsandbytes` quantization config was used during training:
|
|
191 |
- bnb_4bit_use_double_quant: False
|
192 |
- bnb_4bit_compute_dtype: float16
|
193 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
194 |
The following `bitsandbytes` quantization config was used during training:
|
195 |
- load_in_8bit: False
|
196 |
- load_in_4bit: True
|
@@ -220,5 +242,7 @@ The following `bitsandbytes` quantization config was used during training:
|
|
220 |
- PEFT 0.4.0
|
221 |
- PEFT 0.4.0
|
222 |
- PEFT 0.4.0
|
|
|
|
|
223 |
|
224 |
- PEFT 0.4.0
|
|
|
191 |
- bnb_4bit_use_double_quant: False
|
192 |
- bnb_4bit_compute_dtype: float16
|
193 |
|
194 |
+
The following `bitsandbytes` quantization config was used during training:
|
195 |
+
- load_in_8bit: False
|
196 |
+
- load_in_4bit: True
|
197 |
+
- llm_int8_threshold: 6.0
|
198 |
+
- llm_int8_skip_modules: None
|
199 |
+
- llm_int8_enable_fp32_cpu_offload: False
|
200 |
+
- llm_int8_has_fp16_weight: False
|
201 |
+
- bnb_4bit_quant_type: nf4
|
202 |
+
- bnb_4bit_use_double_quant: False
|
203 |
+
- bnb_4bit_compute_dtype: float16
|
204 |
+
|
205 |
+
The following `bitsandbytes` quantization config was used during training:
|
206 |
+
- load_in_8bit: False
|
207 |
+
- load_in_4bit: True
|
208 |
+
- llm_int8_threshold: 6.0
|
209 |
+
- llm_int8_skip_modules: None
|
210 |
+
- llm_int8_enable_fp32_cpu_offload: False
|
211 |
+
- llm_int8_has_fp16_weight: False
|
212 |
+
- bnb_4bit_quant_type: nf4
|
213 |
+
- bnb_4bit_use_double_quant: False
|
214 |
+
- bnb_4bit_compute_dtype: float16
|
215 |
+
|
216 |
The following `bitsandbytes` quantization config was used during training:
|
217 |
- load_in_8bit: False
|
218 |
- load_in_4bit: True
|
|
|
242 |
- PEFT 0.4.0
|
243 |
- PEFT 0.4.0
|
244 |
- PEFT 0.4.0
|
245 |
+
- PEFT 0.4.0
|
246 |
+
- PEFT 0.4.0
|
247 |
|
248 |
- PEFT 0.4.0
|
adapter_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 134263757
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0e894ae74b441a6eac63d9fd231f42a2bddfec1c95ff728ef78d6ced10800a4d
|
3 |
size 134263757
|