KallistiTMR commited on
Commit
977b429
1 Parent(s): ec328dc

Upload model

Browse files
Files changed (2) hide show
  1. README.md +24 -0
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -191,6 +191,28 @@ The following `bitsandbytes` quantization config was used during training:
191
  - bnb_4bit_use_double_quant: False
192
  - bnb_4bit_compute_dtype: float16
193
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
194
  The following `bitsandbytes` quantization config was used during training:
195
  - load_in_8bit: False
196
  - load_in_4bit: True
@@ -220,5 +242,7 @@ The following `bitsandbytes` quantization config was used during training:
220
  - PEFT 0.4.0
221
  - PEFT 0.4.0
222
  - PEFT 0.4.0
 
 
223
 
224
  - PEFT 0.4.0
 
191
  - bnb_4bit_use_double_quant: False
192
  - bnb_4bit_compute_dtype: float16
193
 
194
+ The following `bitsandbytes` quantization config was used during training:
195
+ - load_in_8bit: False
196
+ - load_in_4bit: True
197
+ - llm_int8_threshold: 6.0
198
+ - llm_int8_skip_modules: None
199
+ - llm_int8_enable_fp32_cpu_offload: False
200
+ - llm_int8_has_fp16_weight: False
201
+ - bnb_4bit_quant_type: nf4
202
+ - bnb_4bit_use_double_quant: False
203
+ - bnb_4bit_compute_dtype: float16
204
+
205
+ The following `bitsandbytes` quantization config was used during training:
206
+ - load_in_8bit: False
207
+ - load_in_4bit: True
208
+ - llm_int8_threshold: 6.0
209
+ - llm_int8_skip_modules: None
210
+ - llm_int8_enable_fp32_cpu_offload: False
211
+ - llm_int8_has_fp16_weight: False
212
+ - bnb_4bit_quant_type: nf4
213
+ - bnb_4bit_use_double_quant: False
214
+ - bnb_4bit_compute_dtype: float16
215
+
216
  The following `bitsandbytes` quantization config was used during training:
217
  - load_in_8bit: False
218
  - load_in_4bit: True
 
242
  - PEFT 0.4.0
243
  - PEFT 0.4.0
244
  - PEFT 0.4.0
245
+ - PEFT 0.4.0
246
+ - PEFT 0.4.0
247
 
248
  - PEFT 0.4.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3d2f710ec2feaf7c728b2cd9545d724e8083a556679da8d7c8ba23bad48a485
3
  size 134263757
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e894ae74b441a6eac63d9fd231f42a2bddfec1c95ff728ef78d6ced10800a4d
3
  size 134263757