KallistiTMR commited on
Commit
7e4b8d9
1 Parent(s): 80807a4

Upload model

Browse files
Files changed (2) hide show
  1. README.md +24 -0
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -796,6 +796,28 @@ The following `bitsandbytes` quantization config was used during training:
796
  - bnb_4bit_use_double_quant: False
797
  - bnb_4bit_compute_dtype: float16
798
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
799
  The following `bitsandbytes` quantization config was used during training:
800
  - load_in_8bit: False
801
  - load_in_4bit: True
@@ -880,5 +902,7 @@ The following `bitsandbytes` quantization config was used during training:
880
  - PEFT 0.4.0
881
  - PEFT 0.4.0
882
  - PEFT 0.4.0
 
 
883
 
884
  - PEFT 0.4.0
 
796
  - bnb_4bit_use_double_quant: False
797
  - bnb_4bit_compute_dtype: float16
798
 
799
+ The following `bitsandbytes` quantization config was used during training:
800
+ - load_in_8bit: False
801
+ - load_in_4bit: True
802
+ - llm_int8_threshold: 6.0
803
+ - llm_int8_skip_modules: None
804
+ - llm_int8_enable_fp32_cpu_offload: False
805
+ - llm_int8_has_fp16_weight: False
806
+ - bnb_4bit_quant_type: nf4
807
+ - bnb_4bit_use_double_quant: False
808
+ - bnb_4bit_compute_dtype: float16
809
+
810
+ The following `bitsandbytes` quantization config was used during training:
811
+ - load_in_8bit: False
812
+ - load_in_4bit: True
813
+ - llm_int8_threshold: 6.0
814
+ - llm_int8_skip_modules: None
815
+ - llm_int8_enable_fp32_cpu_offload: False
816
+ - llm_int8_has_fp16_weight: False
817
+ - bnb_4bit_quant_type: nf4
818
+ - bnb_4bit_use_double_quant: False
819
+ - bnb_4bit_compute_dtype: float16
820
+
821
  The following `bitsandbytes` quantization config was used during training:
822
  - load_in_8bit: False
823
  - load_in_4bit: True
 
902
  - PEFT 0.4.0
903
  - PEFT 0.4.0
904
  - PEFT 0.4.0
905
+ - PEFT 0.4.0
906
+ - PEFT 0.4.0
907
 
908
  - PEFT 0.4.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:512746b1d217a2938bff4cd73658a36ae2f43021d44b194dcbf313e14d5c46c0
3
  size 134263757
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9529aea378423fd00784964a2beb6e7dbad4c244f180378284dc9a07fcb1f1b6
3
  size 134263757