dyang415
/

mixtral-fc-op

Generated from Trainer

4-bit precision

Model card Files Files and versions Metrics Training metrics Community

dyang415 commited on Feb 29

Commit

ea5dccb

•

1 Parent(s): 7dd9018

End of training

Files changed (2) hide show

README.md +2 -2
adapter_model.bin +2 -2

README.md CHANGED Viewed

@@ -59,8 +59,8 @@ sequence_len: 16384
 sample_packing: true
 pad_to_sequence_len: true
-lora_r: 8
-lora_alpha: 16
 lora_dropout: 0.05
 lora_target_modules:
   - q_proj

 sample_packing: true
 pad_to_sequence_len: true
+lora_r: 32
+lora_alpha: 64
 lora_dropout: 0.05
 lora_target_modules:
   - q_proj

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d21af6e8357542230e8b9669f5183ae711e8dae8c2d5c7cbd94887f8c73239e2
-size 27354957

 version https://git-lfs.github.com/spec/v1
+oid sha256:980935465efa3cec4fd6359f359bc6095d31e819a26810b94efbd8e71148e8f1
+size 109144269