qwerrwe / examples /mistral /mixtral.yml

Commit History

Mixtral fixes 20240124 (#1192) [skip ci]
54d2ac1
unverified

winglian commited on

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]
782b6a4
unverified

winglian Nanobit commited on

set output_router_logits for mixtral config: (#995)
628b754
unverified

winglian commited on

Fix Deepspeed loading (#950)
5ea3aa3
unverified

winglian commited on

new evals_per_epoch and saves_per_epoch to make things cleaner (#944)
5f79b82
unverified

winglian commited on

Mixtral official (#942)
7fabc4d
unverified

winglian commited on

update to latest transformers for mixstral support (#929)
35f9b0f
unverified

winglian commited on

Mixtral multipack (#928)
68b227a
unverified

winglian commited on