qwerrwe / examples /phi /README.md
winglian's picture
Mixtral fixes 20240124 (#1192) [skip ci]
54d2ac1 unverified
|
raw
history blame
284 Bytes

Phi

Due to some nuances with the phi code, please use deepspeed when training phi for full finetune.

accelerate launch -m axolotl.cli.train examples/phi/phi-ft.yml --deepspeed deepspeed_configs/zero1.json

# OR

python -m axolotl.cli.train examples/phi/phi-qlora.yml