Can you share your deepspeed config file

#5
by Cometyang - opened

Could you share the deepspeed config file?

Fireworks AI org

the deepspeed file is actually very standard,

deepspeed_config:
  deepspeed_multinode_launcher: standard
  offload_optimizer_device: none
  offload_param_device: none
  gradient_accumulation_steps: 1
  zero3_init_flag: true
  zero3_save_16bit_model: true
  zero_stage: 3
aravindputrevu changed discussion status to closed

Sign up or log in to comment