Post
2061
Today we are introducing YaFSDP, Yandex’s tool for efficient distributed LLM training. YaFSDP can be used in conjunction with huggingface workflows and is up to 25% faster compared to FSDP.
Learn more here: https://github.com/yandex/YaFSDP
Learn more here: https://github.com/yandex/YaFSDP