view article Article Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel May 2, 2022 • 1