Published onSeptember 14, 2023How Data Parallelism & Hardware Affect SpeedTrainingDDPFSDPData-ParallelismHow fast you can train your model depends on your hardware and your parallelism strategy. Knowing your hardware will guide you on which strategy you should use.