Scaling PyTorch FSDP for Training Foundation Models on IBM Cloud (PT Conf. '22 Breakout Session)
So my name is Raku Kanti. I’m from IBM Research and today I’ll be talking about how do we scale the PyTorch FSDP on IBM Cloud using Ethernet. So before I jump into how do we use FSDP and what are the key contributions that we have done? What I want to talk about is […]