Thanks for writing & sharing your latest article on MPT. Really well written and has just the right level of detail .
One question though. You wrote > "The entire training framework is based upon PyTorch’s Fully Sharded Data Parallel (FSDP) package and uses no pipeline or
Appreciation for MPT Article and FSDP Implementation Question
By
–