Thanks for writing & sharing your latest article on MPT. Really well written and has just the right level of detail .
One question though. You wrote > "The entire training framework is based upon PyTorch’s Fully Sharded Data Parallel (FSDP) package and uses no pipeline or

→ View original post on X — @rasbt,