from what i know (folks who worked on the infra bits at the other lab), the other lab forked pytorch several years ago for their large-scale runs before tensor subclasses were a thing, as they needed low and mixed precision types. now they have so much custom stuff on top of

→ View original post on X — @soumithchintala