i.e I wouldn't be at all shocked to hear that there are (were?) OOM inefficiencies in xai's training code base.

→ View original post on X — @jeremyphoward