So I’ve heard too, not sure.
(fwiw I’d be inclined to focus on the Transformer and ignore ResNets, too)

→ View original post on X — @karpathy