yeah fp16 is a little more efficient atm for the code as I have it right now but then need gradient scaler ;s

→ View original post on X — @karpathy