The optimal batch size is 1
(For suitable definitions of "optimal")

→ View original post on X — @ylecun