didn't realize it was that easy, will take a look at; you can also try decreasing the batch size all the way down to 1, or then also decreasing sequence length until it fits, but you're compromising on max context length that way.

→ View original post on X — @karpathy