This take feels very off. With the speed of this model, I’d expect it’s close to an order of magnitude smaller than older GPT-4 models. Take the learnings and approaches from building this, scale them up, and you have something way better than GPT-4.

→ View original post on X — @mattshumer_