Translation: Auto-Regressive LLMs scaling is giving diminishing returns. As I've said repeatedly, a new architecture will emerge for the next leap, perhaps along the lines of the Objective-Driven AI I've been proposing. But deep learning will still be the foundation. No wall.

→ View original post on X — @ylecun,