
AFAIK the most significant breakthrough since 2017 besides scaling old
ideas was broadening from base models into larger systems that incorporate symbol/manipulating entities like harnesses, tools, and code interpreters, enabling things like Claude Code.
