Am old enough to remember when @GeoffreyHinton told me I was stupid for saying that LLMs regurgitate training data. He was wrong. LLM regurgitation is now one of the best-established findings in the field. Excerpt below from a new DeepMind paper; every single one of the
@garymarcus
-
The challenges of LLM alignment with human values
By
–
Not even surprised by horrific stories like these anymore. The mission of getting LLMs aligned with human values has largely been a failure.
-
Debating the limits of self-play AI training in real-world environments
By
–
Really doubt what Hinton says here.
— Gary Marcus (@GaryMarcus) 11 mai 2026
Self-play for games like Go is not like the open-ended real world. https://t.co/6t5jUtajaVReally doubt what Hinton says here. Self-play for games like Go is not like the open-ended real world.
-
Community inquiry into Hermes AI model usage and applications
By
–
Who out there is using Hermes, and for what?
-
AI Progress: Misplaced Panic or Real Concerns?
By
–
https://
open.substack.com/pub/garymarcus
/p/misplaced-panic-over-ai-progress?r=8tdk6&utm_medium=ios
… -
Gary Marcus on AI progress by 2027
By
–
Ten of ten on this (and similar tasks) should be a lower bound: https://
garymarcus.substack.com/p/where-will-a
i-be-at-the-end-of-2027
… -
Gary Marcus on AGI and scaling limits
By
–
So many people misremember (or never read) what I said in in 2022 in “Deep learning is hitting a wall”, which was neither about revenue or AI’s potential upper limits. Rather, it was an argument that the pure of scaling LLMs would not get us to AGI, and that we would need to
-
METR’s Graph: 50% Success, Not 100
By
–
Hot take on METR’s new graph that so many people are flipping about today. • Claude Code is a real advance; Mythos probably builds on some of what is learned there. But… • If you read the graph carefully, it is about achieving *50%* success. Not 100 or 99 or even 90. The
-
Crypto Regulation Act Could Boost Market, Institutional Capital, Bitcoin
By
–
C’mon BBC. Zilis was sharp as a tack on the stand, on her role in the OpenAI *nonprofit* board, and how she managed conflicts as they began to develop, and this (which is not really even news since it was reported a couple years ago) is the headline. Annoying, sexist, and