@garymarcus

–

11 May 2026 23h55

that’s actually part of the question – can you make a couple trillion with something unreliable/something short of AGI

Estimating the Annual Revenue Required for AI Sustainability

By

–

11 May 2026 23h47

One estimate of how much annual revenue AI needs to “make sense”: 1.6 trillion. That’s four times what Google made in its best year. (total revenue so far is perhaps on order of 100 billion.)

Claude Code and the Role of Symbolic Tools in AI Reasoning

By

–

11 May 2026 23h35

1. Claude Code is not pure deep learning; without symbolic tools those results would not be achievable
2. Mythos probably isn’t pure deep learning either
3. Software engineering is something they have spent a lot of time engineering (not just with deep learning) and it admits

Technical clarification on LLM data processing and regurgitation mechanisms

By

–

11 May 2026 22h17

Since Hinton has actually replied let me clarify some things – LLMS don’t *always* regurgitate
– LLMs don’t literally store full texts
– but given the mechanisms that they use they do sometimes regurgitate long passes through their process of resynthesis
– the evidence for that

Analyzing the generative mechanics and hallucination patterns of LLMs

By

–

11 May 2026 21h46

they break things into bits. then they reconstitute them often the reconstitution includes verbatim repetition even the hallucinations are often combinations of real bits but from different people, articles that shouldn’t be combined all that has the flavor of pastische

On the nature of LLM memorization and data compression

By

–

11 May 2026 21h42

that’s why i always say to a first approximation and when given space go into why’s it not just memorization . but some of it is effectively memorization, in same extended sense as a JPEG is.

The Mirage of Visual Understanding in AI

By

–

11 May 2026 15h54

there’s a whole article on that phenomenon, in fact https://
garymarcus.substack.com/p/the-mirage-o
f-visual-understanding?r=8tdk6
…

Deconstructing Geoffrey Hinton’s perspectives on AI

By

–

11 May 2026 15h38

to understand the context, please read this: https://
open.substack.com/pub/garymarcus
/p/deconstructing-geoffrey-hintons-weakest?r=8tdk6&utm_medium=ios
…