At first, in the early 2020s, I worried that LLMs were often confidently wrong, calling them “fluent spouters of bullshit”. (And I was right; they have been and continue to be.). But now we have a new problem which is that *people* who *learn* from LLMs are also often
@garymarcus
-
Frontier Models Vision Capabilities: Benchmarks Gaming Problem
By
–
Frontier models can’t see, and if you think they can, you’ve probably been fooled by benchmarks that can totally be gamed. In the very short essay linked below I discuss a stunning new finding from Stanford that shows just how serious the problem is. And why this means a lot
-
ChatGPT 26 Times More Likely Give Dangerous Responses Study
By
–
People on this site regularly give me shit, and almost always turn out to be wrong. Like when I said LLMs might well contribute to delusions, and people doubted me. New study shows that ChatGPT was 26 times more likely than a control to give dangerous responses to people
-
Students Don’t Memorize Textbooks Verbatim Learning
By
–
students do not memorize textbooks and cannot repeat them verbatim
-
War and AI, the Death of Sora: Gary Marcus’s Latest Insights
By
–
War and AI, the death of Sora, and 3 ways you can catch me live today, https://
open.substack.com/pub/garymarcus
/p/war-and-ai-the-death-of-sora-and?r=8tdk6&utm_campaign=post&utm_medium=web&showWelcomeOnShare=true
… -
Explaining Why Sora is Not a Proper World Model
By
–
Search my tweets (or better yet my substack) w sora and world models for endless explanations for why Sora was NOT a proper world model.
-
Sora’s Commercialization Challenges: A Past Prediction
By
–
And I toldya two years ago Sora would have trouble commercializing. @sama shoulda listened to me.
-
Challenges of Group Dynamics in AI Agents
By
–
Groups of agents don’t magically sort out the unreliability of individual agents. Instead, they often get stuck.
