ai doesn’t create because it “wants to.” it creates because we wired it to notice patterns. architectural choices like locality and equivariance force the model to capture structure in the data. that’s why it can remix old knowledge into something that looks new. creativity in
ETHICS
-
LLM Researchers’ Knowledge Gap About Language Fundamentals
By
–
Ironically, LLM researchers know nothing about language.
-
AI Parasitism: A Greater Threat Than Short-Form Video
By
–
Short-form video is not nearly the final boss, unless I've missed a huge number of cases of short videos destroying previously long-lasting marriages. AI parasitism seems like the worse, more advanced, more rapidly advancing people-eater.
-
Generative AI’s Widespread Structural Limitations Essay
By
–
of course they are (structured) representations. my recent relevant essay: https://
open.substack.com/pub/garymarcus
/p/generative-ais-crippling-and-widespread?r=8tdk6&utm_campaign=post&utm_medium=web&showWelcomeOnShare=false
… -
AI Hallucinations: Creativity or Anthropomorphization Error?
By
–
same guy says hallucinations are creative.
— Gary Marcus (@GaryMarcus) 28 septembre 2025
he’s right we shouldn’t anthopomorphize but he should stick with it. https://t.co/TnpWarYhoYsame guy says hallucinations are creative. he’s right we shouldn’t anthopomorphize but he should stick with it.
-
Tech Industry Overpromises: LLM Hallucinations Still Unsolved
By
–
How the tech industry rolls: Almost a million people viewed this May 2023 tweet from Mustafa Suleyman promising that “LLM hallucinations will be largely eliminated by 2025”; many of people believed it (and believed many similar promises from the tech industry). I didn’t — I
-
Chain of Thought vs True Reasoning in LLM Next Token Prediction
By
–
Feels about equivalent to chain of thought in next token guessing LLMs being used for "reasoning" to me
-
Civilizational Collapse Risk: AI and Societal Implications
By
–
Civilizational collapse awaits. (same in Europe my friend)
-
Expertise in AI: Should Expert Opinions Be Overweighted?
By
–
the counter to this would be that AI will have a dramatic impact and only a small number of people really understand how it works deeply so we should overweight their opinions, but i just find it interesting.