It's not an assumption. Reasoning, as I define it, is simply not doable by a system that produces a finite number of tokens, each of which is produced by a neural net with a fixed number of layers.
GENERATIVE AI
-
LLM reasoning vs rationalization and code as inner monologue
By
–
This used to always be true — If you ask an LLM "Why did you say that?" the answer is rationalization / guessing. It's only possibly reasoning if it comes before the answer. Code use is the asterisk: Interpreted code blocks serve as a de facto "inner monologue" it can recall.
-
Every Week Biggest Week Biggest Leap AI Content
By
–
When it comes to AI content — every week is the biggest week, and every thing is the biggest leap.
-
Shorter posts on X, skepticism for ChatGPT advice
By
–
Shorter is better on X — but yes, take everything I post on ChatGPT with a grain of salt for that reason. I used to be careful about posting generation params and preferring temp=0 in the GPT-3 days but with ChatGPT I don’t fight the quicksand.
-
Greatest threats to US national security in AI era
By
–
Which is the greatest threat to US National Security?
-
ChatGPT mobile’s system prompt biases towards shorter answers, favoring API models for research.
By
–
ChatGPT on mobile includes a system prompt that asks for shorter answers, included whether or not you use custom instructions. Details like this (also, unannounced updates to the prompt) are why for research data you usually want the API models instead of ChatGPT.
-
Using AI to Optimize 3D Printing Settings
By
–
Totally agree. I’m excited to use AI to help me dial in things to print.
-
User upgrades for Grok access and ad-free experience
By
–
Haha yeah I upgraded for @grok access, but the no ads bit sealed the deal. Def not WAI so I hope they drop a fix soon.
-
Subtle Differences in AI Assistant Greeting Responses Analysis
By
–
The difference between a world that starts with 'Hi there! How can I assist you today?' and one that begins with 'Hello! Is there anything I can assist you with today?' would be quite peculiar.
-
Sundar Pichai Interview Lacks Depth on Gemini AI
By
–
Great questions in this Wired interview with Sundar Pichai. But, I wish they would have kept digging on Gemini and a few others. The answers lacked depth. https://
wired.com/story/sundar-p
ichai-google-ai-microsoft-openai/
…