It's not an assumption. Reasoning, as I define it, is simply not doable by a system that produces a finite number of tokens, each of which is produced by a neural net with a fixed number of layers.
RESEARCH
-
LLM reasoning vs rationalization and code as inner monologue
By
–
This used to always be true — If you ask an LLM "Why did you say that?" the answer is rationalization / guessing. It's only possibly reasoning if it comes before the answer. Code use is the asterisk: Interpreted code blocks serve as a de facto "inner monologue" it can recall.
-
Open Source Model Quality Standards and Rigorous Evaluation Criteria
By
–
Not this exact model.
But at some point, when we believe there’s a dramatically significant value add after rigorous ablations and evaluations and testing for use cases.
There are just too many open source models and it’s important to have a good bar for signal to noise ratio. -
AGI Safety Victory: Ensuring Beneficial Superintelligent Expansion
By
–
I can't quite say that I'd declare victory, because I need to know what use is going to be made of the rest of the accessible galaxies, if they all turn into cities of sapient life having fun. But that those AGIs were at least safe for humans–I am happy to call that game won.
-
Every Week Biggest Week Biggest Leap AI Content
By
–
When it comes to AI content — every week is the biggest week, and every thing is the biggest leap.
-
ChatGPT Mobile System Prompt: Shorter Answers, API Models for Research Data
By
–
ChatGPT on mobile includes a system prompt that asks for shorter answers, included whether or not you use custom instructions. Details like this (also, unannounced updates to the prompt) are why for research data you usually want the API models instead of ChatGPT.
-
ChatGPT mobile’s system prompt biases towards shorter answers, favoring API models for research.
By
–
ChatGPT on mobile includes a system prompt that asks for shorter answers, included whether or not you use custom instructions. Details like this (also, unannounced updates to the prompt) are why for research data you usually want the API models instead of ChatGPT.
-
Sundar Pichai Interview Lacks Depth on Gemini AI
By
–
Great questions in this Wired interview with Sundar Pichai. But, I wish they would have kept digging on Gemini and a few others. The answers lacked depth. https://
wired.com/story/sundar-p
ichai-google-ai-microsoft-openai/
… -
ASI Competition for Resources Threatens Human Survival
By
–
We compete for matter, negentropy, and humans creating actually-competitive additional ASIs if we're allowed to stick around. Or more plainly, if an ASI boils Earth's oceans as coolant for computation, humanity doesn't survive that.
-
Automatic Differentiation Explained in 30 Lines Python
By
–
Victor MARTIN ~ Understanding Automatic Differentiation in 30 lines of Python https://
bit.ly/3t0ejMg #AI #MachineLearning #DeepLearning #LLMs #DataScience