i suspect the notion of causality is in some form innate
RESEARCH
-
Brain Organization Precedes Experience in Learning Mechanisms
By
–
they don’t fully understand it, but a large fraction of brain organization precedes prior to or independently of experience, and underwrite the various kinds of learning mechanisms that different creatures have.
-
Video Model Limitations and LLM Improvement Potential
By
–
In both cases you can come up with edge-cases that expose their limitations – with LLMs may or those limitations see overcome as the models improve, will be interesting to see if that happens for video models
-
Chain of Thought vs True Reasoning in LLM Next Token Prediction
By
–
Feels about equivalent to chain of thought in next token guessing LLMs being used for "reasoning" to me
-

OpenAI: energy consumption multiplied by 125 in 8 years
By
–
OpenAI expects its energy use to grow 125x over the next 8 years. That would be more electricity than India consumes today. "Building out 17 gigawatts of capacity would require the equivalent of about 17 nuclear power plants, each of which takes at least a decade to build. The
-
GRPO-based models and gibberish detection techniques
By
–
I think they are all basically based on GPRO++, Dr. GRPO etc. But the one interesting one is the Gibberish detection. Need to borrow this!
-
PPO Algorithm Consistency Across Different Reward Signal Implementations
By
–
I'd have said the opposite as they all use the same PPO (or PPO-like) algorithm, just with different reward signals
-
The Bitter Lesson’s Bitter Lesson: AI Learning from Human Knowledge
By
–
.
@iamtrask has a terrific new blog post, the Bitter Lesson's Bitter Lesson, where he concludes: "Nature spent billions of years learning not to start over—and the future belongs to AI systems that can inherit vast human knowledge while maintaining robust capabilities for novel -
Andrew Trask’s Bitter Lessons in AI Development
By
–
Here's Andrew Trask's blog post: https://
andrewtrask.substack.com/p/the-bitter-l
essons-bitter-lesson
… -

Novel cancer therapy targets multiple tumors simultaneously using sugar patterns
By
–
Lets go: New cancer treatment allows multiple tumors to be fought simultaneously! Researchers have developed a novel cancer therapy that can attack many types of tumors simultaneously by exploiting a common “weak point”: specific sugar patterns that occur much more frequently on