it "corrects" itself even when it's correct, if you prompt it that its wrong. so, I've not been able to rely on it's statements blindly without a citation
RESEARCH
-
Pretraining as Universal Compression: Learning to Simulate Nature
By
–
to pretrain is to learn to compress the universe. and as byproduct, learning to simulate all natural processes gather all the data you can. compress. backpropagate you don't see elegance in that?
-
AI’s Exponential Growth in Task Complexity
By
–
AI's Exponential Growth in Task Complexity
#AI #AIio #AIInnovation #ML #DataScience #Futureofwork @demishassabis @Ronald_vanLoon @TamaraMcCleary @geoffreyhinton @goodfellow_ian @jeffdean @erikbryn -
AI Researchers Race to Perfect Reinforcement Learning Scaling
By
–
there’s a palpable tension in the air as hundreds of AI researchers (including me!) quietly work nights and weekends trying to figure out the “right way” to scale RL math & code are not the universe we will not rest until post-training is as clean and elegant as pre-training
-

Why Do LLMs Gravitate Towards Laziness in Reasoning
By
–
I find it quite curious that LLMs gravitate towards laziness. As far as I know, reasoning LLMs are not penalised for using more compute, nor is o3 here actually using less compute when it takes five turns to deliberate whether it should do the task properly. Maybe training on
-

Frontier Models Medical Imaging: Hallucinations Limit Second Opinion
By
–
A note on this: We have enough evidence from controlled studies that it is likely smart to ask a frontier model for a second opinion. But it is also worth noting that the weakest link in both studies & reality is AI’s ability to “see” medical images. Hallucinations are common.
-
JEPA as LLM Plus: Implementation Challenges Explained
By
–
You could argue that JEPA is just LLM+tinything. Although getting tinything to actually work right is pretty hard.
-
Yann’s ASI Theory Beyond LLM Integration Strategy
By
–
Yann doesn't have a prior. He has a theory based on years of study. His theory doesn't need to change based on 01. He hasn't claimed llm will at least partially be part of asi. But since lots of other folks are already working on that bit, his best use of time is on other bits.
-
AI Update March 14 2025 News and Views From Past Week
By
–
AI Update, March 14, 2025: AI News and Views From the Past Week
#AI #AIio #AIInnovation #ML #DataScience #Futureofwork @Scobleizer @AndrewYNg @drfeifei @KirkDBorne @fchollet @rowancheung @antgrasso -
Confidence in AI Opinions Inversely Related to Knowledge
By
–
Those who know least about AI have the strongest opinions about it.