WTF is the “generative part of the brain”? Hello 1970s neuroscience, we need you for a cleanup in aisle 3. P.S. Brilliant reply by @bayesianboy at bottom.
@garymarcus
-
Sora’s Generalization Capabilities: Artifacts in Human Figure Generation
By
–
The completely amazing thing is how this baby generalizes!
— Gary Marcus (@GaryMarcus) 18 février 2024
I mean probably Sora has probably never been trained on people with three arms. (And what’s up with her neck?) https://t.co/xNBQmdqR3SThe completely amazing thing is how this baby generalizes! I mean probably Sora has probably never been trained on people with three arms. (And what’s up with her neck?)
-
Neural Networks Without Symbolic Representations Vulnerable to Hallucinations
By
–
Literally I have arguing for 23 years that neural nets without symbolic representations would be vulnerable to hallucinations, and they have. And literally every year (often daily) I have heard promissory notes like these, and never seen a detailed technical explanation as to https://
x.com/saehtweets/sta
/saehtweets/status/1759329436007112736
… -
OpenAI’s New Game: Spotting AI-Generated Video Violations
By
–
See how many physical and biological violations you can spot in this video. Fun new game, brought to you by OpenAI.
-
Robot with Impressive 180-Degree Head Swivel Capability
By
–
i kinda like the way she swivels her head almost 180 degrees
-
LLMs Limitations: Statistical Prediction Over True Reasoning
By
–
the solutions not come from within LLMs; they are doing the wrong kind of computation, which has nothing to do with facts and reasoning, and pertains only to prediction. The statistical inference has steadily improved with more data; problems with factuality and reliability
-
Accountability for unfulfilled AI promises and grand claims
By
–
Is there any kind of accountability at all for grand promises like these, if they don’t materialize?
-
Yann LeCun Revisits 2019 Predictions on LLM Limitations
By
–
Nice to see Yann LeCun 2024 making yet another set of points (re the intractability of predicting video from pixel space and the limits of LLMs) that I made in 2019 and 2020. He’s catching up!
-
AI/ML Founder Discusses Hallucinations and Model Limitations
By
–
dude, i built an AI/ML company that I sold to Uber, helping design the core IP, and went through the math leading to hallucinatons and troubles with extrapolation etc in 2001. I am not a nontechie.
-
Neural Networks History: From 1940s to Transformers 2017
By
–
(Depends what you count; neural nets go back to the 40s, backprop to roughly the 1960s, etc, though transformers per se only 2017)