Literally I have arguing for 23 years that neural nets without symbolic representations would be vulnerable to hallucinations, and they have. And literally every year (often daily) I have heard promissory notes like these, and never seen a detailed technical explanation as to https://
x.com/saehtweets/sta
/saehtweets/status/1759329436007112736
…
@garymarcus
-
Neural Networks Without Symbolic Representations Vulnerable to Hallucinations
By
–
-
OpenAI’s New Game: Spotting AI-Generated Video Violations
By
–
See how many physical and biological violations you can spot in this video. Fun new game, brought to you by OpenAI.
-
Robot with Impressive 180-Degree Head Swivel Capability
By
–
i kinda like the way she swivels her head almost 180 degrees
-
LLMs Limitations: Statistical Prediction Over True Reasoning
By
–
the solutions not come from within LLMs; they are doing the wrong kind of computation, which has nothing to do with facts and reasoning, and pertains only to prediction. The statistical inference has steadily improved with more data; problems with factuality and reliability
-
Accountability for unfulfilled AI promises and grand claims
By
–
Is there any kind of accountability at all for grand promises like these, if they don’t materialize?
-
Yann LeCun Revisits 2019 Predictions on LLM Limitations
By
–
Nice to see Yann LeCun 2024 making yet another set of points (re the intractability of predicting video from pixel space and the limits of LLMs) that I made in 2019 and 2020. He’s catching up!
-
AI/ML Founder Discusses Hallucinations and Model Limitations
By
–
dude, i built an AI/ML company that I sold to Uber, helping design the core IP, and went through the math leading to hallucinatons and troubles with extrapolation etc in 2001. I am not a nontechie.
-
Neural Networks History: From 1940s to Transformers 2017
By
–
(Depends what you count; neural nets go back to the 40s, backprop to roughly the 1960s, etc, though transformers per se only 2017)
-
GenAI breakthroughs: identifying truly transformative real-world applications
By
–
I would prefer 3-5 really good cases where there has been a fundamental advance truly enabled by GenAI. (The new family of antibiotics would be one.)
-
Critiquing LLM Hype: Pre-existing Concerns About Language Model Limits
By
–
This particular idea long precedes me; I was indicating the grief that I got, not at all saying I originated it. it’s not my area. I would note though that many of my points about hype and the limits of large language models long preceded their work, which they have never