Nice to see Yann LeCun 2024 making yet another set of points (re the intractability of predicting video from pixel space and the limits of LLMs) that I made in 2019 and 2020. He’s catching up!
RESEARCH
-
Model Merging and Pretraining Boost AI Performance Results
By
–
Beyond just merging, we've boosted performance by continuing to pretrain with a massive dataset. Merging alone doesn't cut it for top-notch results.
-
Google VideoPoet: AI Video Generation Comprehensive Guide
By
–
Decoding Google VideoPoet: A Comprehensive Guide to AI Generation: The realm of video creation is undergoing a seismic shift with… https://
analyticsvidhya.com/blog/2024/01/d
ecoding-google-videopoet-a-comprehensive-guide-to-ai-video-generation/?utm_source=dlvr.it&utm_medium=twitter
… #DataAnalytics #DataScience #DataDriven #DeepLearning #ArtificialIntelligence #BusinessIntelligence #ITManager #CTO -
AI/ML Founder Discusses Hallucinations and Model Limitations
By
–
dude, i built an AI/ML company that I sold to Uber, helping design the core IP, and went through the math leading to hallucinatons and troubles with extrapolation etc in 2001. I am not a nontechie.
-
Neural Networks History: From 1940s to Transformers 2017
By
–
(Depends what you count; neural nets go back to the 40s, backprop to roughly the 1960s, etc, though transformers per se only 2017)
-
GenAI breakthroughs: identifying truly transformative real-world applications
By
–
I would prefer 3-5 really good cases where there has been a fundamental advance truly enabled by GenAI. (The new family of antibiotics would be one.)
-
Critiquing LLM Hype: Pre-existing Concerns About Language Model Limits
By
–
This particular idea long precedes me; I was indicating the grief that I got, not at all saying I originated it. it’s not my area. I would note though that many of my points about hype and the limits of large language models long preceded their work, which they have never
-
Temporal dynamics shifts in technology: What’s actually changed?
By
–
What made that conversation immensely frustrating is that I was pointing to a change in temporal dynamics, and trying to think of what had changed (and at what lag) and most of the answers I got back (cars, airplanes etc) are things that have been fairly steady, so weren’t real
-
Sam Altman Energy Breakthrough Advances AI Computing Power
By
–
https://
futurism.com/sam-altman-ene
rgy-breakthrough
… -
Doomers and AI: Why Catastrophism Persists in Tech Culture
By
–
The TLDR of this: Doomers have always been with us. We must be wired this way. Lets be aware of risks and seek to mitigate them but odds are the sun will come up tomorrow. https://
nytimes.com/2024/01/26/opi
nion/polycrisis-doom-extinction-humanity.html
…