yep DeepMind is way ahead of OpenAI on this as far as I can tell
@garymarcus
-
AI Hallucinations Predicted in 2001: Updated List
By
–
i predicted hallucinations in 2001; here is another list from two years ago today
-
Deep Learning Hitting Wall: Challenges and Future Directions
By
–
and the original article: https://
nautil.us/deep-learning-
is-hitting-a-wall-238440/
… -
Overlooking lawsuits and licensing costs in AI economics
By
–
yeah, i kicked myself after for omitting the lawsuits and licensing costs!
-
Deep Learning Wall Prediction: Two-Year Evaluation
By
–
Two years ago today I argued that Deep Learning was Hitting a Wall. How did I do? Point by point evaluation at link below
-
Jensen Huang continues minting money in AI hardware boom
By
–
yes huge profits there; should have clarified that (was focused on the GenAI companies). Jensen will continue to mint money.
-
Seven GPT-4 Competitors, Price Wars, Modest AI Adoption
By
–
Prediction: By end of 2024 we will see
• 7-10 GPT-4 level models
• No massive advance (no GPT-5, or disappointing GPT-5)
• Price wars
• Very little moat for anyone
• No robust solution to hallucinations
• Modest lasting corporate adoption
• Modest profits, split 7-10 ways -
GPT-3 Limitations: Beyond Fluent Bullshit Generation
By
–
Take a step back, people. You make genuine advances not just by looking at progress, but by recognizing obstacles.
— Gary Marcus (@GaryMarcus) 10 mars 2024
August 2020:
GPT-3 is a “𝘧𝘭𝘶𝘦𝘯𝘵 𝘴𝘱𝘰𝘶𝘵𝘦𝘳 𝘰𝘧 𝘣𝘶𝘭𝘭𝘴𝘩𝘪𝘵, 𝘣𝘶𝘵 𝘦𝘷𝘦𝘯 𝘸𝘪𝘵𝘩 175 𝘣𝘪𝘭𝘭𝘪𝘰𝘯 𝘱𝘢𝘳𝘢𝘮𝘦𝘵𝘦𝘳𝘴 𝘢𝘯𝘥 450… pic.twitter.com/XdCrqNdtCkTake a step back, people. You make genuine advances not just by looking at progress, but by recognizing obstacles. August 2020:
GPT-3 is a “𝘧𝘭𝘶𝘦𝘯𝘵 𝘴𝘱𝘰𝘶𝘵𝘦𝘳 𝘰𝘧 𝘣𝘶𝘭𝘭𝘴𝘩𝘪𝘵, 𝘣𝘶𝘵 𝘦𝘷𝘦𝘯 𝘸𝘪𝘵𝘩 175 𝘣𝘪𝘭𝘭𝘪𝘰𝘯 𝘱𝘢𝘳𝘢𝘮𝘦𝘵𝘦𝘳𝘴 𝘢𝘯𝘥 450 -
GenAI dominates 80% of AI investment, stifles alternatives
By
–
GenAI is probably 80%+ of AI investment right now. Maybe more. That is the monopoly I was and am referring to. Some of it is from VC, some internal from companies. Very little oxygen for alternative approaches right now.