The Coming AI Startup Bust “I think we are in an AI startup bubble and that is okay…” @asianometry YouTube: https://
youtu.be/6aS0Dlqarqo
@hardmaru
-

The Coming AI Startup Bust and Bubble Economy
By
–
-

AI Companies Work: Analysis and Discussion
By
–
Related article: https://
benn.substack.com/p/do-ai-compan
ies-work
… -
AI’s $600B Question: Four Months Later, Still Searching for Answers
By
–
Four months after @DavidCahn6
’s “AI’s $600B Question”, are we close to having any answers, or even the concept of an answer? -
AMD’s missed opportunity in deep learning stack development
By
–
And imagine where would AMD be today if they got the deep learning stack done right much earlier, back in 2017.
-

High Quality 5T Token Dataset Released for LLM Training
By
–
They also released a 5T token high quality, processed dataset for training LLMs https://
huggingface.co/datasets/Zyphr
a/Zyda-2
… -
Dennett on Nature’s Need-to-Know Principle in Creature Design
By
–
Makes me think of Daniel Dennett’s book:
— hardmaru (@hardmaru) 15 octobre 2024
“Nature makes heavy use of the Need to Know principle, and designs highly successful, adept, even cunning creatures who have no idea what they are doing or why.”
(From Bacteria to Bach and Back) https://t.co/1C7zUNilJ2Makes me think of Daniel Dennett’s book: “Nature makes heavy use of the Need to Know principle, and designs highly successful, adept, even cunning creatures who have no idea what they are doing or why.” (From Bacteria to Bach and Back)
-

New SOTA 7B LLM Released Under Apache-2.0 License
By
–
Cool to see a new SOTA 7B LLM released under Apache-2.0. Hopefully this will help bring state space models to mainstream! https://
huggingface.co/Zyphra/Zamba2-
7B
… -

Meta-learning Demands More Trial-and-Error Than Standard Learning
By
–
Meta-learning requires a lot more trial-and-error than learning.
-
Neural Simulator Runs Counter-Strike at 10FPS on RTX 3090
By
–
So cool to see this neural simulator of counter-strike run at 10FPS on an RTX 3090 🔥https://t.co/DCAkt7xjTihttps://t.co/n96UZ1r3Inpic.twitter.com/27Y2NV5e1a
— hardmaru (@hardmaru) 13 octobre 2024So cool to see this neural simulator of counter-strike run at 10FPS on an RTX 3090 https://
arxiv.org/abs/2405.12399 https://
diamond-wm.github.io -
AI Videos Lack Artistic Soul Despite Technical Improvements
By
–
AI videos have this ugly hyperrealistic effect that simply doesn’t spark joy. I think even as video diffusion models improve, you might still end up with the same kind of boring “Hollywood” effect, which optimizes for what the typical user wants. https://
x.com/PJaccetturo/st
/PJaccetturo/status/1841884944668491822
…