“Evolution and The Knightian Blindspot of Machine Learning” https://
arxiv.org/abs/2501.13075 Fascinating paper. Makes the case that the harsh filter of evolution enabled organisms (including us) to navigate unexpected events (“unknown unknowns”), something that AI systems struggle with.
@hardmaru
-
Evolution’s Advantage: How Natural Selection Handles Unknown Unknowns
By
–
-
Meeting Pioneer Professor Shun-Ichi Amari on Neural Networks
By
–
I had the honor to meet Professor Shun-Ichi Amari, a pioneer in neural networks, at the University of Tokyo. He worked on early neural nets using pen and paper, before running computing experiments in the future. He talked not only about AI, but human evolution and consciousness.
-
AI Thought-Leadership as Soft Power in Geopolitical Competition
By
–
Actually, to me, there is nothing bizarre about this. A nation’s thought-leadership in an important area like AI is soft power. This soft power is a currency for global influence. I expect the geopolitical competition for AI thought-leadership to increase over the next decade.
-
Chinese LLM Papers as Primary Learning Source for AI Research
By
–
“We are in this bizarre world where the best way to learn about LLMs is to read papers by Chinese companies. I do not think this is a good state of the world — US labs keeping their architectures and algorithms secret is ultimately hurting AI development in the US.” Thread
-
Sakana AI on Global AI Landscape and GPU Demand Outlook
By
–
Sakana AI on AI Development Outlook Interview: https://
bloomberg.com/news/videos/20
25-02-03/sakana-ai-on-ai-development-outlook-video
… “David Ha discusses his outlook for the global AI landscape, saying that the emergence of models like Deepseek only fuels more demand for Nvidia GPUs. Eventually more alternative AI models will be produced.” -
LLMs as Mainframe Computers: Early Stage AI Development
By
–
“Today’s LLMs are the ‘Mainframe Computers’ of our generation”
— hardmaru (@hardmaru) 3 février 2025
I was on @BloombergTV today discussing @SakanaAILabs, and to share my view that today’s LLMs are our generation’s “Mainframe Computers”. We are still in the very early stages of AI, and it is inevitable, due to… pic.twitter.com/PHJNL1GdCM“Today’s LLMs are the ‘Mainframe Computers’ of our generation” I was on @BloombergTV today discussing @SakanaAILabs
, and to share my view that today’s LLMs are our generation’s “Mainframe Computers”. We are still in the very early stages of AI, and it is inevitable, due to -
DeepSeek’s approach attributed to Schmidhuber’s prior work
By
–
“DeepSeek? Schmidhuber did it first.” https://
old.reddit.com/r/MachineLearn
ing/comments/1ielwh5/d_deepseek_schmidhuber_did_it_first/
… -
Sakana AI Hiring: Research Internship, Applied Engineer, Business Analyst
By
–
Sakana AI is hiring in Japan! We have 3 open positions:
1) Research Internship
2) Applied Engineer
3) Business Analyst https://
sakana.ai/careers/ -
Transformer²: Self-Adaptive LLMs with Neural Network Weight Adaptation
By
–
Blog post for Transformer²: Self-Adaptive LLMshttps://t.co/AyeFdqEKsd
— hardmaru (@hardmaru) 17 janvier 2025
Eventually, neural network weights should be as adaptive as the Octopus 🐙pic.twitter.com/me7urXJ6BSBlog post for Transformer²: Self-Adaptive LLMs https://
sakana.ai/transformer-sq
uared/
… Eventually, neural network weights should be as adaptive as the Octopus
