Actually, to me, there is nothing bizarre about this. A nation’s thought-leadership in an important area like AI is soft power. This soft power is a currency for global influence. I expect the geopolitical competition for AI thought-leadership to increase over the next decade.
@hardmaru
-
Chinese LLM Papers as Primary Learning Source for AI Research
By
–
“We are in this bizarre world where the best way to learn about LLMs is to read papers by Chinese companies. I do not think this is a good state of the world — US labs keeping their architectures and algorithms secret is ultimately hurting AI development in the US.” Thread
-
Sakana AI on Global AI Landscape and GPU Demand Outlook
By
–
Sakana AI on AI Development Outlook Interview: https://
bloomberg.com/news/videos/20
25-02-03/sakana-ai-on-ai-development-outlook-video
… “David Ha discusses his outlook for the global AI landscape, saying that the emergence of models like Deepseek only fuels more demand for Nvidia GPUs. Eventually more alternative AI models will be produced.” -
LLMs as Mainframe Computers: Early Stage AI Development
By
–
“Today’s LLMs are the ‘Mainframe Computers’ of our generation”
— hardmaru (@hardmaru) 3 février 2025
I was on @BloombergTV today discussing @SakanaAILabs, and to share my view that today’s LLMs are our generation’s “Mainframe Computers”. We are still in the very early stages of AI, and it is inevitable, due to… pic.twitter.com/PHJNL1GdCM“Today’s LLMs are the ‘Mainframe Computers’ of our generation” I was on @BloombergTV today discussing @SakanaAILabs
, and to share my view that today’s LLMs are our generation’s “Mainframe Computers”. We are still in the very early stages of AI, and it is inevitable, due to -
DeepSeek’s approach attributed to Schmidhuber’s prior work
By
–
“DeepSeek? Schmidhuber did it first.” https://
old.reddit.com/r/MachineLearn
ing/comments/1ielwh5/d_deepseek_schmidhuber_did_it_first/
… -
Sakana AI Hiring: Research Internship, Applied Engineer, Business Analyst
By
–
Sakana AI is hiring in Japan! We have 3 open positions:
1) Research Internship
2) Applied Engineer
3) Business Analyst https://
sakana.ai/careers/ -
Transformer²: Self-Adaptive LLMs with Neural Network Weight Adaptation
By
–
Blog post for Transformer²: Self-Adaptive LLMshttps://t.co/AyeFdqEKsd
— hardmaru (@hardmaru) 17 janvier 2025
Eventually, neural network weights should be as adaptive as the Octopus 🐙pic.twitter.com/me7urXJ6BSBlog post for Transformer²: Self-Adaptive LLMs https://
sakana.ai/transformer-sq
uared/
… Eventually, neural network weights should be as adaptive as the Octopus -
Transformer²: Self-adaptive LLMs that Blur Pre and Post-training
By
–
Transformer²: Self-adaptive LLMshttps://t.co/VnvzSmeIad
— hardmaru (@hardmaru) 15 janvier 2025
This new paper from @SakanaAILabs shows the power of an LLM that can self-adapt its weights to its environment. I think in the future, the line between “pre-training” and “post-training” will be gone, and our models and… https://t.co/t8gEsXOUeg pic.twitter.com/XNFqdnef14Transformer²: Self-adaptive LLMs https://
arxiv.org/abs/2501.06252 This new paper from @SakanaAILabs shows the power of an LLM that can self-adapt its weights to its environment. I think in the future, the line between “pre-training” and “post-training” will be gone, and our models and -
Von Neumann’s Visionary Legacy and Timeless Contributions
By
–
Von Neumann was truly ahead of his time.
