I think it only works when you have a larger model produce data for a smaller one. Otherwise the large model -> same large model, without any other external signals, will likely just learn something very similar
RESEARCH
-
KL Divergence: The Foundation for Modern Language Models
By
–
http://
blog.alexalemi.com KL is All You Need https://
bit.ly/3Ll57rQ
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
New favorite LLM test reveals inconsistent performance across SOTA models
By
–
Wow, this has just become my favorite LLM test. I missed that this doesn't work but it really doesn't, even for SOTA LLMs. Seems to be a bit hit and miss, e.g. with GPT4o which failed 1/3 times, Claude failed 3/3 times.
-
Basic Income Study Shows Impact on Financial Stability
By
–
fascinating story from @shiringhaffary and @sarahsholder about a big @sama
-funded US basic income study that gave people $1k/month for 3 years. the results: people spent the $ on basic needs and helping others, they spent more time with family, and had more financial flexibility. -
Google’s NeuralGCM AI Model Advances Climate Prediction Accuracy
By
–
Exciting news! Meet NeuralGCM, a cutting-edge atmospheric model from Google Research. 🌡🌎
— Jeff Dean (@JeffDean) 22 juillet 2024
This AI-driven general circulation model (GCM) outperforms traditional atmospheric models in precision, providing faster, more accurate climate predictions. Learn more in @Nature →… https://t.co/Ej9x1HIN4CExciting news! Meet NeuralGCM, a cutting-edge atmospheric model from Google Research. This AI-driven general circulation model (GCM) outperforms traditional atmospheric models in precision, providing faster, more accurate climate predictions. Learn more in @Nature →
-
Google NeuralGCM: Hybrid AI Solver for Weather Modeling
By
–
Research Engineer Dmitrii Kochkov's work on weather & climate contributed to the development of a hybrid AI + differentiable solver approach for atmospheric modeling.
— Google AI (@GoogleAI) 22 juillet 2024
Learn more about the groundbreaking work from Google Research's NeuralGCM team. 🌡⛈️→ https://t.co/QJ6cusDKZh pic.twitter.com/1ZiGduq0jMResearch Engineer Dmitrii Kochkov's work on weather & climate contributed to the development of a hybrid AI + differentiable solver approach for atmospheric modeling. Learn more about the groundbreaking work from Google Research's NeuralGCM team. → http://
goo.gle/4ff57ah -
Iteration in AI: Small Steps, Big Results for Development
By
–
✨ Iteration in AI: Small steps, big results! Dive into our #AIToday episode to understand the impact of iterative processes on AI development. 🎧 cognilytica.com/what-iterati… #AIProjects #Innovation #Podcast
-
Open Source Transforming AI and Hardware Innovation
By
–
Watch @jimkxa
, @RajaXg , Chris Walker of @UntetherAI and Charlie Cheng, Board Advisor for @Andes_Tech talk about how #OpenSource is transforming AI and hardware: -
Visual Haystacks: Advanced Computer Vision Search Techniques
By
–
New blog post: https://
bair.berkeley.edu/blog/2024/07/2
0/visual-haystacks/
… -
The Danger Zone in Data Science
By
–
The Danger Zone in Data Science https://
bit.ly/4cVUNCo
#AI #MachineLearning #DeepLearning #LLMs #DataScience