Very capable 1B Models are a thing now.
RESEARCH
-
NVIDIA HOVER: Efficient Motor Skills Learning with 1.5M Parameters
By
–
NVIDIA GEAR lab is breaking new ground. With just 1.5M parameters, HOVER proves that mastering complex motor skills doesn’t require huge models. Using NVIDIA simulation suite, which accelerates physics by 10,000x, humanoids can learn a year’s worth of motion in under an hour. pic.twitter.com/LjWJhw0Fpl
— Chubby♨️ (@kimmonismus) 1 novembre 2024NVIDIA GEAR lab is breaking new ground. With just 1.5M parameters, HOVER proves that mastering complex motor skills doesn’t require huge models. Using NVIDIA simulation suite, which accelerates physics by 10,000x, humanoids can learn a year’s worth of motion in under an hour.
-
BPE Implementations Comparison and Julia Experiments Updates
By
–
Awesome, glad to hear! And I am curious about the Julia experiments, but absolutely no rush 🙂
Btw I also did some quick comparisons with some other BPE implementations here: https://
github.com/rasbt/LLMs-fro
m-scratch/blob/main/ch02/02_bonus_bytepair-encoder/compare-bpe-tiktoken.ipynb
…
(I also have my own custom one that I plan to polish up and add some time…) -
DexMimicGen: Synthetic Data Generator for Humanoid Robot Learning
By
–
„Let machines train machines. I’m excited to introduce DexMimicGen, a massive-scale synthetic data generator that enables a humanoid robot to learn complex skills from only a handful of human demonstrations.“ Dr. Jim Fan pic.twitter.com/MmfmCx9ALx
— Chubby♨️ (@kimmonismus) 1 novembre 2024„Let machines train machines. I’m excited to introduce DexMimicGen, a massive-scale synthetic data generator that enables a humanoid robot to learn complex skills from only a handful of human demonstrations.“ Dr. Jim Fan
-
Information Theory Fundamentals for AI and Machine Learning
By
–
A brief tutorial on information theory https://
bit.ly/3XPOCcR #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Oasis: First AI-Generated Real-Time Video Game Without Engine
By
–
> Oasis: First Real-Time Video Game Without a Game Engine! 🎮@DecartAI & @Etched just released Oasis – a fully AI-generated video game running at 20 FPS (frames per second). The model takes keyboard inputs and generates everything – physics, rules, graphics – on the fly,… pic.twitter.com/DU6l3PBfhF
— m_ric (@AymericRoucher) 1 novembre 2024> Oasis: First Real-Time Game Without a Game Engine! @DecartAI & @Etched just released Oasis – a fully AI-generated video game running at 20 FPS (frames per second). The model takes keyboard inputs and generates everything – physics, rules, graphics – on the fly,
-
Meta’s AI Organization Makes Significant Contributions Despite VR Challenges
By
–
While I had a lot of challenges in the dysfunctional VR org, Meta is still a great company, and the AI org makes huge contributions to the world!
-
Expanding Professional AI Platform Across Multiple Expert Domains
By
–
yes of course! we already include:
– doctors
– lawyers
– PhDs
– mathematicians
– scientists
– professionals
– accountants
– coders but trying to expand quickly! what's of interest to you? -
Advanced AI Models Need World’s Expert Collaboration
By
–
AI models are getting smarter. o1 was a major breakthrough, and we don't expect that to stop. What's needed today are the world's most advanced experts (doctors, lawyers, PhDs, professionals) to help provide their expertise in advancing the models towards the frontier.
-
Connecting AI Experts with Leading AI Labs Worldwide
By
–
We want to provide Experts with opportunities to connect with the leading AI labs and efforts in the world. We also want AI developers and labs to be able to collaborate directly with advanced experts to push the frontier of AI. Read more here: