Anthropic SpaceX Anthropic is getting up to GB200 of capacity in Colossus 2 in June as a part of the expanded agreement with SpaceX. Partnerships are huge unlocks
MACHINE LEARNING
-
Dynamic Fine-Tuning (DFT) combines SFT loss with forward KL penalty
By
–
This is so neat! Dynamic Fine-Tuning (DFT) reweights the SFT loss by the model's own token probability, which creates a feedback loop. So they added forward KL to penalize any token the base finds likely, but the policy has pushed toward zero probability. DFT and forward KL
-
Inquiry into AI model training methodology and data augmentation
By
–
i would be pretty interested to know if anything other than scale had changed and want to know about the training, whether there was a lot of symbolically generated augmented data, etc
-
AI Models Enhance Robot Control, Accelerating Robotics Adoption
By
–
It is truly mind-blowing how capable Claude and Codex now are at configuring and controlling robots. My own experiments (with a lerobot 101) point to a fascinating new trend in robotics that could accelerate adoption. Many thanks to @Ken_Goldberg and @spencerhuang_ for their
-
12 AI Terms to Learn
By
–
12 #AI Terms to Learn
by @Python_Dv #ArtificialIntelligence #MachineLearning #ML #MI -
Inquiry into the architectural basis of recent AI math breakthroughs
By
–
is the new math result neurosymbolic with Lean, harnesses etc or a pure LLM?
-
Neurosymbolic systems vs LLMs for mathematical reasoning
By
–
i am betting it was a neurosymbolic system rather than a pure LLM, and i have already said that’s a route to doing well in math. have not seen the details
-
Debating the Role of Neurosymbolic Systems in Mathematical AI
By
–
how much you want to bet that symbolic tools such as lean were involved and that this was not a pure LLM? i have said numerous times that neurosymbolic systems do well on math: pretty sure this was one.
-
Why learn languages if AI can translate instantly?
By
–
If #AI can translate instantly, why learn another language?
by Olivia Maurice Mark Antoniou @_TCglobal Learn more: https://
bit.ly/42HeE57 #ArtificialIntelligence #MachineLearning #ML #DL -
Growth in Local AI Model Training and Open Source Development
By
–
Local AI and people post training models based on opensource is growing!