Yes. It’s not that we’ve discovered some magic bullet, but rather that JAX, or at least the open source version of it, is mostly optimized for small to medium-sized training runs on Google TPUs, whereas we need to massive training runs on Nvidia GPUs. Pipeline parallelism is
@elonmusk
-
RL Inference Stack Development in C for GB300 Hardware
By
–
Next will be writing the inference stack in C for simultaneous high-speed RL across a large block of GB300s. (We do use a little C++ tbh, but not much)
-
0.5T Model Open-Source Release Announced
By
–
We will open source the 0.5T model towards the end of this year. It should still be quite useful.
-
xAI to Merge with SpaceX, Becoming SpaceXAI
By
–
xAI will be dissolved as a separate company, so it will just be SpaceXAI, the AI products from SpaceX
-
Honesty as the Best Policy for AI Safety
By
–
Yeah. I think about that a lot. For AI safety, I am convinced of the old maxim that honesty is the best policy. The truth shall set us free.
-
SpaceX-like compute for ethical AI development
By
–
Just as SpaceX launches hundreds of satellites for competitors with fair terms and pricing, we will provide compute to AI companies that are taking the right steps to ensure it is good for humanity. We reserve the right to reclaim the compute if their AI engages in actions that
-
Meeting with Anthropic Team on AI Safety Impresses Author
By
–
Same here. By way of background for those who care, I spent a lot of time last week with senior members of the Anthropic team to understand what they do to ensure Claude is good for humanity and was impressed. Everyone I met was highly competent and cared a great deal about
-
World’s Largest Chip Fabrication Facility Under Consideration
By
–
This is one of several locations under consideration for what will be the largest and most advanced chip fabrication facility in the world
-
Tesla, Starlink, and Auto-translation on X
By
–
Try Tesla, Starlink & auto-translation on 𝕏 pic.twitter.com/enxwcUXrCh
— Elon Musk (@elonmusk) 5 mai 2026Try Tesla, Starlink & auto-translation on 𝕏