After 6+ months in the making and burning over a year of GPU compute time, we're super excited to finally release the "Ultra-Scale Playbook" Check it out here: http://
hf.co/spaces/nanotro
n/ultrascale-playbook
… A free, open-source, book to learn everything about 5D parallelism, ZeRO, fast CUDA kernels,
HARDWARE
-

Ultra-Scale Playbook: 5D Parallelism and CUDA Optimization Guide
By
–
-

xAI expands compute cluster to million GPUs for Grok3
By
–
When the frontier labs say they need to unlock orders of magnitude more compute to advance AI…. take their word for it. @XAI quickly moving to cluster that houses a million GPUs. (5x bigger than Colossus now.) After #Grok3 wins, Elon Musk is the strongest horse in the race
-
Apple Intelligence Dictation Feature Works on Latest macOS
By
–
I upgraded to the latest version of macOS and finally I'm seeing some signs of Apple Intelligence. For example, this post is dictated without any manual intervention. So far it looks good.
-
SpaceX Engineers Master 200k H100 GPU Orchestration in Record Time
By
–
Also, @elonmusk has the best engineers in the world at @SpaceX & @Tesla
, that’s a huge advantage! They figured out how to make 200k H100s work together in perfect symphony – from the power, to the cooling to the networking. And in 122 days? A insane (impossible one might have -
Compute Power Drives AI Progress: Full-Stack Integration Essential
By
–
Astonishing progress in 18 months with brute force compute and brilliant engineering. Compute is king. Players who are full-stack are better positioned.
-
xAI Secretly Expands Cluster with 100,000 Additional GPUs
By
–
WOW @xai secretly added 100,000 GPUs to its cluster!
— Nina Schick (@NinaDSchick) 18 février 2025
As I mentioned, compute is king!
PS loving Elon’s international team of engineers, I think I hear German, Chinese and American. https://t.co/oFtyMkAj1qWOW @xai secretly added 100,000 GPUs to its cluster! As I mentioned, compute is king! PS loving Elon’s international team of engineers, I think I hear German, Chinese and American.
-

Accelerating Progress Through Massive Compute Infrastructure
By
–
Progressing at ludicrous speed thanks to COMPUTE.
-
Open Source AI Model: o3-mini vs Phone-Optimized Deployment
By
–
for our next open source project, would it be more useful to do an o3-mini level model that is pretty small but still needs to run on GPUs, or the best phone-sized model we can do?
-

SambaNova’s SN40L RDU 5nm Accelerator for Trillion-Parameter AI
By
–
SambaNova accepted at ISSCC! We’re taking the stage tomorrow to share our paper on the SN40L RDU—a 5nm 2.5D accelerator with three memory tiers designed for trillion-parameter AI. #AI #ISSCC2025
-
14.8 ft Anime-Style Transformer Robot Piloted by Person
By
–
This 14.8 ft anime-style transformer robot can be piloted by a person
— Ronald van Loon (@Ronald_vanLoon) 14 février 2025
by @gigadgets_
#Robotics #AI #ArtificialIntelligence #MachineLearning #MI #Tech #Technology
cc: @paula_piccard @miketamir @kirkdborne pic.twitter.com/sArHYd0NdqThis 14.8 ft anime-style transformer robot can be piloted by a person
by @gigadgets_ #Robotics #AI #ArtificialIntelligence #MachineLearning #MI #Tech #Technology cc: @paula_piccard @miketamir @kirkdborne