It is interesting to see a key truth about the current state of AI play out over and over again. Only a few organizations have the compute needed to train GPT-4 class & beyond models. Key small AI labs may have a lot of talent & ideas, but only 4-5 tech giants have the servers.
AI HARDWARE
-
Galore: Democratizing AI with Less Computing Power
By
–
While #GTC24 may feature even more powerful hardware we help you do more with less. Try our Galore on @huggingface #opensource #gpupoor #democratization
-
Siemens and NVIDIA Deepen Industrial Metaverse Collaboration
By
–
Siemens and NVIDIA Deepens Collaboration for Industrial #Metaverse https://
indianweb2.com/2024/03/siemen
s-and-nvidia-deepens.html
… -
Competitive GPU Destruction Metaphor in AI Hardware Wars
By
–
erecting the rostra on top of the burned out GPUs of our enemies
-
Cerebras CS-3 Wafer-Scale Architecture Enables Superior Training Performance
By
–
Our CTO and Co-Founder Sean Lie takes us deep into the heart of Cerebras Hardware and our Wafer-Scale Architecture. On CS-3, we are enabling large scale training at orders of magnitude performance advantage compared to GPU. But even our largest clusters natively operate as a
-
Cerebras CEO Discusses AI Hardware Challenges and Large Chip Training
By
–
Our CEO @andrewdfeldman kicked off Cerebras AI Day to a standing room only audience. Andrew’s keynote covered: 1. The AI Capabilities Chasm
2. The GPU Challenge
3. Large Models train best on Large Chips. #AI #AIcompute -
H100 GPU Pricing and Availability Challenges in AI
By
–
Have you looked at the price of an H100 assuming you can get them to sell you one?
-
Tinygrad’s Public Quest to Build Commodity Petaflop Compute
By
–
Follow along the @__tinygrad__ saga, who are (very publicly!) trying to build your commodity ~petaflop compute node. tinybox specs: https://
tinygrad.org
the youtube videos form @realGeorgeHotz are actually quite great and entertaining, featuring the signature blend of -
BNY Mellon deploys NVIDIA DGX SuperPOD with H100 systems
By
–
At #GTC24, @BNYMellon announced it's become the first major bank to deploy NVIDIA DGX SuperPOD with DGX H100 systems. Read the blog here https://
nvda.ws/43qo5Wf #financialservices #AI