Trillion parameter models require terabytes of memory. Thousands of GPUs must be procured and connected just to store the model weights. It takes months to bring up a working cluster of this scale. Nvidia's own chart below:
AI HARDWARE
-
Cerebras CS-3 trains 1 trillion parameter model efficiently
By
–
Cerebras Systems + Sandia National Labs have demonstrated training of a 1 trillion parameter model on a single CS-3 system (!) This is ~1% the footprint & power of an equivalent GPU cluster.
-
Elon Musk and Google Plan Giant Quantum Computer in Space
By
–
Pendant que les politiciens français se déchirent sur des affaires de corneculs debiles @elonmusk et @sundarpichai le patron de @google prévoient de construire un ordinateur quantique géant dans l’espace LA FRANCE VA COULER
-
Meta Quest 3, Quest 3S and Solos AirGo VR Hardware
By
–
Meta Quest 3, Quest 3S and Solos AirGo are pretty cool
-
GPU Availability Challenges for AI Projects
By
–
I have an open thread on slack – if the GPU gods allow, then we shall!
-
Google Quantum Chip Solves Problems in Minutes Not Septillion Years
By
–
BREAKING News :
Google makes quantum computing breakthrough with new chip capable of solving computational problems in under 5 minutes, that would otherwise take the leading supercomputer: 10,000,000,000,000,000,000,000,000 years. cc @sundarpichai @GoogleQuantumAI -
Nobel Prize honors GPU-powered neural networks and protein prediction breakthroughs
By
–
GPU-powered breakthroughs in neural networks and protein prediction have won @NobelPrize honors, heralding a new era for science and industry. Congratulations to new Nobel Prize Laureates John Hopfield, Geoffrey Hinton, Demis Hassabis, and John Jumper. #AI https://
nvda.ws/3ZQ0sGs -
DeepMind’s AlphaQubit Achieves Quantum Error Detection Breakthrough
By
–
Google DeepMind's AlphaQubit tackles quantum error detection with unprecedented accuracy – SiliconANGLE https://
bit.ly/4fW1fLw
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
GlobalSemi Award highlights AI and HPC innovation milestone
By
–
Thrilled to see our @GlobalSemi Award shining bright on the @Nasdaq MarketSite . This tower-worthy milestone is a testament to our commitment to innovation in #AI and #HPC. #GSAAward #NASDAQ
-
Canada invests $2B in AI compute for domestic innovation
By
–
#Canada's $2B #AI #compute strategy champions domestic innovation while tackling AI's energy challenge. As data centres approach 2% of energy demand, our energy-efficient chips are key in building the necessary foundation for AI infrastructure growth. https://
betakit.com/federal-govern
ment-outlines-2-billion-in-ai-compute-spending-commitment/
…