It’s a big week! We’ve raised $1.3 billion and are building the world’s largest AI cluster (22k H100s). We’re grateful for our investors and new funding that will help us accelerate our mission to make personal AI available to every person in the world.
AI HARDWARE
-
Inflection AI raises $1.3B for massive AI cluster and Pi
By
–
Excited to announce that we’ve raised $1.3B to build one of the largest clusters in the world and turbocharge the creation of Pi, your personal AI. https://
forbes.com/sites/alexkonr
ad/2023/06/28/inflection-ai-raises-1-billion-for-chatbot-pi/
… -
GPU Heat and Noise Issues Require Laundry Room Setup
By
–
I considered it still too hot and noisy to be in the same room with. I probably need to put a rack in the laundry room if I still want ML GPUs now.
-
Micron Stock Rises After Quarterly Beat Amid Chip Shortage Forecast
By
–
Micron rising: finally, a quarterly beat The company’s forecast of negative supply growth in DRAM and NAND plays to a favorable narrative of future shortages. https://
thetechnologyletter.com/the-posts/micr
on-rising-finally-a-quarterly-beat
… $MU #investing #stocks #DRAM #NAND #semiconductors -
Energy Efficiency in Open-Source Models at Scale
By
–
How do you think about energy efficiency of training and inference at scale when open-source models are applied? Do you see low-energy models at the edge as entering the broader conversation about model-context match? @bmorphism
-
Open Source Transforming AI Hardware with Tenstorrent CEO
By
–
Open Source is Transforming AI and Hardware w/ #tenstorrent CEO @jimkxa
-
Fourier Neural Operators Enable 25km Weather Forecasting
By
–
Thank you @PASC_Conference https://
arxiv.org/abs/2208.05419 Our work was first to do medium-range weather forecasts at 25km spatial resolution with 10^4-10^5 speedups using Fourier neural operators. Recently we added spherical harmonics for stable long rollouts https://
arxiv.org/abs/2306.03838 -
Nvidia dominates AI benchmarks while Intel Habana gains ground
By
–
Nvidia sweeps AI benchmarks, but Intel brings meaningful competition Habana came very close on several tests of 8-way systems. @MLCommons $NVDA $INTC $AMD #AI #MLPerf #GPU #CPU
-
DGX Station Repeatedly Fails: Third Hardware Issue in Months
By
–
My DGX Station https://
nvidia.com/content/dam/en
-zz/Solutions/Data-Center/dgx-station/dgx-station-data-science-supercomputer-datasheet-v4.pdf
… died AGAIN and Nvidia is again shipping me a replacement unit. First was a cooling pump, then an NVLINK failure, now a CPU overheat. Good service, but a lemon of a $150k product. -
DGX Station Failure and Hardware Redundancy Considerations
By
–
Still very happy with our @LambdaAPI cluster, so my personal DGX station dying isn’t critical path, but I liked having some redundancy in capabilities. I sometimes think about the merit of having a stockpile of physical hardware in case something crazy happens in the volatile AI