The @googlecloud MultiSlice system (see blog post in tweet below) is an external version of some internal software+hardware we've been using for a while to scale some of our largest ML training runs across multiple TPUv4 and TPUv5e pods. Scaling made easy!
HARDWARE
-
H100 GPUs lack gaming hardware, potential for CAVE rendering demo
By
–
The H100 GPUs don’t have either rasterization or ray tracing hardware, so conventional game engines can’t run on them. I do think it would be a fun to do some kind of super high end 240 fps CAVE rendering demo with a cluster!
-
Google TPUv4 System and Reconfigurable Optical Network Explained
By
–
A nice writeup about the TPUv4 system based on a talk my colleagues Norm Jouppi and Andy Swing delivered at @hotchipsorg 2023 on Tuesday. Learn more about the reconfigurable optical network!
-
Generative AI at the Edge: Guest Lecture at Taiwan-Eindhoven
By
–
Join our very own Bram-Ernst Verhoef tomorrow for his guest lecture "Moving Generative AI Towards the Edge" at the inaugural Summer School Taiwan-Eindhoven, hosted at @TUeindhoven
. https://
etspss.nl/home -
Balancing Crane: Self-Balancing Technology Demo with AI IoT 5G
By
–
Balancing Crane #crane #oceancrane #balancing #selfbalance #selfbalancing via @MarsMeRobotics #AI #IoT #5G @Paula_Piccard @Analytics_699 @segundoatdell @JBarbosaPR @FinMKTG @Shi4Tech @mvollmer1 @marcusborba https://
x.com/MarsMeRobotics
/status/1697093245614842269/video/1
… -
Groq Day: AI Acceleration and LLM Inference Solutions
By
–
Join us at #GroqDay to understand why now is the moment that matters for AI acceleration of LLMs and how Groq inference solutions provide customer advantages. Register at http://
groq.link/groqday5 -
Chemix AI Develops EV Batteries Without Cobalt
By
–
New Chemix AI-Based EV Battery Development Reduces Or Eliminates Cobalt
#AI #AIio #BigData #ML #NLU #Futureofwork @nigelwalsh @pbouillaud @PatrickGunz_CH @pierrepinna @RebekahRadice @Ronald_vanLoon @sbmeunier
@Shirastweet http://
ow.ly/zBHX30swTue -
Montreal Datacenter: Hardware Mix and CO2 Impact Timeline
By
–
I think Montreal is a relatively new datacenter (but great for CO2e!). The land purchase was just announced in May, 2021, so with construction and equipment deployment timelines, it may not be fully populated, so mix of hardware there may change.
-
Google Cloud Datacenters Carbon Intensity and TPUv4 Sustainability
By
–
Depends on the data center (I actually don't know which one this was filmed in). We report %age of Google carbon free energy as well as Grid carbon intensity
(gCO2eq/kWh) per Cloud datacenter here. Most TPUv4 pods are installed in ones marked "Low CO2" https://
cloud.google.com/sustainability
/region-carbon
… -
Jais: Advanced Arabic LLM Trained on Condor Galaxy 1
By
–
(3/3) Jais was trained on the newly unveiled Condor Galaxy 1 (CG-1) AI supercomputer, built by the G42 – Cerebras strategic partnership. To learn more, check out the Press Release: https://
cerebras.net/press-release/
meet-jais-the-worlds-most-advanced-arabic-large-language-model-open-sourced-by-g42s-inception
…