Cerebras Wafer Scale Cluster uses unique, terabyte-scale external memory device called MemoryX to store model weights. For Sandia’s run, Cerebras configured a 55 terabyte MemoryX device – enough to comfortably store 1T parameters and optimizer states.
TECHNOLOGY
-

Cerebras CS-3 trains 1 trillion parameter model efficiently
By
–
Cerebras Systems + Sandia National Labs have demonstrated training of a 1 trillion parameter model on a single CS-3 system (!) This is ~1% the footprint & power of an equivalent GPU cluster.
-

ChatGPT integrated into Apple Intelligence and Siri: Apple-OpenAI strategy
By
–
#ChatGPT arrives in #AppleIntelligence and #Siri → https://youtu.be/Ks1sbFyWrNc In this video, we discuss the features and especially the (brilliant) strategy of @Apple with @OpenAI and #AI
-

Seven Tech Revolutions: $77.46T GDP Impact Analysis
By
–
7 #Tech Wonders of the World #Electrification +$12.5T GDP #Telephone +$12.5T GDP #PC +$45T GDP #Mobile +$1.5T GDP #Cloud +$1T GDP #Blockchain +$1.76T GDP #AI +$15.7T GDP
#megatrends @mikequindazzi 2024 #GDP -
Meta Llama 3.3 integration and bug fixes release
By
–
We're also bringing in Llama 3.3 by Meta, and many bugfixes Full release note:
-
5G and Education Innovations Changing Lives
By
–
Thanks a million Dear Fati @sulefati7 a pleasure to share and please look out for a #5G and #education special coming very soon – some incredible and award winning innovations here quite literally changing lives! Wonderful to see! Warmest wishes, Sally #TechForGood
-
People Prefer Communicating Through Computers Rather Than With Them
By
–
“People don’t want to talk to computers, they want to talk through computers.”
-
Google Gemini 2.0 Flash Surpasses 1.5 Pro with Native Image Generation
By
–
Gemini 2.0 Flash ⚡️ has arrived!
— Oriol Vinyals (@OriolVinyalsML) 11 décembre 2024
2.0 Flash > 1.5 Pro (again!) 📈
Interacts with a browser 🤖
Native image generation 🖼️
and much more!
Try it out https://t.co/IMN3bqKgJS
As a preview of what is possible, wishing you all a Drastic Holiday powered by 2.0! pic.twitter.com/iHBB4lwXTkGemini 2.0 Flash has arrived! 2.0 Flash > 1.5 Pro (again!)
Interacts with a browser
Native image generation and much more! Try it out
http://
aistudio.google.com/prompts/new_ch
at
… As a preview of what is possible, wishing you all a Drastic Holiday powered by 2.0! -
Human Innovation Timeline: 250k Years to Metal Sewing Needle
By
–
I agree, keep in mind it took 250k for human to invent a metal sewing needle.
-
Industrial Giants to Tech Titans: AI Reshapes Market Leadership
By
–
A Shift from #Industrial Giants 🏭 @GeneralElectric @exxonmobil in 1998 to #Tech Titans 🤖 w/ Top 3 @Apple @nvidia @Microsoft each worth $3T💰in 2024 📆#Megatrends 📈 #AI 🖲️ pic.twitter.com/JceuL5ERb0
— Mike Quindazzi (@MikeQuindazzi) 11 décembre 2024A Shift from #Industrial Giants @GeneralElectric @exxonmobil in 1998 to #Tech Titans w/ Top 3 @Apple @nvidia @Microsoft each worth $3Tin 2024 #Megatrends #AI