At @NeurIPSConf
, we introduced Sparse Pre-training and Dense Fine-tuning to reduce the computational FLOPs of training GPT models using weight sparsity without significant loss in downstream task metrics Read more here: https://
hubs.li/Q01twKNt0 #NeurIPS2022 #sparsity #ai #ml
@cerebras
-
Sparse Pre-training Dense Fine-tuning Reduces GPT Training FLOPs
By
–
-
New Partnership Democratizes AI Model Training at Lower Cost
By
–
According to @VentureBeat our new offering with @Cirrascale “democratizes #AI by giving users the ability to train GPT-class models much more inexpensively than existing providers” and our partnership with @Jasper “accelerates adoption and improves the accuracy of generative AI.”
-
Partnership accelerates generative AI adoption across enterprise applications
By
–
Today, we announced our partnership with Jasper, the category-leading AI content platform, to accelerate adoption and improve the accuracy of generative AI across enterprise and consumer applications. Learn more about our partnership here: https://
hubs.li/Q01twdk70 -
Cerebras Launches AI Model Studio for Transformer Training
By
–
Today we announced the Cerebras AI Model Studio, a pay-by-the-model computing service that makes training large Transformer models fast, easy, and affordable. Learn more here: • Press release – https://
hubs.li/Q01tvJ4p0 • Webpage – https://
hubs.li/Q01tvMpS0 #cloud #ai #ml -
Andromeda AI Supercomputer: 13.5M Cores, Exascale Computing
By
–
@ykilcher recently spoke about Andromeda, our AI Supercomputer that consists of 13.5M cores, 1 exaFLOP of AI compute, and near-perfect linear scaling. Check out the episode here: https://
hubs.li/Q01tnsyt0 #AI #ML -
Cerebras Sparse ML Techniques Preserve GPT Model Accuracy
By
–
At Cerebras, we are creating sparse ML techniques paired with our CS-2 hardware. Our initial work has shown that high degrees of sparsity can be induced into large-scale GPT models while still preserving model accuracy Learn more here: https://
tinyurl.com/yc22pbbz #Neurisp2022 #ai -
Cerebras Showcases AI Hardware at NeurIPS Conference Booth
By
–
Cerebras will be at @NeurIPSConf this week, come meet us at booth #809! #NeurIPS #AI #ML
-
ACM Gordon Bell Prize Awarded for HPC COVID-19 Research
By
–
Congratulations to our Solutions Engineers, Claire Zhang and Cindy Catherine Orozco Bohorquez, who recently received their ACM Gordon Bell Special Prize for HPC-Based COVID-19 Research awards! Read the paper here: https://
hubs.li/Q01s_n7N0 -
GenSLMs trained on full sequence length in under one day
By
–
"To enable training of the larger models on the full sequence length (10,240 tokens), we leveraged… CS-2… and obtained GenSLMs that converge in less than a day.” ACM article on our award for this research: https://
hubs.li/Q01s-1f40 Full article: https://
hubs.li/Q01s-0Yy0 -
Argonne’s Andromeda AI Supercomputer Wins Gordon Bell Prize
By
–
At #SC22, we were awarded the Gordon Bell Special Prize for High-Performance Computing-Based #Covid-19 Research. We are thrilled that Rick Stevens and the Argonne National Laboratory team were able to use our AI Supercomputer, Andromeda, to accomplish this world-class research