"To enable training of the larger models on the full sequence length (10,240 tokens), we leveraged… CS-2… and obtained GenSLMs that converge in less than a day.” ACM article on our award for this research: https://
hubs.li/Q01s-1f40 Full article: https://
hubs.li/Q01s-0Yy0
@cerebras
-
GenSLMs trained on full sequence length in under one day
By
–
-
Argonne’s Andromeda AI Supercomputer Wins Gordon Bell Prize
By
–
At #SC22, we were awarded the Gordon Bell Special Prize for High-Performance Computing-Based #Covid-19 Research. We are thrilled that Rick Stevens and the Argonne National Laboratory team were able to use our AI Supercomputer, Andromeda, to accomplish this world-class research
-
Argonne’s GPT Model Wins Gordon Bell Prize for COVID Research
By
–
In partnership with @Argonne
, we’ve been awarded the 2022 Gordon Bell Special Prize for HPC Based COVID-19 Research! We trained ANL’s GPT-style models on full Covid-19 genome, holding the entire sequence length (10240 tokens) on a single device. Read more: https://
hubs.li/Q01sCD600 -
CS-2 System Achieves Fast SARS-CoV-2 Genome Training Convergence
By
–
At a Gordon Bell Prize finalist talk, Kyle Hippe of @argonne said “The CS-2 system allows for really fast time to solution. We were able to train from scratch on the SARS-CoV-2 genomes and reach convergence in less than a day." Read the @HPCwire article:
-
JasperAI Partners with Cerebras for Next-Gen Model Optimization
By
–
“We are thrilled to partner with Cerebras and leverage Andromeda's performance and near-perfect scaling without traditional distributed computing and parallel programming pains to design and optimize our next set of models,” says Dave Rogenmoser, CEO of JasperAI.
-
Computational Physics Research with Cerebras CS-2 System
By
–
At #SC22? Join Dr. Dirk Van Essendelft today at #SC22 as he describes the tremendous Computational Physics research he’s done using the Cerebras CS-2 system. #HPC #Physics #SC22
-
Wafer-Scale Engine on Display at SC22 Conference
By
–
Our treasured Wafer-Scale Engine will be on display at #SC22! Come by our booth (#2833) and take a selfie with it, tag us, and join the ranks of many of our other friends in the industry.
-
Quantum Computing Integration with HPC Systems for Hybrid Applications
By
–
Quantum computing is a growing field but quantum systems are of limited use unless integrated with HPC systems to enable efficient pre- and post-processing and to allow for truly hybrid applications. Join our Director of PM, Natalia Vassilieva, at #SC22 to learn more!
-
Training Transformers at Scale for Scientific Applications
By
–
Transformers and other large language models have shown impressive capabilities as foundation models for domains such as NLP and CV. Join Andy Hock, our VP of Product, at #SC22, as he discusses new algorithms, software, and hardware for training transformers at scale for science
-
Argonne Nominated for Gordon Bell Special Prize HPC COVID Research
By
–
@Argonne was nominated for the 2022 Gordon Bell Special Prize for HPC Based COVID-19 Research, based on their work on CS-2! Join us for this event at #SC22! Read more about our research here: https://
hubs.li/Q01rJhNW0