Worth mentioning that we can also train these models with very large context windows — up to 30k instead of 1k like the original.
@cerebras
-
Training from Scratch Pricing Table for Language Models
By
–
Here's a screenshot of our training-from-scratch pricing table that is on the webpage posted in the previous thread. We can also train to non-Chinchilla – do you have more information about the dataset?
-
First CFD Simulation on Wafer-Scale Engine Announced
By
–
Recently we announced the first-ever computational fluid dynamics simulation on our Wafer-Scale Engine. We joined our partners at NETL and PSC who made this achievement possible for a fire-side chat. Watch to learn more about how we are reinventing CFD!
-
Cerebras AI Model Studio Launches Fine-Tuning Service
By
–
Fine-tuning of large language models is now available via the Cerebras AI Model Studio, a pay-by-the-model computing service powered by dedicated clusters of Cerebras CS-2 systems. Interested? Learn more here – https://
hubs.li/Q01D09L70 Free trial – https://
hubs.li/Q01D0mfx0 -
Genome-Scale Language Models Learn SARS-CoV-2 Evolutionary Landscape
By
–
Tomorrow @argonne
's Arvind Ramanathan shares with our community how his team built genome-scale language models that can learn the evolutionary landscape of SARS-CoV-2 genomes. This research won the 2022 ACM Gordon Bell Special Prize. Join us! https://
hubs.li/Q01CV9rF0 -
LLM Abstractive Summarization for Long Documents in Healthcare
By
–
Join us for our talk, "Long Document Abstractive Summarization with Large Language Models" at the virtual #NLPSummit 2023 on April 4-5 by @JohnSnowLabs
! Two days of discussions on #NLP applications in healthcare and life sciences. Register for free: https://
hubs.li/Q01Ck9Ww0 -
Pittsburgh PSC Opens Neocortex Summer 2023 Call for Proposals
By
–
On Feb 28th, Pittsburgh Supercomputing Center will present the Summer 2023 Call for Proposals for time on Neocortex, which now features two Cerebras CS-2 systems Neocortex: https://
cmu.edu/psc/aibd/neoco
rtex/
… Webinar: https://
us06web.zoom.us/webinar/regist
er/WN_yQ5g73p3RWa_irEa_uYDkQ?utm_content=238156959&utm_medium=social&utm_source=linkedin&hss_channel=lcp-10858000
… Call for Proposals: https://
cmu.edu/psc/aibd/neoco
rtex/2023-03-cfp-spring-2023.html
… -
GenAI Conference Highlights Inspiring Conversations and Industry Insights
By
–
So many inspiring and interesting conversations at this year's #GenAI conference, hosted by @heyjasperai
. Fun to hear all the insights on this panel with @andrewdfeldman
, @openai
, @coatue, @cohereai -
Genome-Scale Language Models Learn SARS-CoV-2 Evolution
By
–
Join us for a guest presentation! @argonne
's Arvind Ramanathan will share how his team built genome-scale language models that can learn the evolutionary landscape of SARS-CoV-2 genomes. This research won the 2022 ACM Gordon Bell Special Prize. Register: https://
hubs.li/Q01CkjLt0 -
Waferscale Architectures Bridge Post-Moore’s Law AI Computing
By
–
The Next Platform writes "…waferscale architectures were dismissed as impractical. 5 years ago, they were touted as a fringe possibility for AI/ML. But the next decade might demonstrate waferscale as [a] bridge across the post-Moore’s Law divide" Read