New podcast: how we made Cerebras-GPT with @DeyNolan and @QuentinAnthon15
. A deep look on what it's like to train on Cerebras and the tradeoffs between compute and inference optimal training.
@cerebras
-
Cerebras-GPT Training: Compute vs Inference Optimization
By
–
-
Chinchilla Paper Anniversary: One Year Transforming LLM Training
By
–
A year ago @DeepMind released the Chinchilla paper, forever changing the direction of LLM training. Without Chinchilla, there would be no LLaMa, Alpaca, or Cerebras-GPT. Happy birthday Chinchilla! https://
deepmind.com/publications/a
n-empirical-analysis-of-compute-optimal-large-language-model-training
… -
Cerebras-GPT Models Surpass 130k Downloads Milestone
By
–
Cerebras-GPT models have been downloaded over 130k times since our announcement and our 111M parameter model just crossed 85k downloads! We've already seen users enjoy this model using their local deployments! Models – https://
hubs.li/Q01L0xYC0
Discord – https://
hubs.li/Q01L0mPQ0 -
Cerebras-GPT Model Family Trends on Hugging Face
By
–
We are excited to see a Cerebras-GPT model trending on Hugging Face! Check out our page on Hugging Face to see the entire family of models: https://
hubs.ly/Q01KRZzT0 -
Pittsburgh Supercomputing Center Opens Summer 2023 Neocortex Proposals
By
–
Currently, Pittsburgh Supercomputing Center has opened their summer 2023 call for proposals for system time on the Neocortex, which now features two Cerebras CS-2 systems. Call for Proposals page: https://
hubs.ly/Q01KgwFd0 Learn more about Neocortex: https://
hubs.ly/Q01KgymB0 -
Cerebras Models Now Available on Hugging Face Platform
By
–
Access the models via Hugging Face: https://
huggingface.co/cerebras?utm_c
ontent=243949389
… Join our Discord: https://
discord.com/invite/q6bZcMW
JVu
… -
Cerebras-GPT Demonstrates AI Chip Capability for Neural Network Training
By
–
@nathanbenaich described the availability of Cerebras-GPT as "an opportunity to show customers that their AI chips can be used to train modern neural networks that are set to be the industry standard for the upcoming future." Read the newsletter here: https://
nathanbenaich.substack.com/p/your-guide-t
o-ai-april-2023
… -
Cerebras Offers Cloud GPU Capacity Amid Market Shortage
By
–
We hear there is a cloud GPU shortage out there. Cerebras has plenty of capacity to share – come snag a CS2 instance – faster than a bunch of DGXs! http://
cerebras.net/product-cloud/ -
Cerebras Models Now Available on Hugging Face Platform
By
–
Access the models via Hugging Face: https://
huggingface.co/cerebras Join our Discord: https://
discord.com/invite/q6bZcMW
JVu
… Read the full article here: -
Cerebras-GPT Models Emphasize Open, Royalty-Free AI Access
By
–
@Marktechpost recently wrote an article about the availability of the Cerebras-GPT family of models and mentioned that "It is crucial to have access to open, replicable, and royalty-free state-of-the-art models … for LLMs to be a freely available technology."