(5/n) MediSwift was trained in three sizes (Med, Large, and XL), with dense and sparse variants, on a Cerebras Wafer-Scale Cluster with only a few configuration changes. Cerebras makes it easy to experiment and train production-ready models. Contact us to learn how we can help
GENERATIVE AI
-
MediSwift Achieves 75% Sparsity, Reduces Training FLOPs by 2.5x
By
–
(2/n) MediSwift capitalizes on our most recent innovations in sparsity, inducing up to 75% unstructured weight sparsity during in-domain pre-training on biomedical texts. This results in a 2-2.5x reduction in the required training FLOPs. Blog: https://
cerebras.net/blog/sparsity-
made-easy-introducing-the-cerebras-pytorch-sparsity-library
… -
LLMs Outperform Human Experts in Neuroscience Prediction
By
–
Large language models surpass human experts in predicting neuroscience results Luo et al.: https://
arxiv.org/abs/2403.03230 #ArtificialIntelligence #DeepLearning #MachineLearning -
Groq Processors Power OpenRouter Nitro Models With Impressive Speed
By
–
🚀 Thrilled to see our processors powering the latest Nitro models at @OpenRouterAI! The new speed benchmarks are impressive. It's exciting to be at the forefront of AI innovation with such high caliber developers. https://t.co/Gtfhy5fB1q
— Groq Inc (@GroqInc) 8 mars 2024Thrilled to see our processors powering the latest Nitro models at @openrouter
! The new speed benchmarks are impressive. It's exciting to be at the forefront of AI innovation with such high caliber developers. -
Groq’s Brighter Outlook Compared to Stranger in a Strange Land
By
–
"The man who introduces grok to Earth comes to an unpleasant end in Stranger in a Strange Land. For Groq, the outlook seems brighter." — @iainwmorris
-
Extracting Full Logits from OpenAI API via Binary Search
By
–
for those who haven't heard about this:
openAI only gives you the top 5 logprobs per response (max). we (mostly @justintchiu
) came up with an algorithm to get logits from openAI. essentially for a different token (not top-5), u can binary search logit bias to see the minimal -
Language Model Inversion: New Research and Open Source Tools
By
–
paper (language model inversion) http://
arxiv.org/abs/2311.13647 github (open_logprobs) -
Language Model Inversion Attack Research Paper
By
–
language model inversion http://
arxiv.org/abs/2311.13647 -
Generative AI Revenue Market Size and OpenAI’s Market Share
By
–
My tweet says 4B (2B consumer + 2B enterprise). OpenAI is half of that. Note that the relevant quantity is gen AI derived revenue from companies that train their own models and directly monetize them. Not all revenue made by anyone using gen AI (e.g. some company using a 3rd
-
OpenAI API Changes Due to Language Model Inversion Research
By
–
achievement unlocked: OpenAI changes its API because of your research you can still get logits from GPT-4 by using the argmax bisection method detailed in Language Model Inversion. it's pretty expensive, though we should have stockpiled logits while we had the chance…