Today we are releasing Codestral-22B, our first code model! Codestral is trained on more than 80 programming languages and outperforms the performance of previous code models, including the largest ones. It is available on our API platform, through instruct and
MACHINE LEARNING
-
Daily content sharing on Python, Data Science, and Machine Learning
By
–
That's a wrap! If you are interested in any of these below topics: – Python – Data Science – Machine Learning – Data Analysis – LLMs – MLOps Find me → @Sumanth_077 I'm sharing daily content over here.
-
Pandas AI: Data Cleaning, Feature Engineering and Visualization
By
–
With Pandas AI you can: → Clean the Data → Impute missing values → Generate New features → Analyze and manipulate the data Not just that you can also ask it to plot the charts: Here is plotting Histogram with Pandas AI:
-
PandasAI: Generative AI for Natural Language Data Analysis
By
–
Python library that adds Generative AI capabilities to Pandas Introducing PandasAI, now you can analyze complex data frames and plot visualizations just by using natural language:
-
FineWeb Extended Report and Blog Post Coming Soon
By
–
We're finishing a pretty awesome extended blogpost/report on FineWeb in which you'll find all the info – stay tuned!
-
GPT-3 Breakthrough: Scaling Language Models Revealed AI Potential
By
–
2/ GPT-3 was when it first became clear what the potential of scaling language models was. The efficacy of GPT-3 took the AI community by surprise for the most part—the capabilities were staggering compared to everything that came before in NLP.
-
GPT-3 Marked Inflection Point for Language Models AI
By
–
3/ @scale_AI had started working on language models the year before on the very first RLHF experiments on GPT-2. But GPT-2 still felt very much like a toy at that time. GPT-3 was the first moment where it was obvious this would be the major theme of AI
-
OpenAI’s 2020 Scaling Laws Paper: Foundation of Modern AI
By
–
4/ The key insight of scaling laws was actually published earlier that year in Jan 2020 by OpenAI—"Scaling Laws for Neural Language Models" This paper and GPT-3 ultimately was the start of the current AI era of rapidly scaling language models—especially the compute + data needed
-
GPT-3 Anniversary: Four Years of Language Model Evolution
By
–
1/ Today is the 4th anniversary of the original GPT-3 paper—"Language Models are Few-Shot Learners" Some reflections on how the last 4 years have played out, and thoughts about the next 4 years
-
H100 and FP8 optimizations for performance improvement
By
–
Nice! H100 is a great "free win" to bring this down.
Turning on fp8 for GEMMs would be the other source of really solid improvement, imminently