oh cool, is it *pretraining* data? and they do the same gradient-matching thing? i wonder what the advantage is over just mixing in and doing supervised training on a few examples every now and again
LLMS
-
Sam Altman Declares AGI Solved, Shifts Focus to Superintelligence
By
–
SAM ALTMAN CROIT QUE L'AGI EST RÉSOLUE
— VISION IA (@vision_ia) 31 juillet 2025
« Nous commençons maintenant à nous tourner vers la superintelligence. »
« Quand nous avons créé OpenAI, il y a maintenant presque neuf ans, nous croyions que l'IA pourrait devenir la technologie la plus impactante de l'histoire humaine.… pic.twitter.com/QBBQ9TyDZCSAM ALTMAN CROIT QUE L'AGI EST RÉSOLUE « Nous commençons maintenant à nous tourner vers la superintelligence. » « Quand nous avons créé OpenAI, il y a maintenant presque neuf ans, nous croyions que l'IA pourrait devenir la technologie la plus impactante de l'histoire humaine.
-
RLHF Training: Avoiding Model Drift Through Gradient Mixing
By
–
here's some free alpha: if we do RL for too long after pretraining, we will surely overwrite parameters and start to forget things in the original instructGPT paper, their best model mixed RLHF with pretraining gradients to avoid exactly this model drift issue yet no one is
-
LLM-Assisted Coding Quote Sparks Controversy and Misinterpretation
By
–
This quote turned out to be way more controversial than I expected! I think a bunch of people instantly reacted to it as an argument against any form of LLM-assisted coding at all – without reading the (only slightly longer) piece the quote came from to understand the context
-
Mistral OCR App Converts Images PDFs to Markdown
By
–
I needed an app to export markdown from images and PDFs, so I built one using the best model on the market: Mistral OCR.
— Pietro Schirano (@skirano) 31 juillet 2025
It can convert images, PDFs, and even extract tables and images, keeping them contextually within the markdown.
All you need is a @MistralAI API. pic.twitter.com/cUcraPsD56I needed an app to export markdown from images and PDFs, so I built one using the best model on the market: Mistral OCR. It can convert images, PDFs, and even extract tables and images, keeping them contextually within the markdown. All you need is a @MistralAI API.
-
M2 Mac Experience and LocalLLaMA Community Recommendations
By
–
I have no idea I'm afraid – I don't have any personal experience with anything other two my M2 Mac I'd hit up r/LocalLLaMA for opinions on that
-
Mistral European Champion but Technologically Behind
By
–
My objective has never been to criticize Mistral. On the contrary, I remind you that it is our European champion, supported by remarkable talents. But we must remain clear-sighted: in terms of performance, Mistral remains behind the major American and Chinese models. It is not
-
Mistral, French talent to support despite its limitations
By
–
My title starts with 'Mistral, the talent…' because yes, it's our French and even European champion. We must support them, particularly by stopping putting obstacles in their way with absurd regulations. But let's be clear-eyed: Mistral still lags behind
-
Efficient Differentially Private LLM Fine-Tuning via Reinforcement Learning
By
–
Efficient Differentially Private Fine-Tuning of LLMs via Reinforcement Learning
-
LM Studio: Easiest Way to Try New AI Model
By
–
Looks like LM Studio is currently the easiest way to try the new model