An Open Source Tsunami Is Coming
LLMS
-
GPT-4 vs GPT-4o: Costly API Pricing Mistake Discovery
By
–
I remember the days when you discover that you've accidentally set your API call to be 'GPT-4' instead of 'GPT-4o' and your heart drops (because GPT-4 was like 10x more expensive than GPT-4o)
-
OpenAI prepares ChatGPT Ads for broader rollout
By
–
OpenAI prepares ChatGPT Ads for a broader rollout on web and mobile apps. "Ads are personalized based on current chat, ad interactions, and past chats/memory"
-
Cohere Invites Developers to Start Building with AI Platform
By
–
We're glad to hear it. First step to building with us: https://
dashboard.cohere.com/welcome/login -
OpenAI’s ChatGPT ad pricing suggests deeper user insights than Google
By
–
OpenAI wanting $60 per 1,000 impressions for ads on ChatGPT just tells you that they know 10-100x more about their users than Google.
-
50 Essential LLM Interview Questions and Answers
By
–
Over 50 essential LLM interview questions & their answers: https://
bit.ly/4j5UV6p v/devinterview -
Self-Distillation Fine-Tuning: On-Policy Continual Learning from Expert Demonstrations
By
–
2026 is the year of continual learning And we are getting some amazing papers towards that This paper introduces Self-Distillation Fine-Tuning (SDFT): on-policy continual learning from expert demonstrations, with no explicit reward inference or engineering The trick here is:
-
Using o1-pro to Show Premium AI Capabilities
By
–
If I want to impress someone, I don't use Opus 4.5 or GPT-5.2-xhigh, I use o1-pro to show that no expense has been spared
-
Fine-tuning Resources: SFT, GRPO, and CPT Notebooks
By
–
Text SFT: https://
colab.research.google.com/drive/1vGRg4ks
Rj__6OLvXkHhvji_Pamv801Ss?usp=sharing
…
Vision SFT: https://
colab.research.google.com/drive/1FaR2HSe
91YDe88TG97-JVxMygl-rL6vB?usp=sharing
…
Text GRPO: https://
colab.research.google.com/drive/1mIikXFa
GvcW4vXOZXLbVTxfBRw_XsXa5?usp=sharing
…
CPT (text completion): https://
colab.research.google.com/drive/10fm7eNM
ezs-DSn36mF7vAsNYlOsx9YZO?usp=sharing
…
CPT (translation): https://
colab.research.google.com/drive/1gaP8yTl
e2_v35Um8Gpu9239fqbU7UgY8?usp=sharing
… -
LFM2.5 notebooks update: SFT, GRPO, CPT with vision
By
–
We worked with @UnslothAI to bring up-to-date notebooks for LFM2.5 It covers SFT, GRPO, and CPT with text and vision (SFT-only). Continued pre-training is particularly nice with the base model for text completion and translation examples.