Sonnet-4.6 takes top place on all my evals: EQ-Bench, Creative writing, Longform writing & Judgemark. Opus 4.6 within margin of error. GLM-5 and Qwen3.5-397B nipping at their heels.
→ View original post on X — @maximelabonne, 2026-02-18 21:33 UTC
@maximelabonne
-
Consistent AI Rankings: Dataset Evaluation Methodology Questions
By
–
It's surprising that it still manages to output such a consistent ranking. Are they simply evaluating on a fraction of the dataset, effectively?
-
SWE-Rebench: Software Engineering AI Evaluation Benchmark January 2026
By
–
The eval is probably not perfect, so please just consider it as an additional signal https://
swe-rebench.com/?insight=jan_2
026
… -
Chinese LLMs Performance on SWE-bench: M2.5 Underperforms Opus
By
–
Oof, SWE-rebench is brutal for recent Chinese releases M2.5 reported 80.2% on SWE-bench verified against 80.8% for Opus 4.6, but it seriously underperforms here Qwen3-Coder-Next looks good with 40% and only 80B A3B parameters
-
Healthcare AI Panel Expert Recommendation for Future Collaboration
By
–
Ah that's too bad! I'll DM you next time @josephinePqt1 I can recommend my friend Maziyar if you ever want to do a healthcare-related panel (or any of his many, many hats in AI)
-
OpenMed Healthcare Initiative Referral London Event
By
–
London! Actually, a lot of people were interested in healthcare, so I referred your OpenMed initiative (expect my invoice in your DMs)
-
Small Models AI Discussion and Use Cases Exploration
By
–
Lots of interest around small models! It was a pleasure ranting about AI and talking about your use cases. Thanks to @josephinePqt1 and the AI Circle for inviting me!
-
LFM2.5-1.2B-Thinking Model Demonstrates Impressive Instruction Following
By
–
Thanks @xeophon and @natolambert for your kind words on @interconnectsai LFM2.5-1.2B-Thinking is even more impressive in terms of instruction following. Please check it out!
-
Fine-tuning Resources: SFT, GRPO, and CPT Notebooks
By
–
Text SFT: https://
colab.research.google.com/drive/1vGRg4ks
Rj__6OLvXkHhvji_Pamv801Ss?usp=sharing
…
Vision SFT: https://
colab.research.google.com/drive/1FaR2HSe
91YDe88TG97-JVxMygl-rL6vB?usp=sharing
…
Text GRPO: https://
colab.research.google.com/drive/1mIikXFa
GvcW4vXOZXLbVTxfBRw_XsXa5?usp=sharing
…
CPT (text completion): https://
colab.research.google.com/drive/10fm7eNM
ezs-DSn36mF7vAsNYlOsx9YZO?usp=sharing
…
CPT (translation): https://
colab.research.google.com/drive/1gaP8yTl
e2_v35Um8Gpu9239fqbU7UgY8?usp=sharing
…