If you’re still only testing GPT-4 and Claude, you’re missing out on what’s coming next.
LLMS
-
Qwen Introduces Group Sequence Policy Optimization for LLMs
By
–
"Group Sequence Policy Optimization" Qwen introduces Group Sequence Policy Optimization (GSPO), a RL algorithm for LLMs that uses sequence-level importance weighting and clipping instead of token-level methods, which provides high performing training for MoE models.
-
OpenAI Faces Talent Loss, Delays, and Valuation Setbacks
By
–
OpenAI (Chatgpt) ces dernières semaines, gros coup dur : – a perdu la moitié de ses meilleurs talents
– a retardé la sortie de GPT-5
– a repoussé l’open source
– a vu le financement de SoftBank pour Stargate s’arrêter
– a subi une baisse de valorisation en capital-investissement -
Meta Hires OpenAI’s Shengjia Zhao as Chief Scientist
By
–
Et ça continue… Shendjia Zhao, une des meilleure chercheuse chez open AI, qui a co-développé GPT-4 et le moteur de raisonnement o1 est maintenant recruté par Mark Zuckerberg Traduction : Nous sommes ravis d’annoncer que shengjia_zhao sera le Chief Scientist des Meta
-
Architecture Ablation Study and LLM Objective Functions Analysis
By
–
It clearly ablates the main architectures like encoder decoder, decoder only etc. it even tried prefix lm. Also a master class in llm objective functions.
-
T5 Paper Remains the Most Insightful LLM Pretraining Classic
By
–
I think t5 paper is still the best classic most insightful paper for LLM pretraining. Way ahead of it's time.
-
Mastering spaCy: Build Advanced NLP Solutions with Custom Components
By
–
Mastering spaCy — Build structured NLP solutions with custom components & models powered by spacy-llm [2nd Edition]: http://
amzn.to/3QpPfXi via @PacktDataML 𝓦𝓱𝓪𝓽 𝔂𝓸𝓾 𝔀𝓲𝓵𝓵 𝓵𝓮𝓪𝓻𝓷: Apply transformer models and fine-tune them for specialized NLP tasks Master -
Critical perspective on AI benchmarks and AGI progress
By
–
Slightly better benchmarks, connected models into one (depending on user’s task). Hype, not AGI
-
Paywall llms.txt feature enhances premium customer experience
By
–
This is kinda cool actually — an llms.txt behind a paywall; very nice extra touch to provide paying customers! 😀
-
LLMs Learn to Write With Typos and Errors
By
–
Because LLMs could never, ever learn to rite with typos