LLM distillation helps train SLMs that retain the reasoning power of large models, while slashing inference costs. Join us to learn: Fine-tuning vs. distillation Training SLMs for specialized tasks Reducing latency & compute costs Register: https://
snorkel.ai/webinar/improv
ing-the-accuracy-of-domain-specific-tasks-with-llm-distillation/
…
RESEARCH
-

LLM Distillation: Training Efficient Models for Specialized Tasks
By
–
-
LLM Post-Training: Deep Dive into Reasoning Models
By
–
LS Paper Club: LLM Post-Training: A Deep Dive into Reasoning Large Language Models
-

Pareto Analysis of High-Capability AI Models at Competitive Pricing
By
–
Love me a good Pareto graph: our focus on highly capable, efficient models at a great price looks pretty good on these (note the logarithmic X axis).
-

Support ArXiv’s Open Science Mission with Triple Matching Donations
By
–
We're excited to be able to support ArXiv in its mission to promote open science and research, by TRIPLING donations you make today. ArXiv has been helping the research community for the last >30 years, time to help back! https://
givingday.cornell.edu/campaigns/arxiv -
Building Deep Research Agents with SambaNova
By
–
POV: You want to build a deep research agent from scratch @Aurimas_Gr is the real MVP for showing us how build a Deep Research Agentic system with SambaNova in this @SwirlAI newsletter Check it out
-

Benchmarks and Competitions Drive Scientific Progress
By
–
Benchmarks and competitions are an effective way to drive scientific progress.
-
Auditing Language Models for Hidden Objectives and Alignment
By
–
For more information about our RM-sycophantic model, our auditing game, alignment auditing techniques, and a nuanced discussion of the value LLM interpretability provides for alignment auditing, read our paper: https://
assets.anthropic.com/m/317564659027
fb33/original/Auditing-Language-Models-for-Hidden-Objectives.pdf
… -
Advancing AI Alignment Auditing Methodologies and Assurances
By
–
Our auditing game has limitations, but similar methodologies could advance the science and practice of alignment auditing, and enable AI developers to provide positive assurances about the alignment of their systems. Read the blog post:
-

Auditing AI Models Through Interpretability and Sparse Autoencoders
By
–
We audited this model using training data analysis, black-box interrogation, and interpretability with sparse autoencoders. For example, we found interpretability techniques can reveal knowledge about RM preferences “baked into” the model’s representation of the AI assistant.
-

Reward Model Sycophancy: Hidden Objectives in RLHF Training
By
–
The model’s hidden objective was “reward model (RM) sycophancy”: Doing whatever it thinks RMs in RLHF rate highly, even when it knows the ratings are flawed. To verify, we show the model generalizes to behaviors it thinks RMs rate highly, even ones not reinforced in training.