It's actually thriving. I probably have bookmarked at >100 interesting papers on reasoning-related methods in just the last few months. I will share some thoughts / synthesis of all this in the upcoming weeks.
@rasbt
-
Missing GPT-1 Base Baseline in Comparison Analysis
By
–
Ok, so my criticism here is not the scores. But the right baseline is missing.
Should have a "GPT-1 base" column. -
Ordinal Regression and Classification Techniques
By
–
Even better: Ordinal regression (/classification) Shameless plug:
-
Social Apps for AI Videos: Expensive but Effective Preference Data Collection
By
–
Social apps for AI generated videos are one expensive way to collect human preference labels for RL. But those preference labels are probably going to be spot on.
-
DeepSeek V3.2 Sparse Attention Preparation for V4 Support
By
–
DeepSeek V 3.2 is basically just a heads up for inference tools devs to implement their new sparse attention mechanism so they can add V4 support on day 1
-
New Book Builds on LLM from Scratch with Reasoning Techniques
By
–
Yes! It basically picks up where the LLM from Scratch left of. I.e., we start with a pre-training LLM and then implement and add reasoning techniques.
(However, it can also be read as a standalone book) -
Symbolic Verifiers vs LLM Judges for Verification Tasks
By
–
What do you mean with set of prompts? A LLM judge with a rubric? (That’s a different approach; covered in the appendix).
The reason for a symbolic verifier is that it is symbolic. There is no nondeterminism, bias, etc. Doesn’t work for everything, but eg for math there is no -
GRPO-based models and gibberish detection techniques
By
–
I think they are all basically based on GPRO++, Dr. GRPO etc. But the one interesting one is the Gibberish detection. Need to borrow this!
-
PPO Algorithm Consistency Across Different Reward Signal Implementations
By
–
I'd have said the opposite as they all use the same PPO (or PPO-like) algorithm, just with different reward signals