ScaleRL isn’t magic. It’s a recipe of small, proven ingredients: – Pipeline-RL async setup
– FP32 logits for stable gradients
– CISPO loss (clipped importance sampling)
– Prompt-level averaging
– Batch-level normalization
– No-Positive-Resampling (drop “too easy” prompts)

→ View original post on X — @godofprompt