"DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignment" RL for reasoning has a credit assignment problem. One reward basically gets spread across the whole chain-of-thought. This paper, DGPO, fixes that by turning policy deviation into a token-level