This new Z AI paper suggests agent RL should learn from single rollout as it comes in, and not wait for perfectly grouped batches. So instead of waiting for a whole GRPO group of rollouts to finish, Single-rollout Asynchronous Optimization (SAO) trains on each rollout the moment
Single-Rollout Asynchronous Optimization Updates Agents Without Waiting for Groups
By
–
