It's 3 AM and Fable 5 just solved a bug for me that I've been struggling with for a week, impossible to find on an adversarial PPO training where the gradient was becoming almost zero… Well, it fixed it. And it also increased my parallelism to 4,557 steps/env/s.
Fable 5 solves an adversarial PPO bug and improves parallelism
By
–