We go into detail about the infrastructure behind large scale training including the kernels we developed and open-sourced for the project. We also discuss distributed training and environment scaling for RL.
Large Scale Training Infrastructure Kernels and Distributed RL Scaling
By
–
