Other than avoiding loss scaling, are there other benefits to using bf16? It still seems to require mixed precision afaict, right?
BF16 Benefits Beyond Loss Scaling in Mixed Precision
By
–
By
–
Other than avoiding loss scaling, are there other benefits to using bf16? It still seems to require mixed precision afaict, right?