It makes sense though since it’s kind of like batch size: make it as large as your hardware permits (… < bfloat 16 < bfloat 16/32 mixed < float 32)
Batch Size Analogy for Precision Selection in Hardware
By
–
By
–
It makes sense though since it’s kind of like batch size: make it as large as your hardware permits (… < bfloat 16 < bfloat 16/32 mixed < float 32)