I didn't come up with the name. I called it 'CompactFloat', if I remember correctly. The bfloat16 moniker was given later by some folks in our early TPUv2 hardware team when they were exploring 16-bit floating point formats, to distinguish it from the IEEE fp16 format (that

→ View original post on X — @jeffdean