My understanding from the paper is that it's fp8. Maybe @zizhpan can confirm

→ View original post on X — @reach_vb