AI Dynamics

Global AI News Aggregator

BFloat16 Weight Clipping Limits and Extreme Value Representation

By

@rasbt

–

Hm, so that means all weights above values 65504 and below -65504 will be clipped. Does anyone know of there are numbers that large/small in the original bfloat16 representation?

→ View original post on X — @rasbt,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *

MORE ARTICLES