AI Dynamics

Global AI News Aggregator

About

Normalization and Token Counting in AI Model Evaluation

Isn't the point of normalization to control for the number of tokens (i.e. using mean rather than sum), so these 20% variations should be accounted for with acc_norm. I figured that's why most people use acc_norm these days!

→ View original post on X — @alexjc