Isn't the point of normalization to control for the number of tokens (i.e. using mean rather than sum), so these 20% variations should be accounted for with acc_norm. I figured that's why most people use acc_norm these days!
By
–
Isn't the point of normalization to control for the number of tokens (i.e. using mean rather than sum), so these 20% variations should be accounted for with acc_norm. I figured that's why most people use acc_norm these days!