In prior work, we've claimed that the residual stream has no "privileged basis" and individual coordinates should have no special significance. The presence of persistently-large coordinates suggested our theory might miss something.

→ View original post on X — @anthropicai,