The accurate summarisation of the paper: Researchers from Stanford and Tsinghua identified sparse hidden-state dimensions associated with expected correctness and changes in expected correctness.
Fewer than 1% of dimensions were sufficient for their probes to preserve much of https://
x.com/thesupermannx/
/thesupermannx/status/2102027727192932469
…
Sparse Hidden-State Dimensions Signal Expected Model Correctness
By
–