One neat thing is that, very experimentally, crosscoders can be used to "diff" models: comparing between, say, a pretrained model and a fine-tuned one, to see how they differ at a more basic level.
Crosscoders as Model Comparison Tools: Experimental Interpretability Approach
By
–
