text-sae-generalizes-to-image-activations

Summary

Anthropic found that a feature-detection tool trained only on text data works immediately on image data, without any image-specific training, suggesting the underlying structure of concepts is shared across modalities rather than being modality-specific. This matters because it implies interpretability tools built for one type of data may transfer broadly, reducing the cost of understanding what a model is doing across text and images.