sae-jcr-prevents-feature-splitting

IN premisesummaries/2026/08/24/templeton-2024-scaling-monosemanticity-chunk-2.md

Created 2026-08-25T02:58:37+00:00

Jump Consistency Regularization (JCR) is a regularization term that discourages two nearby features from representing the same concept, preventing the 'feature splitting' pathology.

Summary

Jump Consistency Regularization is a training penalty that stops the model from redundantly encoding the same concept across multiple nearby features. This keeps the learned representations clean and interpretable, so each feature actually corresponds to one distinct idea rather than a diluted copy of a neighbor's idea.