feature-clumping-downstream-actions

Summary

When neurons or directions in a network's activation space tend to cluster together, the main reason is that they push the network toward similar outputs or behaviors, not simply because they happen to light up on similar inputs. This matters because it means the best way to understand what a feature is doing is to trace what it causes downstream, rather than just cataloging which inputs trigger it.