unbiased-cka-can-be-negative
IN premise — summaries/2026/08/24/aristotelian-2026-sR-references.md
Created 2026-08-24T17:10:51+00:00
Unbiased CKA (using the zero-diagonal Gram U-statistic HSIC estimator) can produce negative values at finite n, unlike biased CKA which is always in [0,1]
Summary
At finite sample sizes, the unbiased alignment score can dip below zero, even though its biased counterpart is mathematically guaranteed to stay between 0 and 1. This matters because any downstream logic that assumes the score is non-negative — thresholds, ranking comparisons, or optimization targets — will misfire or produce misleading results when the unbiased estimator returns a negative value that is simply a finite-sample artifact rather than a meaningful signal of "anti-alignment."