cad-conditional-independence-noop

IN premise — summaries/2026/08/24/shi-2024-context-aware-decoding-s2-method.md

Created 2026-08-25T02:58:35+00:00

If context c is conditionally independent of the generation given (x, y_

Summary

If the context carries no additional information about what token will be generated next (beyond what the input and prior tokens already determine), then the CAD adjustment is completely inert — no setting of its strength parameter will alter the output. In practice, this means CAD only has a real effect when the context is genuinely informative for the prediction, and it serves as a built-in check that the mechanism won't waste compute or introduce noise in cases where the context is redundant.