cad-core-decoding-formula

IN premise — summaries/2026/08/24/shi-2024-context-aware-decoding-s1-introduction.md

Created 2026-08-25T02:58:34+00:00

The CAD decoding formula is y_t ~ softmax[(1+α)·logit_θ(y_t|c,x,y_

Summary

This is the core mechanism that lets the system pull out what the context specifically contributes at every token step, by boosting tokens the context favors relative to what the prompt alone would predict and suppressing the rest. The alpha parameter acts as a dial for how aggressively the system separates the contextual signal from generic prompt-driven output, so setting it wrong either drowns out the context or makes the generation unstable.