cad-default-alpha-0-5

IN premise — summaries/2026/08/24/shi-2024-context-aware-decoding-s5-related-work.md

Created 2026-08-25T02:58:36+00:00

The empirically robust default value for CAD's hyperparameter α is 0.5, with larger values providing additional benefit specifically on knowledge-conflict tasks (Memotrap, NQSWAP).

Summary

CAD has a well-tested starting setting at 0.5 for its key tuning knob, so you don't need to guess when configuring the system. If the task involves resolving contradictions between what the system already "knows" and new information it encounters, pushing that value higher tends to help performance.