icl-distinguishability-condition-kl-threshold

OUT premise — summaries/2026/08/24/xie-2021-icl-bayesian-s3-theoretical-analysis.md

Created 2026-08-25T02:58:56+00:00

The distinguishability condition (Eq. 14) requires that the sum over k tokens of KL divergence KL_j(θ*∥θ) exceeds ε^start_θ + ε^delim_θ for all θ ≠ θ*, where ε^delim_θ = 2(log c₂ − log c₁) + log c₄ − log c₃ and ε^start_θ = log(1/c₈).