chameleon-five-step-framework
IN premise — summaries/2026/08/24/xie-2024-chameleon-sloth-s0-abstract-chunk-1.md
Created 2026-08-25T02:58:58+00:00
The LLM knowledge conflict framework consists of 5 steps: parametric memory elicitation, counter-memory construction, entailment checking (DeBERTa-V2), answer consistency verification, and evidence preference evaluation in multiple-choice format.
Summary
This defines the exact five-step pipeline the system follows whenever an LLM's internal knowledge clashes with new evidence: surface what the model "remembers," build the conflicting piece, check logical entailment with DeBERTa-V2, verify the answer is self-consistent, and finally pick which evidence to trust in a multiple-choice comparison. In practice, it means conflict resolution is a fixed procedure rather than an ad-hoc judgment, so the system always reasons through the same stages before deciding which information wins.