zhou-2023-max-16-demonstrations
IN premise — summaries/2026/08/24/zhou-2023-context-faithful-prompting-s4-experiments.md
Created 2026-08-25T02:59:10+00:00
The maximum number of few-shot demonstration instances used in experiments was 16, limited by the context window; abstention tasks used 3 demonstrations per instance.
Summary
The experiments were capped at 16 example prompts per input because the model's context window could not fit more, and abstention-style tasks were further constrained to just 3 examples. This means any conclusions drawn are bounded by a hard practical limit on how much in-context guidance the model received, not by a deliberate choice to keep demonstrations low.