icl-gd-gap-persists-across-model-scale

OUT premise — summaries/2026/08/24/shen-2023-icl-not-gd-s4-icl-demonstrations.md

Created 2026-08-25T02:58:32+00:00

The behavioral gap between ICL and GD does not significantly narrow when model size increases from 1.5B (GPT2-XL) to 7B (LLaMA) on AGNews with N=8 demonstrations.