hendel-t-sne-50-vectors-per-task-llama7b
IN premise — summaries/2026/08/24/hendel-2023-icl-task-vectors-s4-robustness-of-task-vectors.md
Created 2026-08-25T02:58:04+00:00
Robustness analysis sampled 50 different (S, x′) pairs per task using LLaMA 7B; t-SNE plots showed tight task-specific clusters with within-task distances smaller than cross-task distances.
Summary
When LLaMA 7B was tested on 50 different variations of each task, its outputs stayed tightly grouped within a task and clearly separated from every other task. This means the model's behavior is stable and predictable per task, and different tasks produce reliably distinct results, so downstream logic can trust that task identity is well-defined rather than ambiguous or overlapping.