llm-control-operates-at-training-and-inference-layers
IN derived (depth 3)
Created 2026-06-21T09:57:37+00:00 · Reviewed 2026-06-21T14:41:08+00:00
LLM behavior control has developed along two axes: training-time alignment (which diversified from RLHF into three independent paradigms — full RLHF, DPO/IPO/KTO, and Constitutional AI) and inference-time prompting (which evolved from linear CoT through self-consistency to branching ToT, adding search structure to manage prompt-dependent variability). The antecedents establish these as parallel developments but do not directly establish that they compensate for each other's specific limitations.
Justifications
SL — training-time and inference-time control evolved independently into complementary stacks
Antecedents (all must be IN):
- IN alignment-diversified-into-three-independent-paradigms — LLM alignment diversified from a single RLHF pipeline into three independent paradigms — full mathematical RLHF, direct preference optimization (DPO/IPO/KTO), and Constitutional AI — each eliminating different sources of complexity while preserving alignment quality.
- IN prompting-sophistication-compensates-for-irreducible-sensitivity — Prompt sensitivity is a persistent, intrinsic property not resolved by scaling, and the field developed increasingly structured prompting approaches (CoT → self-consistency → tree-of-thoughts) that add search structure to reasoning. These techniques manage prompt-dependent variability by structuring the reasoning process, though the antecedents do not establish that this was the explicit motivation for their development.
Dependents
These beliefs depend on this one:
- OUT dual-layer-control-insufficient-without-injection-defense — The dual-layer LLM control stack — training-time alignment diversity (RLHF, DPO, Constitutional AI) and inference-time prompting sophistication (CoT, self-consistency, context engineering) — would be sufficient for safe agentic deployment, but prompt injection's architectural vulnerability undermines the entire inference-time control layer.
- IN llm-reliability-requires-five-independent-defense-dimensions — LLM reliability requires independent defenses across at least five dimensions — two control layers (training-time alignment, inference-time prompting) and three security surfaces (training data poisoning, prompt injection, architectural vulnerability) — with no single defense sufficient on its own.
- OUT reactive-security-addressable-through-dual-layer-defense-maturation — The security deficit at the unpredictable innovation frontier could become addressable as both the training-time alignment layer (diversified into three independent paradigms) and inference-time control layer (increasingly sophisticated prompting from CoT through ToT) independently mature — each layer catches failure modes the other misses, and their independence means a single-point failure cannot compromise both.
- IN reasoning-orthogonality-creates-combinatorial-configuration-space — The orthogonality of reasoning and alignment as capability dimensions, combined with LLM control operating at independent training and inference layers, creates a combinatorial model configuration space — reasoning can be tuned independently (training-time specialization or inference-time prompting), alignment can be selected from three paradigms, and both operate across two control layers — replacing a single capability-safety tradeoff with a multi-axis design space.