formal-verification-impossibility-extends-to-disambiguation-layer
IN derived (depth 11)
Created 2026-06-21T13:13:49+00:00 · Reviewed 2026-06-21T14:41:08+00:00
The craft discipline's formal verification impossibility (grounded in NLP's AI-complete classification) extends to the disambiguation layer where the most critical security vulnerability operates: since prompt injection exploits the universal disambiguation problem (semantic context crossing processing boundaries), the formal verification deficit is rooted at the most fundamental processing level — not merely at the surface of deployment complexity.
Justifications
SL — Formal verification impossibility operates at the same processing level as the universal disambiguation constraint underlying injection
Antecedents (all must be IN):
- IN formal-verification-impossible-given-ai-completeness — The craft discipline's inability to achieve formal safety verification may reflect a fundamental impossibility rather than a maturity gap: NLP's classification as AI-complete implies that formally verifying NLP system behavior requires solving the full AI problem, explaining why safety assurance remains fundamentally informal despite decades of engineering maturity and massive investment.
- IN disambiguation-boundary-violation-is-universal-computational-constraint — The need for semantic context to resolve disambiguation appears as a recurring pattern across processing hierarchies: both compilers (the C lexer hack requiring symbol table feedback across the lexer-parser boundary) and LLMs (prompt injection exploiting the inability to distinguish instructions from data) exhibit cases where lower-level processing cannot resolve meaning without higher-level semantic knowledge, suggesting that formal processing-level separations face inherent pressure from disambiguation demands that cross those boundaries.
Dependents
These beliefs depend on this one:
- IN formal-verification-impossibility-makes-inference-vulnerability-unresolvable — The inference information architecture's joint vulnerability — context engineering and retrieval augmentation both ceiling-limited by inference control — is formally unresolvable: the disambiguation layer where prompt injection originates is the same layer where formal verification is impossible due to NLP's AI-complete classification, placing inference security provably beyond the reach of formal methods.