park-2024-shuffled-baseline-collapses-orthogonality
IN premise — summaries/2026/08/24/park-2024-categorical-hierarchical-concepts-sR-references-chunk-2.md
Created 2026-08-25T02:58:26+00:00
When WordNet parent/child assignments are randomly shuffled in the unembedding, the predicted orthogonality structure collapses (cosine similarity departs from zero).
Summary
The specific parent-child pairings in WordNet are doing real structural work in the embedding space: scramble them and dimensions that should be independent start leaking into each other. This means the system's representational integrity depends on getting those hierarchical relationships correctly assigned, not just on having some word associations present at all.
Dependents
These beliefs depend on this one:
- OUT hierarchical-orthogonality-genuine-structure — The observed parent⊥(child−parent) orthogonality in LLM representation spaces reflects genuine hierarchical semantics rather than a trivial set-inclusion artifact.