craft-architectural-convergence-guarantees-behavioral-stability

OUT derived (depth 10)

Created 2026-06-21T13:06:41+00:00

The craft discipline's empirical methodology — producing convergent architectural choices across independent research groups (SwiGLU, RoPE, RMSNorm adopted by Llama, PaLM, and others via craft-by-assembly) combined with innovation transcending organizational boundaries — guarantees behaviorally stable architectures through empirical selection pressure.

Justifications

SL — Craft convergence on architecture WOULD guarantee behavioral stability IF implementation details were not critical — but dozens of engineering details dominating outcomes means identical architectures can produce wildly different behaviors

Antecedents (all must be IN):

  • IN llama-exemplifies-craft-discipline-architecture-by-assembly — Llama's architecture-by-assembly strategy — adopting proven refinements (SwiGLU, RoPE, RMSNorm) from independent prior research while focusing effort on data scaling — exemplifies the craft discipline's empirical epistemology: rather than innovating architecturally, Meta assembled the best empirically validated components and invested in the scaling lever the field had empirically identified as dominant.
  • IN innovation-transcends-organizational-and-disciplinary-boundaries — The NLP revolution's most transformative contributions defy institutional ownership at two levels: organizationally, Google's inventions (Transformer, BERT, CoT) became the universal foundation powering every competitor; disciplinarily, techniques imported from robotics (RLHF), machine translation (attention), and compression theory (scaling validation) proved more impactful than NLP-native innovations.

Unless (any of these IN defeats this justification):

  • IN rlhf-implementation-details-critical — Naive PPO implementations fail in RLHF; dozens of engineering details including reward normalization, KL penalty tuning, advantage estimation (GAE), learning rate schedules, and batch size significantly affect training stability and performance.