steepest-descent-residuals-orthogonal

IN premise — entries/2026/06/21/wiki-Gradient_descent-chunk-3.md

Created 2026-06-21T09:55:50+00:00

In steepest descent with exact line search, consecutive residual vectors are orthogonal (⟨r_{k+1}, r_k⟩ = 0), which causes characteristic zig-zag convergence behavior