any-positive-inner-product-direction-is-descent
IN premise — entries/2026/06/21/wiki-Gradient_descent-chunk-2.md
Created 2026-06-21T09:55:50+00:00
Any direction with positive inner product with the negative gradient is a valid descent direction (not just the gradient itself), provided the step size is sufficiently small