any-positive-inner-product-direction-is-descent

IN premiseentries/2026/06/21/wiki-Gradient_descent-chunk-2.md

Created 2026-06-21T09:55:50+00:00

Any direction with positive inner product with the negative gradient is a valid descent direction (not just the gradient itself), provided the step size is sufficiently small