gd-first-order-method-taxonomy

IN premise — entries/2026/06/21/wiki-Gradient_descent-chunk-6.md

Created 2026-06-21T09:55:50+00:00

Optimization methods are taxonomized as function-based (no gradient, e.g. Nelder-Mead), gradient-based/first-order (e.g. gradient descent), and Hessian-based/second-order (e.g. Newton's method)