barzilai-borwein-adaptive-step-size

IN premise — entries/2026/06/21/wiki-Gradient_descent-chunk-2.md

Created 2026-06-21T09:55:50+00:00

The Barzilai-Borwein method computes an adaptive step size using consecutive gradient differences: η_n = |(x_n - x_{n-1})^T[∇f(x_n) - ∇f(x_{n-1})]| / ‖∇f(x_n) - ∇f(x_{n-1})‖², requiring no line search