activation-jacobian-is-diagonal

IN premise — entries/2026/06/21/wiki-Backpropagation-chunk-6.md

Created 2026-06-21T09:55:49+00:00

Element-wise activation functions have a diagonal Jacobian matrix, which can be equivalently computed as a Hadamard (element-wise) product with the vector of per-node derivatives.