relu-introduced-1969-fukushima

OUT premise — entries/2026/06/21/wiki-Neural_network_28machine_learning29-chunk-2.md

Created 2026-06-21T09:55:51+00:00

The ReLU activation function was introduced by Kunihiko Fukushima in 1969 and became the most common activation function in modern deep learning