relu-introduced-fukushima-1969

IN premise — entries/2026/06/21/wiki-Convolutional_neural_network-chunk-2.md

Created 2026-06-21T09:55:49+00:00

The ReLU activation function was first introduced by Fukushima in 1969, though it was not used in the neocognitron itself