resnet-2015-skip-connections-degradation

IN premise — entries/2026/06/21/wiki-Deep_learning-chunk-2.md

Created 2026-06-21T09:55:50+00:00

ResNet (2015) by He et al. solved the degradation problem of very deep networks (20-30+ layers) using skip/residual connections

Dependents

These beliefs depend on this one:

• IN residual-connections-enable-arbitrary-depth — Residual connections (F(x) + x) are the key architectural innovation enabling arbitrarily deep networks — ResNet solved the degradation problem for CNNs, and the same mechanism was adopted by transformers to enable deep stacking without vanishing gradients.