random-forest-reduces-variance-not-bias

IN premise — entries/2026/06/21/wiki-Random_forest-chunk-1.md

Created 2026-06-21T09:55:51+00:00

Random forests reduce variance (not bias) compared to individual decision trees by averaging many decorrelated trees.

Dependents

These beliefs depend on this one:

• IN ensemble-methods-decompose-bias-variance-independently — Ensemble methods provide complementary and independent controls over the two components of prediction error: bagging (random forests) reduces variance by averaging decorrelated models, while boosting reduces bias by iteratively correcting residuals — together enabling targeted error reduction.
• IN random-forest-robust-generalization — Random forests achieve robust generalization through three complementary mechanisms: variance reduction via averaging decorrelated trees, immunity to overfitting from additional trees, and built-in OOB error estimation without a separate test set.
• OUT rf-universally-applicable-ensemble — Random forests are universally applicable ensemble methods — no overfitting from added trees, built-in OOB validation, and robust variance reduction make them a safe default for any problem.