Tuning Random Forests

Random forest and the bias-variance tradeoff

The random forest algorithm was designed to address aspects of the bias-variance tradeoff without directly tuning the hyperparameters. This differentiates the random forest algorithm from algorithms like CART decision trees and boosted decision trees (e.g., XGBoost). The following illustration maps the random forest algorithm’s design to the bias-variance tradeoff.