Abstract

Bagging is an important technique for stabilizing machine learning models. Inthis paper, we derive a finite-sample guarantee on the stability of bagging forany model. Our result places no assumptions on the distribution of the data, onthe properties of the base algorithm, or on the dimensionality of thecovariates. Our guarantee applies to many variants of bagging and is optimal upto a constant. Empirical results validate our findings, showing that baggingsuccessfully stabilizes even highly unstable base algorithms.

 

Quick Read (beta)