AdaBoost is Consistent

Peter L. Bartlett, Mikhail Traskin.

Year: 2007, Volume: 8, Issue: 78, Pages: 2347−2368


The risk, or probability of error, of the classifier produced by the AdaBoost algorithm is investigated. In particular, we consider the stopping strategy to be used in AdaBoost to achieve universal consistency. We show that provided AdaBoost is stopped after n1-ε iterations---for sample size n and ε ∈ (0,1)---the sequence of risks of the classifiers it produces approaches the Bayes risk.