Search

MiS Preprint Repository

We have decided to discontinue the publication of preprints on our preprint server as of 1 March 2024. The publication culture within mathematics has changed so much due to the rise of repositories such as ArXiV (www.arxiv.org) that we are encouraging all institute members to make their preprints available there. An institute's repository in its previous form is, therefore, unnecessary. The preprints published to date will remain available here, but we will not add any new preprints here.

MiS Preprint
7/2010

An experimental evaluation of boosting methods for classification

Rainer Stollhoff, Willi Sauerbrei and Martin Schumacher

Abstract

Objectives:
In clinical medicine, the accuracy achieved by classification rules is often not sufficient to justify their use in daily practice. In order to improve classifiers it has become popular to combine single classification rules into a classification ensemble. Two popular boosting methods will be compared with classical statistical approaches.

Methods:
Using data from a clinical study on the diagnosis of breast tumors and by simulation we will compare AdaBoost with gradient boosting ensembles of regression trees. We will also consider a tree approach and logistic regression as traditional competitors. In logistic regression we allow to select non-linear effects by the fractional polynomial approach. Performance of the classifiers will be assessed by estimated misclassification rates and the Brier score.

Results:
We will show that boosting of simple base classifiers gives classification rules with improved predictive ability. However, the performance of boosting classifiers was not generally superior to the performance of logistic regression. In contrast to the computer intensive methods the latter are based on classifiers which are much easier to interpret and to use.

Conclusions:
In medical applications, the logistic regression model remains a method of choice or, at least, a serious competitor of more sophisticated techniques. Refinement of boosting methods by using optimized number of boosting steps may lead to further improvement.

Received:
Feb 10, 2010
Published:
Feb 12, 2010
Keywords:
Classification, boosting, simulation study, generalized additive models, diagnosis of breast tumors

Related publications

inJournal
2010 Repository Open Access
Rainer Stollhoff, Willi Sauerbrei and Martin Schumacher

An experimental evaluation of boosting methods for classification

In: Methods of information in medicine, 49 (2010) 3, pp. 219-229