A finite-sample simulation study of cross validation in tree-based models
- Authors
- Kim, Seoung Bum; Huo, Xiaoming; Tsui, Kwok-Leung
- Issue Date
- 12월-2009
- Publisher
- SPRINGER
- Keywords
- Cross validation; Bayes classifier; Trees-based models
- Citation
- INFORMATION TECHNOLOGY & MANAGEMENT, v.10, no.4, pp.223 - 233
- Indexed
- SCIE
SCOPUS
- Journal Title
- INFORMATION TECHNOLOGY & MANAGEMENT
- Volume
- 10
- Number
- 4
- Start Page
- 223
- End Page
- 233
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/118878
- DOI
- 10.1007/s10799-009-0052-7
- ISSN
- 1385-951X
- Abstract
- Cross validation (CV) has been widely used for choosing and evaluating statistical models. The main purpose of this study is to explore the behavior of CV in tree-based models. We achieve this goal by an experimental approach, which compares a cross-validated tree classifier with the Bayes classifier that is ideal for the underlying distribution. The main observation of this study is that the difference between the testing and training errors from a cross-validated tree classifier and the Bayes classifier empirically has a linear regression relation. The slope and the coefficient of determination of the regression model can serve as performance measure of a cross-validated tree classifier. Moreover, simulation reveals that the performance of a cross-validated tree classifier depends on the geometry, parameters of the underlying distributions, and sample sizes. Our study can explain, evaluate, and justify the use of CV in tree-based models when the sample size is relatively small.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Industrial and Management Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.