다중선형회귀모형에서의 변수선택기법 평가Evaluating Variable Selection Techniques for Multivariate Linear Regression
- Other Titles
- Evaluating Variable Selection Techniques for Multivariate Linear Regression
- Authors
- 류나현; 김형석; 강필성
- Issue Date
- 2016
- Publisher
- 대한산업공학회
- Keywords
- Forward Selection; Backward Elimination; Stepwise Selection; Genetic Algorithm; Ridge Regression; Lasso; Elastic Net
- Citation
- 대한산업공학회지, v.42, no.5, pp.314 - 326
- Indexed
- KCI
- Journal Title
- 대한산업공학회지
- Volume
- 42
- Number
- 5
- Start Page
- 314
- End Page
- 326
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/90665
- DOI
- 10.7232/JKIIE.2016.42.5.314
- ISSN
- 1225-0988
- Abstract
- The purpose of variable selection techniques is to select a subset of relevant variables for a particular learning algorithm in order to improve the accuracy of prediction model and improve the efficiency of the model. We conduct an empirical analysis to evaluate and compare seven well-known variable selection techniques for multiple linear regression model, which is one of the most commonly used regression model in practice. The variable selection techniques we apply are forward selection, backward elimination, stepwise selection, genetic algorithm (GA), ridge regression, lasso (Least Absolute Shrinkage and Selection Operator) and elastic net. Basedon the experiment with 49 regression data sets, it is found that GA resulted in the lowest error rates while lasso most significantly reduces the number of variables. In terms of computational efficiency, forward/backward elimination and lasso requires less time than the other techniques.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Industrial and Management Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.