Robustness of model averaging methods for the violation of standard linear regression assumptions
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, Yongsu | - |
dc.contributor.author | Song, Juwon | - |
dc.date.accessioned | 2021-11-23T22:40:23Z | - |
dc.date.available | 2021-11-23T22:40:23Z | - |
dc.date.created | 2021-08-30 | - |
dc.date.issued | 2021-03 | - |
dc.identifier.issn | 2287-7843 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/128524 | - |
dc.description.abstract | In a regression analysis, a single best model is usually selected among several candidate models. However, it is often useful to combine several candidate models to achieve better performance, especially, in the prediction viewpoint. Model combining methods such as stacking and Bayesian model averaging (BMA) have been suggested from the perspective of averaging candidate models. When the candidate models include a true model, it is expected that BMA generally gives better performance than stacking. On the other hand, when candidate models do not include the true model, it is known that stacking outperforms BMA. Since stacking and BMA approaches have different properties, it is difficult to determine which method is more appropriate under other situations. In particular, it is not easy to find research papers that compare stacking and BMA when regression model assumptions are violated. Therefore, in the paper, we compare the performance among model averaging methods as well as a single best model in the linear regression analysis when standard linear regression assumptions are violated. Simulations were conducted to compare model averaging methods with the linear regression when data include outliers and data do not include them. We also compared them when data include errors from a non-normal distribution. The model averaging methods were applied to the water pollution data, which have a strong multicollinearity among variables. Simulation studies showed that the stacking method tends to give better performance than BMA or standard linear regression analysis (including the stepwise selection method) in the sense of risks (see (3.1)) or prediction error (see (3.2)) when typical linear regression assumptions are violated. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | KOREAN STATISTICAL SOC | - |
dc.title | Robustness of model averaging methods for the violation of standard linear regression assumptions | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Song, Juwon | - |
dc.identifier.doi | 10.29220/CSAM.2021.28.2.189 | - |
dc.identifier.scopusid | 2-s2.0-85104713304 | - |
dc.identifier.wosid | 000638254500007 | - |
dc.identifier.bibliographicCitation | COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, v.28, no.2, pp.189 - 204 | - |
dc.relation.isPartOf | COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS | - |
dc.citation.title | COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS | - |
dc.citation.volume | 28 | - |
dc.citation.number | 2 | - |
dc.citation.startPage | 189 | - |
dc.citation.endPage | 204 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.identifier.kciid | ART002704475 | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scopus | - |
dc.description.journalRegisteredClass | kci | - |
dc.description.journalRegisteredClass | other | - |
dc.relation.journalResearchArea | Mathematics | - |
dc.relation.journalWebOfScienceCategory | Statistics & Probability | - |
dc.subject.keywordAuthor | model averaging | - |
dc.subject.keywordAuthor | stacking regression | - |
dc.subject.keywordAuthor | Bayesian model averaging | - |
dc.subject.keywordAuthor | outliers | - |
dc.subject.keywordAuthor | misspecified distribution | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
145 Anam-ro, Seongbuk-gu, Seoul, 02841, Korea+82-2-3290-2963
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.