Inflated prediction accuracy of neuropsychiatric biomarkers caused by data leakage in feature selection
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Shim, Miseon | - |
dc.contributor.author | Lee, Seung-Hwan | - |
dc.contributor.author | Hwang, Han-Jeong | - |
dc.date.accessioned | 2021-11-21T15:40:16Z | - |
dc.date.available | 2021-11-21T15:40:16Z | - |
dc.date.created | 2021-08-30 | - |
dc.date.issued | 2021-04-12 | - |
dc.identifier.issn | 2045-2322 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/128248 | - |
dc.description.abstract | In recent years, machine learning techniques have been frequently applied to uncovering neuropsychiatric biomarkers with the aim of accurately diagnosing neuropsychiatric diseases and predicting treatment prognosis. However, many studies did not perform cross validation (CV) when using machine learning techniques, or others performed CV in an incorrect manner, leading to significantly biased results due to overfitting problem. The aim of this study is to investigate the impact of CV on the prediction performance of neuropsychiatric biomarkers, in particular, for feature selection performed with high-dimensional features. To this end, we evaluated prediction performances using both simulation data and actual electroencephalography (EEG) data. The overall prediction accuracies of the feature selection method performed outside of CV were considerably higher than those of the feature selection method performed within CV for both the simulation and actual EEG data. The differences between the prediction accuracies of the two feature selection approaches can be thought of as the amount of overfitting due to selection bias. Our results indicate the importance of correctly using CV to avoid biased results of prediction performance of neuropsychiatric biomarkers. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | NATURE RESEARCH | - |
dc.subject | EEG | - |
dc.subject | BIAS | - |
dc.title | Inflated prediction accuracy of neuropsychiatric biomarkers caused by data leakage in feature selection | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Hwang, Han-Jeong | - |
dc.identifier.doi | 10.1038/s41598-021-87157-3 | - |
dc.identifier.scopusid | 2-s2.0-85104272592 | - |
dc.identifier.wosid | 000640434400113 | - |
dc.identifier.bibliographicCitation | SCIENTIFIC REPORTS, v.11, no.1 | - |
dc.relation.isPartOf | SCIENTIFIC REPORTS | - |
dc.citation.title | SCIENTIFIC REPORTS | - |
dc.citation.volume | 11 | - |
dc.citation.number | 1 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Science & Technology - Other Topics | - |
dc.relation.journalWebOfScienceCategory | Multidisciplinary Sciences | - |
dc.subject.keywordPlus | EEG | - |
dc.subject.keywordPlus | BIAS | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.