The effect of rebalancing on LDA in imbalanced classification
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Arlene K. H. | - |
dc.contributor.author | Chung, Hyunwoo | - |
dc.date.accessioned | 2022-02-12T14:40:45Z | - |
dc.date.available | 2022-02-12T14:40:45Z | - |
dc.date.created | 2022-02-09 | - |
dc.date.issued | 2021-12 | - |
dc.identifier.issn | 2049-1573 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/135512 | - |
dc.description.abstract | In binary classification, class imbalance is undesirable in that it may worsen the performance of a classifier. One of the remedies to handle this problem is rebalancing with the optimal rate. Theoretical derivation of the rate is not usually considered and often empirically detected, because it is complex and depends on the classifier. To simplify this, we used a linear discriminant classifier, deriving the theoretical optimal rate that maximizes the Matthews Correlation Coefficient (MCC) and F-1 score assuming normality. We showed that adjusting the size of each class to be equal is not always the best solution. Instead, we found that there exists the optimal rate depending on the level of class imbalance and the Mahalanobis distance between two classes. Conducting extensive simulation studies and real data analyses, we confirmed that rebalancing with the optimal rate improves the test MCC and F-1 score. These findings suggest that with a careful consideration on the level of class imbalance and the separability between two classes, we can achieve better classification results in presence of class imbalance. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | WILEY | - |
dc.subject | DATA SETS | - |
dc.subject | SMOTE | - |
dc.title | The effect of rebalancing on LDA in imbalanced classification | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kim, Arlene K. H. | - |
dc.identifier.doi | 10.1002/sta4.384 | - |
dc.identifier.scopusid | 2-s2.0-85121820540 | - |
dc.identifier.wosid | 000675204100001 | - |
dc.identifier.bibliographicCitation | STAT, v.10, no.1 | - |
dc.relation.isPartOf | STAT | - |
dc.citation.title | STAT | - |
dc.citation.volume | 10 | - |
dc.citation.number | 1 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Mathematics | - |
dc.relation.journalWebOfScienceCategory | Statistics & Probability | - |
dc.subject.keywordPlus | DATA SETS | - |
dc.subject.keywordPlus | SMOTE | - |
dc.subject.keywordAuthor | F-1 score | - |
dc.subject.keywordAuthor | LDA | - |
dc.subject.keywordAuthor | MCC | - |
dc.subject.keywordAuthor | Rebalancing | - |
dc.subject.keywordAuthor | class imbalance | - |
dc.subject.keywordAuthor | optimal rebalancing rate | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
145 Anam-ro, Seongbuk-gu, Seoul, 02841, Korea+82-2-3290-2963
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.