The effect of rebalancing on LDA in imbalanced classification
- Authors
- Kim, Arlene K. H.; Chung, Hyunwoo
- Issue Date
- 12월-2021
- Publisher
- WILEY
- Keywords
- F-1 score; LDA; MCC; Rebalancing; class imbalance; optimal rebalancing rate
- Citation
- STAT, v.10, no.1
- Indexed
- SCIE
SCOPUS
- Journal Title
- STAT
- Volume
- 10
- Number
- 1
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/135512
- DOI
- 10.1002/sta4.384
- ISSN
- 2049-1573
- Abstract
- In binary classification, class imbalance is undesirable in that it may worsen the performance of a classifier. One of the remedies to handle this problem is rebalancing with the optimal rate. Theoretical derivation of the rate is not usually considered and often empirically detected, because it is complex and depends on the classifier. To simplify this, we used a linear discriminant classifier, deriving the theoretical optimal rate that maximizes the Matthews Correlation Coefficient (MCC) and F-1 score assuming normality. We showed that adjusting the size of each class to be equal is not always the best solution. Instead, we found that there exists the optimal rate depending on the level of class imbalance and the Mahalanobis distance between two classes. Conducting extensive simulation studies and real data analyses, we confirmed that rebalancing with the optimal rate improves the test MCC and F-1 score. These findings suggest that with a careful consideration on the level of class imbalance and the separability between two classes, we can achieve better classification results in presence of class imbalance.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Political Science & Economics > Department of Statistics > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.