Condition-number-regularized covariance estimation
- Authors
- Won, Joong-Ho; Lim, Johan; Kim, Seung-Jean; Rajaratnam, Bala
- Issue Date
- 2013
- Publisher
- WILEY
- Keywords
- Condition number; Convex optimization; Covariance estimation; Cross-validation; Eigenvalue; Portfolio optimization; Regularization; Risk comparisons; Shrinkage
- Citation
- JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, v.75, no.3, pp.427 - 450
- Indexed
- SCIE
SCOPUS
- Journal Title
- JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY
- Volume
- 75
- Number
- 3
- Start Page
- 427
- End Page
- 450
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/106455
- DOI
- 10.1111/j.1467-9868.2012.01049.x
- ISSN
- 1369-7412
- Abstract
- Estimation of high dimensional covariance matrices is known to be a difficult problem, has many applications and is of current interest to the larger statistics community. In many applications including the so-called large p, small n' setting, the estimate of the covariance matrix is required to be not only invertible but also well conditioned. Although many regularization schemes attempt to do this, none of them address the ill conditioning problem directly. We propose a maximum likelihood approach, with the direct goal of obtaining a well-conditioned estimator. No sparsity assumptions on either the covariance matrix or its inverse are imposed, thus making our procedure more widely applicable. We demonstrate that the proposed regularization scheme is computationally efficient, yields a type of Steinian shrinkage estimator and has a natural Bayesian interpretation. We investigate the theoretical properties of the regularized covariance estimator comprehensively, including its regularization path, and proceed to develop an approach that adaptively determines the level of regularization that is required. Finally, we demonstrate the performance of the regularized estimator in decision theoretic comparisons and in the financial portfolio optimization setting. The approach proposed has desirable properties and can serve as a competitive procedure, especially when the sample size is small and when a well-conditioned estimator is required.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Industrial and Management Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.