Joint Estimation of Multiple Precision Matrices with Common Structures.

TitleJoint Estimation of Multiple Precision Matrices with Common Structures.
Publication TypeJournal Article
Year of Publication2015
AuthorsLee, Wonyul, and Yufeng Liu
JournalJ Mach Learn Res
Volume16
Pagination1035-1062
Date Published2015
ISSN1532-4435
Abstract

Estimation of inverse covariance matrices, known as precision matrices, is important in various areas of statistical analysis. In this article, we consider estimation of multiple precision matrices sharing some common structures. In this setting, estimating each precision matrix separately can be suboptimal as it ignores potential common structures. This article proposes a new approach to parameterize each precision matrix as a sum of common and unique components and estimate multiple precision matrices in a constrained minimization framework. We establish both estimation and selection consistency of the proposed estimator in the high dimensional setting. The proposed estimator achieves a faster convergence rate for the common structure in certain cases. Our numerical examples demonstrate that our new estimator can perform better than several existing methods in terms of the entropy loss and Frobenius loss. An application to a glioblastoma cancer data set reveals some interesting gene networks across multiple cancer subtypes.

Alternate JournalJ Mach Learn Res
Original PublicationJoint estimation of multiple precision matrices with common structures.
PubMed ID26568704
PubMed Central IDPMC4643293
Grant ListP01 CA142538 / CA / NCI NIH HHS / United States
R01 CA149569 / CA / NCI NIH HHS / United States
Project: