Record Details

The BACON Approach for Rank-Deficient Data

Pakistan Journal of Statistics and Operation Research

View Archive Info
Field Value
Title The BACON Approach for Rank-Deficient Data
Creator Kondylis, Athanassios; Philip Morris International
R&D, Neuchatel, Switzerland
Hadi, Ali S.; Department of Mathematics and Actuarial Science
The American University in Cairo, Egypt, and
Department of Statistical Sciences, Cornell University, USA.
Werner, Mark; Department of Statistics
University of Georgia, USA.
Subject Statistics
High-dimensional data, Mahalanobis distance, Outlier detection, Spatial median.

Description Rank-deficient data are not uncommon in practice. They result from highly collinear variables and/or high-dimensional data. A special case of the latter occurs when the number of recorded variables exceeds the number of observations. The use of the BACON algorithm for outlier detection in multivariate data is extended here to include rank-deficient data. We present two approaches to identifying outliers in rank-deficient data based on the original BACON algorithm. The first algorithm projects the data onto a robust subspace of reduced dimension, while the second employs a ridge type regularization on the covariance matrix. Both algorithms are tested on real as well as simulated data sets with good results in terms of their effectiveness in outlier detection. They are also examined in terms of computational efficiency and found to be very fast, with particularly good scaling properties for increasing dimension.
Publisher College of Statistical and Actuarial Sciences
Date 2012-07-01
Type info:eu-repo/semantics/article
Peer-reviewed Article
Format application/pdf
Source Pakistan Journal of Statistics and Operation Research; Vol 8. No. 3, 2012; 359-379
Language eng