Optimization Online


A Pure L1-norm Principal Component Analysis

J.P. Brooks (jpbrooks***at***vcu.edu)
J.H. Dula (jdula***at***vcu.edu)
E.L. Boone (elboone***at***vcu.edu)

Abstract: The L1 norm has been applied in numerous variations of principal component analysis (PCA). L1-norm PCA is an attractive alternative to traditional L2-based PCA because it can impart robustness in the presence of outliers and is indicated for models where standard Gaussian assumptions about the noise may not apply. Of all the previously-proposed PCA schemes that recast PCA as an optimization problem involving the L1 norm, none provide globally optimal solutions in polynomial time. This paper proposes an L1-norm PCA procedure based on the efficient calculation of the optimal solution of the L1-norm best-fit hyperplane problem. We present a procedure called L1-PCA* based on the application of this idea that fits data to hyperplanes of successively smaller dimension. The procedure is implemented and tested on a diverse problem suite. Our tests show that L1-PCA* is the indicated procedure in the presence of unbalanced outlier contamination.

Keywords: principal component analysis, linear programming, L1 regression

Category 1: Applications -- Science and Engineering (Data-Mining )

Category 2: Linear, Cone and Semidefinite Programming (Linear Programming )

Citation: Computational Statistics and Data Analysis, 61: 83-98, 2013. http://dx.doi.org/10.1016/j.csda.2012.11.007


Entry Submitted: 01/05/2010
Entry Accepted: 01/05/2010
Entry Last Modified: 03/15/2013

Modify/Update this entry

  Visitors Authors More about us Links
  Subscribe, Unsubscribe
Digest Archive
Search, Browse the Repository


Coordinator's Board
Classification Scheme
Give us feedback
Optimization Journals, Sites, Societies
Mathematical Optimization Society