Factor Analysis and extensions

Many subspace-based array signal processing algorithms assume that the noise is spatially white. In this case the noise covariance matrix is a multiple of the identity and the eigenvectors of the data covariance matrix are not affected by the noise. If the noise covariance is an unknown arbitrary diagonal (e.g., for an uncalibrated array), the eigenvalue decomposition leads to incorrect subspace estimates and it has to be replaced by a more general “Factor Analysis” decomposition (FA), which then reveals all relevant information.

We consider this data model and several extensions where the noise covariance matrix has a more general structure, such as banded, sparse, block-diagonal, and cases where we have multiple data covariance matrices that share the same noise covariance matrix. Starting from a nonlinear weighted least squares formulation, we propose new estimation algorithms for both classical FA and its extensions. The optimization is based on Gauss-Newton gradient descent. Generally, this leads to an iteration involving the inversion of a very large matrix. Using the structure of the problem, we show how this can be reduced to the inversion of a matrix with dimension equal to the number of unknown noise covariance parameters.

This results in new algorithms that have faster numerical convergence and lower complexity compared to several maximum-likelihood based algorithms that could be considered state-of-the-art. The new algorithms scale well to large dimensions and can replace eigenvalue decompositions in many applications even if the noise can be assumed to be white.

The attached matlab code was used to generate the figures in the paper. It also contains some alternative algorithms that were used in its comparison

Related publications

1. Complex Factor Analysis and Extensions
   A.M. Sardarabadi; A.J. van der Veen;
   IEEE Tr. Signal Processing,
   Volume 66, Issue 4, February 2018. DOI: 10.1109/TSP.2017.2780047
   document