Mean Field ICA

Kaare Brandt Petersen

AbstractThis thesis describes investigations and improvements of a technique for Independent Component Analysis (ICA), called "Mean Field ICA".

The main focus of the thesis is the optimization part of the algorithm, the so-called "EM algorithm". Using different approaches it is demonstrated that the EM algorithm is inefficient and therefore an improper choice for a certain class of models. As an alternative, the so-called "Easy Gradient Algorithm" is presented, which makes it possible to apply advanced optimization techniques using the computationally simple E-step and M-step of the EM algorithm. The Easy Gradient Recipe is applicable to a wide selection of models. Furthermore, the Mean Field ICA model is extended to incorporate ltering over time in a so-called "convolutive ICA" model.

Finally, by using mixture of Gaussians as source priors, the generative and ltering approach to ICA is compared in the overcomplete setting, i.e. the situation in which there is more sources than sensors.
TypePh.D. thesis [Academic thesis]
PublisherInformatics and Mathematical Modelling, Technical University of Denmark, DTU
AddressRichard Petersens Plads, Building 321, DK-2800 Kgs. Lyngby
NoteSupervised by Ole Winther, IMM.
Electronic version(s)[ps]
BibTeX data [bibtex]
IMM Group(s)Intelligent Signal Processing