Mean Field ICA  Kaare Brandt Petersen
 Abstract  This thesis describes investigations and improvements of a technique for Independent Component Analysis (ICA), called "Mean Field ICA".
The main focus of the thesis is the optimization part of the algorithm, the socalled "EM algorithm". Using different approaches it is demonstrated that the EM algorithm is inefficient and therefore an improper choice for a certain class of models. As an alternative, the socalled "Easy Gradient Algorithm" is presented, which makes it possible to apply advanced optimization techniques using the computationally simple Estep and Mstep of the EM algorithm. The Easy Gradient Recipe is applicable to a wide selection of models. Furthermore, the Mean Field ICA model is extended to incorporate ltering over time in a socalled "convolutive ICA" model.
Finally, by using mixture of Gaussians as source priors, the generative and ltering approach to ICA is compared in the overcomplete setting, i.e. the situation in which there is more sources than sensors.  Type  Ph.D. thesis [Academic thesis]  Year  2005  Publisher  Informatics and Mathematical Modelling, Technical University of Denmark, DTU  Address  Richard Petersens Plads, Building 321, DK2800 Kgs. Lyngby  Series  IMMPHD2005148  Note  Supervised by Ole Winther, IMM.  Electronic version(s)  [ps]  BibTeX data  [bibtex]  IMM Group(s)  Intelligent Signal Processing 
