SSP'05 -- Proceedings

	IEEE/SP 13th workshop on Statistical Signal Processing July, 17-20, 2005 - Bordeaux - France

Information regarding the paper

Title

Convex surrogates and stable message-passing: Joint parameter estimation and prediction in coupled Gaussian mixture models

Author(s)

Martin Wainwright

UC Berkeley, Department of EECS and Department of Statistics

Get the paper in PDF format

To obtain Acrobat Reader (version 5 minimum required) necessary to his read.

Abstract

The coupled mixture of Gaussian (MoG) model is a graphical model useful for various applications in signal processing. The parameter estimation and prediction problems, though tractable for tree-structured graphs, are intractable when the local mixture models are coupled together with a more complex graph with cycles. We present a joint approach to parameter estimation and prediction/smoothing problems in a coupled MoG model for an arbitrary graph with cycles. Our method exploits a convex surrogate to the cumulant generating function, for which both the parameter estimation and prediction steps can be solved efficiently by a tree-reweighted sum-product algorithm. We prove that our methods are globally Lipschitz stable, and provide bounds on the increase in MSE relative to the (unattainable) Bayes optimum. We also present the results of experimental simulations that both confirm these theoretical results, and show that our method outperforms the analogous method based on the ordinary sum-product algorithm.