Comparison of Fully Bayesian and Empirical Bayes approaches for joint Bayesian model selection and estimation of sinusoids via reversible jump MCMC

Abstract : This work addresses the sensitivity of the algorithm proposed by Andrieu and Doucet (IEEE T. Signal Proces., 47(10), 1999), for the joint Bayesian model selection and estimation of sinusoids in white Gaussian noise, to the values of a certain hyperparameter claimed to be weakly influential in the original paper. On the basis of extensive numerical experiments, we argue on the contrary that the value of this hyperparameter (the scale parameter of the expected signal-to-noise ratio) has a strong influence on 1) the mixing rate of the Markov chain and 2) the posterior distribution of the number of components. Fully Bayesian and Empirical Bayes methods are proposed and compared for estimating an appropriate value for this hyperparameter. In the Fully Bayesian approach, a weakly informative proper prior is assigned over that hyperparameter. In the Empirical Bayes approach, marginal likelihood maximization is performed by means of an importance sampling-based Monte Carlo EM (MCEM) algorithm. The pros and cons of each method are discussed on the basis of numerical experiments conducted with several sample sizes and signal-to-noise ratios.
Complete list of metadatas

https://hal-supelec.archives-ouvertes.fr/hal-00482533
Contributor : Julien Bect <>
Submitted on : Monday, May 10, 2010 - 4:30:17 PM
Last modification on : Thursday, March 29, 2018 - 11:06:05 AM

Identifiers

  • HAL Id : hal-00482533, version 1

Collections

Citation

Alireza Roodaki, Julien Bect, Gilles Fleury. Comparison of Fully Bayesian and Empirical Bayes approaches for joint Bayesian model selection and estimation of sinusoids via reversible jump MCMC. International Society for Bayesian Analysis - World Meeting (ISBA'10), Jun 2010, Benidorm, Spain. ⟨hal-00482533⟩

Share

Metrics

Record views

191