A New Class of Stochastic EM Algorithms. Escaping Local Maxima and Handling Intractable Sampling - Centre de mathématiques appliquées (CMAP) Accéder directement au contenu
Article Dans Une Revue Computational Statistics and Data Analysis Année : 2021

A New Class of Stochastic EM Algorithms. Escaping Local Maxima and Handling Intractable Sampling

Résumé

The expectation-maximization (EM) algorithm is a powerful computational technique for maximum likelihood estimation in incomplete data models. When the expectation step cannot be performed in closed form, a stochastic approximation of EM (SAEM) can be used. The convergence of the SAEM toward critical points of the observed likelihood has been proved and its numerical efficiency has been demonstrated. However, sampling from the posterior distribution may be intractable or have a high computational cost. Moreover, despite appealing features, the limit position of this algorithm can strongly depend on its starting one. To cope with this two issues, we propose here a new stochastic approximation version of the EM in which we do not sample from the exact distribution in the expectation phase of the procedure. We first prove the convergence of this algorithm toward critical points of the observed likelihood. Then, we propose an instantiation of this general procedure to favor convergence toward global maxima. Experiments on synthetic and real data highlight the performance of this algorithm in comparison to the SAEM and the EM when feasible.
Fichier principal
Vignette du fichier
2020_AllassonniereChevallier.pdf (27.84 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02044722 , version 1 (21-02-2019)
hal-02044722 , version 2 (26-02-2019)
hal-02044722 , version 3 (18-06-2019)
hal-02044722 , version 4 (23-04-2020)

Identifiants

Citer

Stéphanie Allassonnière, Juliette Chevallier. A New Class of Stochastic EM Algorithms. Escaping Local Maxima and Handling Intractable Sampling. Computational Statistics and Data Analysis, 2021, 159, pp.107159. ⟨10.1016/j.csda.2020.107159⟩. ⟨hal-02044722v4⟩
1079 Consultations
710 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More