Bayesian optimization for parameter identification on a small simulation budget

Abstract : Bayesian optimization uses a probabilistic model of the objective function to guide the search for the optimum. It is particularly interesting for the optimization of expensive-to-evaluate functions. For the last decade, it has been increasingly used for industrial optimization problems and especially for numerical design involving complex computer simulations. We feel that Bayesian optimization should be considered with attention by anyone who has to identify the parameters of a model based on a very limited number of model simulations because of model complexity. In this paper, we wish to describe, as simply as possible, how Bayesian optimization can be used in parameter identification and to present a new application. We concentrate on two algorithms, namely EGO (for Efficient Global Optimization) and IAGO (for Informational Approach to Global Optimization), and describe how they can be used for parameter identification when the budget for evaluating the cost function is severely limited. Some open questions that must be addressed for theoretical and practical reasons are indicated.
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal-supelec.archives-ouvertes.fr/hal-00368152
Contributor : Emmanuel Vazquez <>
Submitted on : Friday, March 13, 2009 - 4:53:29 PM
Last modification on : Thursday, April 5, 2018 - 12:30:04 PM
Long-term archiving on : Tuesday, June 8, 2010 - 8:24:55 PM

File

paper_version_finale.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00368152, version 1

Collections

Citation

Julien Villemonteix, Emmanuel Vazquez, Eric Walter. Bayesian optimization for parameter identification on a small simulation budget. 15th IFAC Symposium on System Identification, SYSID 2009, Jul 2009, Saint-Malo, France. 6 p. ⟨hal-00368152⟩

Share

Metrics

Record views

403

Files downloads

459