Stochastic Modeling by Inhomogeneous Continuous Time Markov Chains

Abstract : Homogeneous continuous time Markov chain (HCTMC), with the assumption of time-independent constant transition rates, is one of the most frequent applied methods for stochastic modeling. In realistic situations, with varying external factors influencing the transition processes, the transition rates can no longer be considered time-independent. Under these circumstances, the inhomogeneous CTMC (ICTMC) is more suited for modeling the stochastic processes. One drawback of ICTMC is that an analytical solution is difficult, if not impossible, to obtain. Then, one must resort to numerical approaches e.g. Monte Carlo simulation, uniformization, state-space enrichment, and numerical differential equation solvers. This presentation aims at comparing the methods, making reference to a simple but challenging case study.
Complete list of metadatas

https://hal-supelec.archives-ouvertes.fr/hal-00737094
Contributor : Yanfu Li <>
Submitted on : Monday, October 1, 2012 - 11:49:25 AM
Last modification on : Tuesday, May 8, 2018 - 10:30:14 AM
Long-term archiving on : Wednesday, January 2, 2013 - 5:05:45 AM

File

EURO-workshop.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00737094, version 1

Citation

Yan-Fu Li, Yan-Hui Lin, Enrico Zio. Stochastic Modeling by Inhomogeneous Continuous Time Markov Chains. EURO Workshop on Stochastic Modelling, May 2012, France. ⟨hal-00737094⟩

Share

Metrics

Record views

882

Files downloads

181