Model-free POMDP optimisation of tutoring systems with echo-state networks

Lucie Daubigney 1, 2 Matthieu Geist 3 Olivier Pietquin 2
1 MAIA - Autonomous intelligent machine
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
2 IMS - Equipe Information, Multimodalité et Signal
UMI2958 - Georgia Tech - CNRS [Metz], SUPELEC-Campus Metz
Abstract : Intelligent Tutoring Systems (ITSs) are now recognised as an interesting alternative for providing learning opportunities in various domains. The Reinforcement Learning (RL) approach has been shown reliable for finding efficient teaching strategies. However, similarly to other human-machine interaction systems such as spoken dialogue systems, ITSs suffer from a partial knowledge of the interlocutor's intentions. In the dialogue case, engineering work can infer a precise state of the user by taking into account the uncertainty provided by the spoken understanding language module. A model-free approach based on RL and Echo State Newtorks (ESNs), which retrieves similar information, is proposed here for tutoring.
Document type :
Conference papers
Complete list of metadatas

https://hal-supelec.archives-ouvertes.fr/hal-00869773
Contributor : Sébastien van Luchene <>
Submitted on : Friday, October 4, 2013 - 10:13:40 AM
Last modification on : Wednesday, July 31, 2019 - 4:18:03 PM

Identifiers

  • HAL Id : hal-00869773, version 1

Citation

Lucie Daubigney, Matthieu Geist, Olivier Pietquin. Model-free POMDP optimisation of tutoring systems with echo-state networks. SIGDial 2013, Aug 2013, Metz, France. pp.102-106. ⟨hal-00869773⟩

Share

Metrics

Record views

329