Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks

Lucie Daubigney 1, 2 Matthieu Geist 3 Olivier Pietquin 2
1 MAIA - Autonomous intelligent machine
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
2 IMS - Equipe Information, Multimodalité et Signal
UMI2958 - Georgia Tech - CNRS [Metz], SUPELEC-Campus Metz
Abstract : Modelling time series is quite a difficult task. The last recent years, reservoir computing approaches have been proven very efficient for such problems. Indeed, thanks to recurrence in the connections between neurons, this approach is a powerful tool to catch and model time dependencies between samples. Yet, the prediction quality often depends on the trade-off between the number of neurons in the reservoir and the amount of training data. Supposedly, the larger the number of neurons, the richer the reservoir of dynamics. However, the risk of overfitting problem appears. Conversely, the lower the number of neurons is, the lower the risk of overfitting problem is but also the poorer the reservoir of dynamics is. We consider here the combination of an echo state network with a projection method to benefit from the advantages of the reservoir computing approach without needing to pay attention to overfitting problems due to a lack of training data.
Type de document :
Communication dans un congrès
ICASSP 2013, May 2013, Vancouver, Canada. ICASSP 2013, pp.3253-3257, 2013, 〈10.1109/ICASSP.2013.6638259〉
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal-supelec.archives-ouvertes.fr/hal-00869814
Contributeur : Sébastien Van Luchene <>
Soumis le : lundi 6 novembre 2017 - 17:46:50
Dernière modification le : lundi 23 avril 2018 - 14:35:34

Fichier

rp_esn.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Lucie Daubigney, Matthieu Geist, Olivier Pietquin. Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks. ICASSP 2013, May 2013, Vancouver, Canada. ICASSP 2013, pp.3253-3257, 2013, 〈10.1109/ICASSP.2013.6638259〉. 〈hal-00869814〉

Partager

Métriques

Consultations de la notice

432

Téléchargements de fichiers

31