Skip to Main content Skip to Navigation
Conference papers

Reinforcement learning application scenario for Opportunistic Spectrum Access

Abstract : We tackle in this work a concrete scenario that illustrates the behavior of Cognitive Radio equipment within an Opportunistic Spectrum Access context. We assume that there exist two sets of users. On the one hand Primary Users who own the spectrum pool of interest. And one the other hand, Secondary Users who aim at exploiting vacant communication opportunities left by Primary Users at a given time in a given band. Moreover, Secondary Users are assumed to have no a priori knowledge on Primary Users behavior and aim at learning missing information while exploiting found communication opportunities. For that purpose, we model Primary Users' frequency bands occupations pattern using an OFDM modulation. While, the introduced secondary user's learning process relies on an energy detector and a reinforcement learning algorithm known as UCB1. The complete model is developed on Simulink to illustrate the behavior of the Primary Network as well as the Secondary User.
Document type :
Conference papers
Complete list of metadata
Contributor : Myriam Andrieux Connect in order to contact the contributor
Submitted on : Wednesday, July 6, 2011 - 1:35:20 PM
Last modification on : Friday, January 8, 2021 - 3:42:41 AM


  • HAL Id : hal-00606399, version 1


Wassim Jouini, Robin Bollenbach, Matthieu Guillet, Christophe Moy, Amor Nafkha. Reinforcement learning application scenario for Opportunistic Spectrum Access. 54th IEEE International Midwest Symposium on Circuits & Systems (MWSCAS 2011), Aug 2011, Seoul, North Korea. ⟨hal-00606399⟩



Les métriques sont temporairement indisponibles