Hybrid UCB-HMM: A Machine Learning Strategy for Cognitive Radio in HF Band - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Cognitive Communications and Networking Année : 2016

Hybrid UCB-HMM: A Machine Learning Strategy for Cognitive Radio in HF Band

Résumé

Multiple users transmit in the HF band with worldwide coverage but collide with other HF users. New techniques based on cognitive radio principles are discussed to reduce the inefficient use of this band. In this paper, we show the feasibility of the Upper Confidence Bound (UCB) algorithm, based on reinforcement learning, for an opportunistic access to the HF band. The exploration vs. exploitation dilemma is evaluated in single-channel and multi-channel UCB algorithms in order to obtain their best performance in the HF environment. Furthermore, we propose a new hybrid system which combines two types of machine learning techniques based on reinforcement learning and learning with Hidden Markov Models. This system can be understood as a metacognitive engine that automatically adapts its data transmission strategy according to HF environment's behaviour to efficiently use spectrum holes. The proposed hybrid UCB-HMM system increases the duration of data transmission's slots when conditions are favourable, and is also able to reduce the required signalling transmissions between transmitter and receiver to inform which channels have been selected for data transmission. This reduction can be as high as 61% with respect to the signalling required by multi-channel UCB.
Fichier principal
Vignette du fichier
07401030.pdf (1.24 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01272872 , version 1 (11-03-2016)

Identifiants

Citer

Laura Melián-Gutiérrez, Navikkumar Modi, Christophe Moy, Faouzi Bader, Iván Pérez-´ Alvarez, et al.. Hybrid UCB-HMM: A Machine Learning Strategy for Cognitive Radio in HF Band. IEEE Transactions on Cognitive Communications and Networking, 2016, 1 (3), pp.347-358. ⟨10.1109/TCCN.2016.2527021⟩. ⟨hal-01272872⟩
763 Consultations
197 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More