How can Ignorant but Patient Cognitive Terminals Learn Their Strategy and Utility?

Abstract : This paper aims to contribute to bridge the gap between ex- isting theoretical results in distributed radio resource alloca- tion policies based on equilibria in games (assuming com- plete information and rational players) and practical design of signal processing algorithms for self-configuring wireless networks. For this purpose, the framework of learning theory in games is exploited. Here, a new learning algorithm based on mild information assumptions at the transmitters is pre- sented. This algorithm possesses attractive convergence prop- erties not available for standard reinforcement learning algo- rithms and in addition, it allows each transmitter to learn both its optimal strategy and the values of its expected utility for all its actions. A detailed convergence analysis is conducted. In particular, a framework for studying heterogeneous wire- less networks where transmitters do not learn at the same rate is provided. The proposed algorithm, which can be applied to any wireless network verifying the information assumptions stated, is applied to the case of multiple access channels in order to provide some numerical results.
Document type :
Conference papers
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download

https://hal-supelec.archives-ouvertes.fr/hal-00556154
Contributor : Samir Medina Perlaza <>
Submitted on : Saturday, January 15, 2011 - 3:53:17 PM
Last modification on : Thursday, April 5, 2018 - 12:30:05 PM
Long-term archiving on : Saturday, April 16, 2011 - 2:56:42 AM

File

342_P_11867_69.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00556154, version 1

Collections

Citation

Samir M. Perlaza, Hamidou Tembine, Samson Lasaulce. How can Ignorant but Patient Cognitive Terminals Learn Their Strategy and Utility?. SPAWC 2010, Jun 2010, Morocco. 5 p. ⟨hal-00556154⟩

Share

Metrics

Record views

896

Files downloads

381