1. Trial and Error Learning for Dynamic Distributed Channel Allocation in Random Medium
- Author
-
Christophe J. Le Martret, Jerome Gaveau, Xavier Leturc, Mohamad Assaad, Thales SIX GTS France, DGA Maîtrise de l'information (DGA.MI), Direction générale de l'Armement (DGA), Laboratoire des signaux et systèmes (L2S), and CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
- Subjects
Mathematical optimization ,Channel allocation schemes ,[INFO.INFO-GT]Computer Science [cs]/Computer Science and Game Theory [cs.GT] ,Computer science ,Applied Mathematics ,Random media ,020206 networking & telecommunications ,02 engineering and technology ,Trial and error ,Computer Science Applications ,[INFO.INFO-NI]Computer Science [cs]/Networking and Internet Architecture [cs.NI] ,[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG] ,0202 electrical engineering, electronic engineering, information engineering ,Electrical and Electronic Engineering ,ComputingMilieux_MISCELLANEOUS - Abstract
International audience; This paper considers the problem of fully distributed channel allocation in clustered wireless networks when the propagation medium is random. We extend here the existing Trial and Error (TE) framework developed in the deterministic case and for which strong convergence properties hold. We prove that using directly this solution in the random context leads to unsatisfactory solutions. Then we propose an adaptation of the original Trial and Error Learning (TEL) algorithm, called Robust TEL (RTEL), assuming that the random channel effects translate into a bounded stochastic disturbance of the utility function. The solution consists in introducing thresholds in the transitions of the TEL’s Finite State Controller (FSC). We prove that this new solution restores the good convergence property inherited from the TEL. Furthermore, we provide analysis of the stochastic utilities in the Rayleigh fading case in order to check the bounded assumption. Finally, we develop an online algorithm that dynamically estimates the optimal threshold values to adapt to the instantaneous disturbance. Numerical results corroborate our theoretical claims.
- Published
- 2021
- Full Text
- View/download PDF