Oneshot Deep Reinforcement Learning Approach to Network Slicing for Autonomous IoT Systems

Abdel Kader Chabi Sika Boni (1) , Hassan Hassan (2) , Khalil Drira (1)

1 LAAS-SARA - Équipe Services et Architectures pour Réseaux Avancés
2 LAAS-IDEA - Service Informatique : Développement, Exploitation et Assistance

With the emergence of the Internet of Things (IoT) services, meeting multiple and diverse Quality of Service (QoS) requirements in networks has become a crucial issue. In the new 5G networks, network slicing is presented as the solution to provide a tailored QoS for different network services. This new technology offers better prospects for IoT services and applications. In fact, in modern IoT systems, the number of IoT devices increases, and these systems evolve to be autonomous IoT systems. QoS management must be done without human intervention, making conventional QoS management mechanisms unsuitable. In this paper, we introduce an oneshot Deep Reinforcement Learning (DRL) agent capable of autonomously receiving requests for slices and proposing a placement on the physical infrastructure that maximizes the total number of accepted requests while guaranteeing load balancing at the infrastructure resources level. By adopting a new paradigm located at the crossroads between the single DRL agent and the multi-agent DRL, our agent manages to generate the placement decision of a slice request in one step, which makes it compatible with the European Telecommunications Standards Institute (ETSI) standard. Numerous simulations and comparisons with six other algorithms allowed us to validate its effectiveness in real-time scenarios where learning from previous placements is required to improve future slice provisioning.

Mots clés: Autonomous IoT systems; QoS; Network Slicing; Deep Reinforcement Learning

Domaines: Informatique [cs]

Abdel Kader Chabi Sika Boni, Hassan Hassan, Khalil Drira. Oneshot Deep Reinforcement Learning Approach to Network Slicing for Autonomous IoT Systems. IEEE Internet of Things Journal, In press, ⟨10.1109/jiot.2024.3356750⟩. ⟨hal-04474328⟩