Passer à la navigation principale Passer à la recherche Passer au contenu principal

Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things

  • Chongqing University of Posts and Telecommunications
  • Nanyang Technological University

Résultats de recherche: Contribution à un journal › Article publié dans une revue, révisé par les pairs › Revue par des pairs

52 Citations (Scopus)

Résumé

The Industrial Internet of Things (IIoT) has attracted tremendous interest from both industry and academia as it can significantly improve production efficiency and system intelligence. However, with the explosive growth of various types of user equipment (UE) and data flow, IIoT experiences spectrum resource scarcity for wireless applications. In this article, we propose a solution for spectrum resource management for the IIoT network, with the objective of facilitating the limited spectrum sharing between different kinds of UEs. To overcome the challenges of unknown dynamic IIoT environments, a modified deep Q-learning network (MDQN) is developed. Considering the cost effectiveness of IIoT devices, the base station (BS) acts as a single agent and centrally manages the spectrum resources, which can be executed without coordination or exchange between UEs. In this article, we first built a realistic IIoT model and design a simple medium access control (MAC) frame structure to facilitate the environment state observation. Then, a new reward function is designed to drive the learning process, which takes into account the different communication requirements of various types of UEs. In addition, to improve the learning efficiency, we compress the action space and propose a priority experience replay strategy based on decreasing temporal difference (TD) error. Finally, simulation results show that the proposed algorithm can successfully achieve dynamic spectrum resource management in the IIoT network. Compared with other algorithms, it can achieve superior network performance with a faster convergence rate.

Langue originaleAnglais
Numéro d'article9187936
Pages (de - à)3476-3489
Nombre de pages14
RevueIEEE Internet of Things Journal
Volume8
Numéro de publication5
Les DOIs
ÉtatPublié - 1 mars 2021

SDG des Nations Unies

Ce résultat contribue à ou aux Objectifs de développement durable suivants

  1. SDG 9 – Industrie, innovation et infrastructure
    SDG 9 – Industrie, innovation et infrastructure

Classification disciplinaire ASJC Scopus

  • Traitement du signal
  • Systèmes d'information
  • Matériel et architecture
  • Applications de l'informatique
  • Réseaux informatiques et communications

Empreinte digitale

Voici les principaux termes ou expressions associés à « Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things ». Ces libellés thématiques sont générés à partir du titre et du résumé de la publication. Ensemble, ils forment une empreinte digitale unique.

Citer cette ressource