Skip to main navigation Skip to search Skip to main content

Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things

  • Chongqing University of Posts and Telecommunications
  • Nanyang Technological University

Research output: Contribution to journal › Journal Article › peer-review

52 Citations (Scopus)

Abstract

The Industrial Internet of Things (IIoT) has attracted tremendous interest from both industry and academia as it can significantly improve production efficiency and system intelligence. However, with the explosive growth of various types of user equipment (UE) and data flow, IIoT experiences spectrum resource scarcity for wireless applications. In this article, we propose a solution for spectrum resource management for the IIoT network, with the objective of facilitating the limited spectrum sharing between different kinds of UEs. To overcome the challenges of unknown dynamic IIoT environments, a modified deep Q-learning network (MDQN) is developed. Considering the cost effectiveness of IIoT devices, the base station (BS) acts as a single agent and centrally manages the spectrum resources, which can be executed without coordination or exchange between UEs. In this article, we first built a realistic IIoT model and design a simple medium access control (MAC) frame structure to facilitate the environment state observation. Then, a new reward function is designed to drive the learning process, which takes into account the different communication requirements of various types of UEs. In addition, to improve the learning efficiency, we compress the action space and propose a priority experience replay strategy based on decreasing temporal difference (TD) error. Finally, simulation results show that the proposed algorithm can successfully achieve dynamic spectrum resource management in the IIoT network. Compared with other algorithms, it can achieve superior network performance with a faster convergence rate.

Original languageEnglish
Article number9187936
Pages (from-to)3476-3489
Number of pages14
JournalIEEE Internet of Things Journal
Volume8
Issue number5
DOIs
Publication statusPublished - 1 Mar 2021

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 9 - Industry, Innovation, and Infrastructure
    SDG 9 Industry, Innovation, and Infrastructure

Keywords

  • Deep reinforcement learning (DRL)
  • Industrial Internet of Things (IIoT)
  • learning efficiency
  • priority experience replay
  • spectrum resource management

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this