Skip to main navigation Skip to search Skip to main content

Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches

  • University of Electronic Science and Technology of China
  • University of Jyväskylä
  • Southeast University, Nanjing
  • Purple Mountain Laboratories
  • Department of Computer Science
  • École de technologie supérieure

Research output: Contribution to journal › Journal Article › peer-review

160 Citations (Scopus)

Abstract

The future mobile communication system is expected to provide ubiquitous connectivity and unprecedented services over billions of devices. The unmanned aerial vehicle (UAV), which is prominent in its flexibility and low cost, emerges as a significant network entity to realize such ambitious targets. In this work, novel machine learning-based trajectory design and resource allocation schemes are presented for a multi-UAV communications system. In the considered system, the UAVs act as aerial Base Stations (BSs) and provide ubiquitous coverage. In particular, with the objective to maximize the system utility over all served users, a joint user association, power allocation and trajectory design problem is presented. To solve the problem caused by high dimensionality in state space, we first propose a machine learning-based strategic resource allocation algorithm which comprises of reinforcement learning and deep learning to design the optimal policy of all the UAVs. Then, we also present a multi-agent deep reinforcement learning scheme for distributed implementation without knowing a priori knowledge of the dynamic nature of networks. Extensive simulation studies are conducted and illustrated to evaluate the advantages of the proposed scheme.

Original languageEnglish
Pages (from-to)2940-2951
Number of pages12
JournalIEEE Transactions on Network Science and Engineering
Volume10
Issue number5
DOIs
Publication statusPublished - 1 Sept 2023

Keywords

  • Trajectory design
  • UAV
  • deep learning
  • drone
  • multi-agent reinforcement learning
  • resource allocation

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches'. These topics are generated from the title and abstract of the publication. Together, they form a unique fingerprint.

Cite this