A Deep Reinforcement Learning-Based Dynamic Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN)

Fengxiao Tang, Hans Hofner, Nei Kato, Kazuma Kaneko, Yasutaka Yamashita, Masatake Hangai

Research output: Contribution to journalArticlepeer-review

43 Citations (Scopus)

Abstract

Space-Air-Ground Integrated Networks (SAGIN) is considered as the key structure of the next generation network. The space satellites and air nodes are the potential candidates to assist and offload the terrain transmissions. However, due to the high mobility of space and air nodes as well as the high dynamic of network traffic, the conventional traffic offloading strategy is not applicable for the high dynamic SAGIN. In this paper, we propose a reinforcement learning based traffic offloading for SAGIN by considering the high mobility of nodes as well as frequent changing network traffic and link state. In the proposal, a double Q-learning algorithm with improved delay-sensitive replay memory algorithm (DSRPM) is proposed to train the node to decide offloading strategy based on the local and neighboring historical information. Furthermore, a joint information collection with hello package and offline training mechanism is proposed to assist the proposed offloading algorithm. The simulation shows that the proposal outperforms conventional offloading algorithms in terms of signaling overhead, dynamic adaptivity, packet drop rate and transmission delay.

Original languageEnglish
Pages (from-to)276-289
Number of pages14
JournalIEEE Journal on Selected Areas in Communications
Volume40
Issue number1
DOIs
Publication statusPublished - 2022 Jan 1

Keywords

  • Double Q-learning
  • Reinforcement learning (RL)
  • Satellite communication
  • Space-air-ground integrated networks (SAGIN)
  • Traffic offloading
  • UAV

Fingerprint

Dive into the research topics of 'A Deep Reinforcement Learning-Based Dynamic Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN)'. Together they form a unique fingerprint.

Cite this