A two-hops state-aware routing strategy based on deep reinforcement learning for LEO satellite networks

21Citations
Citations of this article
21Readers
Mendeley users who have this article in their library.

Abstract

Low Earth Orbit (LEO) satellite networks can provide complete connectivity and worldwide data transmission capability for the internet of things. However, arbitrary flow arrival and uneven traffic load among areas bring about unbalanced traffic distribution over the LEO constellation. Therefore, the routing strategy in LEO networks should have the ability to adjust routing paths based on changes in network status adaptively. In this paper, we propose a Two-Hops State-Aware Routing Strategy Based on Deep Reinforcement Learning (DRL-THSA) for LEO satellite networks. In this strategy, each node only needs to obtain the link state within the range of two-hop neighbors, and the optimal next-hop node can be output. The link state is divided into three levels, and the traffic forwarding strategy for each level is proposed, which allows DRL-THSA to cope with link outage or congestion. The Double-Deep Q Network (DDQN) is proposed in DRL-THSA to figure out the optional next hop by inputting the two-hops link states. The DDQN is analyzed from three aspects: model setting, training process and running process. The effectiveness of DRL-THSA, in terms of end-to-end delay, throughput, and packet drop rate, is verified via a set of simulations using the Network Simulator 3 (NS3).

References Powered by Scopus

LEO Satellite Constellation for Internet of Things

457Citations
N/AReaders
Get full text

The Deep Learning Vision for Heterogeneous Network Traffic Control: Proposal, Challenges, and Future Perspective

352Citations
N/AReaders
Get full text

Explicit Load Balancing Technique for NGEO Satellite IP Networks With On-Board Processing Capabilities

181Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Survey on Machine Learning for Intelligent End-to-End Communication Toward 6G: From Network Access, Routing to Traffic Control and Streaming Adaption

127Citations
N/AReaders
Get full text

A Deep Reinforcement Learning-Based Dynamic Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN)

83Citations
N/AReaders
Get full text

QR-SDN: Towards reinforcement learning states, actions, and rewards for direct flow routing in software-defined networks

55Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Wang, C., Wang, H., & Wang, W. (2019). A two-hops state-aware routing strategy based on deep reinforcement learning for LEO satellite networks. Electronics (Switzerland), 8(9). https://doi.org/10.3390/electronics8090920

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 6

75%

Lecturer / Post doc 1

13%

Researcher 1

13%

Readers' Discipline

Tooltip

Computer Science 4

40%

Engineering 4

40%

Social Sciences 1

10%

Psychology 1

10%

Save time finding and organizing research with Mendeley

Sign up for free