LD3QN-IR：信息时效性与能量协同优化的卫星网络路由算法

杨晨; 王欣睿; 魏德宾; 潘成胜

doi:10.11959/j.issn.1000-0801.DXKX260438

Chinese

您当前的位置：

首页 >

文章列表页 >

LD3QN-IR：信息时效性与能量协同优化的卫星网络路由算法

研究与开发 | 更新时间：2026-09-30

- LD3QN-IR：信息时效性与能量协同优化的卫星网络路由算法
- LD3QN-IR: An Information-Timeliness and Energy Co-Optimization Routing Algorithm for Satellite Networks
- 电信科学 2026年
- 作者机构：
  
  1.大连大学信息工程学院，辽宁大连 116622
  2.南京邮电大学通信与网络技术国家工程研究中心，江苏南京 210023
- 作者简介：
  
  杨晨，出生于2001年，男，大连大学，硕士研究生，主要研究方向为卫星网络路由、网络流量预测等。
  王欣睿，出生于2001年，男，硕士，大连大学，主要研究方向为队列管理、网络路由等。
  魏德宾，出生于1978年，男，博士，大连大学，副教授，主要研究方向为空间信息网络传输技术、流量工程和网络优化。
  潘成胜，出生于1962年，男，博士，南京邮电大学，教授，主要研究方向为一体化智能网络流量理论与关键技术。
- 基金信息：
  
  国家自然科学基金资助项目(61931004)
- DOI：10.11959/j.issn.1000-0801.DXKX260438
  中图分类号： TP393
- 收稿：2026-06-30，
  
  修回：2026-08-13，
  
  录用：2026-09-08，
- 稿件说明：
移动端阅览
杨晨, 王欣睿, 魏德宾, 等. LD3QN-IR：信息时效性与能量协同优化的卫星网络路由算法[J/OL]. 电信科学, 2026.

YANG Chen, WANG Xinrui, WEI Debin, et al. LD3QN-IR: An Information-Timeliness and Energy Co-Optimization Routing Algorithm for Satellite Networks[J/OL]. Telecommunications Science, 2026.
杨晨, 王欣睿, 魏德宾, 等. LD3QN-IR：信息时效性与能量协同优化的卫星网络路由算法[J/OL]. 电信科学, 2026. DOI： 10.11959/j.issn.1000-0801.DXKX260438.

YANG Chen, WANG Xinrui, WEI Debin, et al. LD3QN-IR: An Information-Timeliness and Energy Co-Optimization Routing Algorithm for Satellite Networks[J/OL]. Telecommunications Science, 2026. DOI： 10.11959/j.issn.1000-0801.DXKX260438.

摘要

针对低轨卫星运动引起的网络拓扑和星间链路状态动态变化，以及业务负载、链路资源和节点能量状态持续演化时，现有卫星网络路由方法难以同时兼顾信息时效性、链路拥塞与节点能量消耗的问题，提出信息时效性与能量协同优化的卫星网络路由算法LD3QN-IR。该算法将网络邻接关系、链路剩余带宽、传输时延、端到端信息年龄及节点剩余能量比例联合构建为状态空间，利用LSTM对历史网络状态进行时序编码，并通过CNN进一步提取状态特征中的局部关联信息；随后采用Dueling Double DQN对状态价值与动作优势进行分解，并利用Double Q机制降低动作价值过估计。在此基础上，通过综合考虑信息年龄、链路利用率、节点能量和路由前进性的奖励函数，引导智能体在信息新鲜度、传输性能和能量消耗之间进行协同权衡。基于STK、NS3与MATLAB的联合动态拓扑仿真结果表明，LD3QN-IR在不同网络负载条件下均获得最高的综合均衡得分，表现出更优的多目标综合性能，能够有效兼顾传输时延、信息新鲜度与节点能量消耗。

Abstract

In low-Earth-orbit (LEO) satellite networks

the network topology and inter-satellite link states were continuously altered by satellite motion

while continuous variations were observed in traffic loads

link resources

and node energy states. Consequently

information timeliness

link congestion

and node energy consumption could not be simultaneously balanced by existing satellite network routing methods. To address this problem

LD3QN-IR

a satellite network routing algorithm for the joint optimization of information timeliness and energy

was proposed. In the proposed algorithm

a state space was constructed by jointly incorporating network adjacency

residual link bandwidth

transmission delay

end-to-end age of information (AoI)

and the residual energy ratio of each node. Historical network states were temporally encoded using a long short-term memory (LSTM) network

and local temporal correlations in the encoded state features were further extracted using a convolutional neural network (CNN). Subsequently

a Dueling Double deep Q-network (Dueling Double DQN) was adopted

through which the action-value function was decomposed into a state-value function and an action-advantage function

while action-value overestimation was reduced using the Double Q mechanism. On this basis

a reward function incorporating AoI

link utilization

residual node energy

and routing progress was designed

through which the agent was guided to balance information freshness

transmission performance

and energy consumption. Joint dynamic-topology simulations were conducted using STK

NS3

and MATLAB. The highest comprehensive balance score was achieved by LD3QN-IR under all tested network loads

and superior multi-objective performance was demonstrated

with end-to-end delay

information freshness

and node energy consumption effectively balanced.

关键词

Keywords

references

SU Y , LIU Y , ZHOU Y , et al . Broadband LEO satellite communications: architectures and key technologies [J ] . IEEE Wireless Communications , 2019 , 26 ( 2 ): 55 - 61 .

KAHRAMAN I , KOSE A , KOCA M , et al . Age of information in Internet of Things: a survey [J ] . IEEE Internet of Things Journal , 2023 , 11 ( 6 ): 9896 - 9914 .

GAO Z , LIU A , HAN C , et al . Non-orthogonal multiple access-based average age of information minimization in LEO satellite-terrestrial integrated networks [J ] . IEEE Transactions on Green Communications and Networking , 2022 , 6 ( 3 ): 1793 - 1805 .

YANG L , ZHANG H , QI Y , et al . Available energy routing algorithm considering QoS requirements for LEO satellite network [J ] . Computer Communications , 2024 , 217 : 87 - 96 .

TSAI K C , FAN L , WANG L C , et al . Multi-commodity flow routing for large-scale LEO satellite networks using deep reinforcement learning [C ] // Proceedings of 2022 IEEE Wireless Communications and Networking Conference . Piscataway : IEEE Press , 2022 : 626 - 631 .

LIN C Y , LIAO W . Energy-aware age of information minimization for Internet of Things in NOMA-based LEO satellite networks [C ] // Proceedings of 2024 IEEE 99th Vehicular Technology Conference . Piscataway : IEEE Press , 2024 : 1 - 5 .

WANG Q , LIANG X , ZHANG H , et al . AoI-aware energy efficiency resource allocation for integrated satellite-terrestrial IoT networks [J ] . IEEE Transactions on Green Communications and Networking , 2025 , 9 ( 1 ): 125 - 139 .

LI Y , XU Y , ZHANG Q , et al . Age-optimized multihop information update mechanism on the LEO satellite constellation via continuous time-varying graphs [J ] . IEEE Internet of Things Journal , 2023 , 10 ( 8 ): 7189 - 7203 .

JING Y , YANG Z , ZHAO Y , et al . Energy-efficient routing based on a genetic algorithm for satellite laser communication [J ] . Optics Express , 2023 , 31 ( 5 ): 8682 - 8695 .

LIU J , ZHAO B , XIN Q , et al . DRL-ER: an intelligent energy-aware routing protocol with guaranteed delay bounds in satellite mega-constellations [J ] . IEEE Transactions on Network Science and Engineering , 2020 , 8 ( 4 ): 2872 - 2884 .

DONG F , SONG J , ZHANG Y , et al . DRL-based load-balancing routing scheme for 6G space-air-ground integrated networks [J ] . Remote Sensing , 2023 , 15 ( 11 ): 2801 .

CHEN Y , CAO H , WANG L , et al . Deep reinforcement learning-based routing method for low earth orbit mega-constellation satellite networks with service function constraints [J ] . Sensors , 2025 , 25 ( 4 ): 1232 .

MNIH V , KAVUKCUOGLU K , SILVER D , et al . Human-level control through deep reinforcement learning [J ] . Nature , 2015 , 518 ( 7540 ): 529 - 533 .

温京龙 , 张怡 , 魏德宾 , 等 . 基于长短期记忆深度Q网络的卫星网络多业务路由算法 [J ] . 电信科学 , 2026 , 42 ( 5 ): 48 - 59 .

WEN J L , ZHANG Y , WEI D B , et al . Multi-service routing algorithm for satellite networks based on deep Q-network with long short-term memory [J ] . Telecommunications Science , 2026 , 42 ( 5 ): 48 - 59 .

VAN HASSELT H , GUEZ A , SILVER D . Deep reinforcement learning with double Q-learning [C ] // Proceedings of the AAAI Conference on Artificial Intelligence . Palo Alto : AAAI Press , 2016 : 2094 - 2100 .

WANG Z , SCHAUL T , HESSEL M , et al . Dueling network architectures for deep reinforcement learning [C ] // Proceedings of the International Conference on Machine Learning . New York : PMLR , 2016 : 1995 - 2003 .

XU G , ZHAO Y , RAN Y , et al . Spatial location-aided fully-distributed dynamic routing for large-scale LEO satellite networks [J ] . IEEE Communications Letters , 2022 , 26 ( 12 ): 3034 - 3038 .

LI S , WU Q , WANG R , et al . Efficient multipath differential routing and traffic scheduling in ultra-dense LEO satellite networks: a DRL with Stackelberg game approach [J ] . IEEE Transactions on Mobile Computing , 2025 , 24 ( 11 ): 12424 - 12440 .

LIAO H , ZHANG X , ZHOU J , et al . Real-time routing design for LEO satellite networks: an enhanced multi-agent DRL approach [C ] // Proceedings of 2024 IEEE/CIC International Conference on Communications in China Workshops . Piscataway : IEEE Press , 2024 : 547 - 552 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

面向智能路由的多级哈希网络数据存储结构

多无人机辅助物联网中信息年龄最小化的数据采集与分发优化算法

量子-经典混合神经网络在分类算法中的研究与应用

面向智能运维的数据中心垂类大模型构建与应用研究

一种融合声纹验证的实时语音识别方法