1.西安航空学院计算机与人工智能学院,陕西 西安 710077
2.中国人民解放军空军工程大学,陕西 西安 710051
田继伟,邮箱:tianjiwei2016@163.com
收稿:2026-04-01,
修回:2026-05-26,
录用:2026-06-23,
移动端阅览
刘超, 田继伟, 贾楠, 等. 基于GCN-Transformer的空管系统网络威胁实体识别方法[J/OL]. 电信科学, 2026.
LIU Chao, TIAN Jiwei, JIA Nan, et al. A GCN-Transformer method for network threat entity recognition in air traffic management systems[J/OL]. Telecommunications Science, 2026.
刘超, 田继伟, 贾楠, 等. 基于GCN-Transformer的空管系统网络威胁实体识别方法[J/OL]. 电信科学, 2026. DOI: 10.11959/j.issn.1000-0801.DXKX260210.
LIU Chao, TIAN Jiwei, JIA Nan, et al. A GCN-Transformer method for network threat entity recognition in air traffic management systems[J/OL]. Telecommunications Science, 2026. DOI: 10.11959/j.issn.1000-0801.DXKX260210.
随着空管系统数字化转型深入,网络安全风险持续加剧,威胁实体识别已成为构建网络安全知识图谱的关键基础。针对传统序列标注模型难以有效捕捉文本语法结构与语义依赖的问题,提出一种融合图卷积网络(graph convolutional network,GCN)与transformer的空管网络威胁实体识别方法。方法通过语法解析与词共现构建文本图,利用节点重要性排序与广度优先搜索生成语义子图并完成标准化;设计基于层次正则化的深度图卷积网络HR-DGCNN,引入父子标签相似性约束,增强层次化威胁实体识别能力;借助transformer编码器提取全局语义特征,结合条件随机场(conditional random field,CRF)完成最优实体序列解码。自建空管威胁语料库进行实验,模型F1值、精确率、召回率均优于BiLSTM-CRF、BERT-Tagging等基线模型。该模型为空管系统网络威胁实体识别提供了有效新思路,具备理论与应用价值。
With the deepening digital transformation of air traffic management systems
cybersecurity risks are becoming increasingly prominent
and threat entity recognition has become a critical foundation for constructing cybersecurity knowledge graphs. To address the limitations of traditional sequence labeling models in capturing syntactic structures and semantic dependencies
this paper proposes a network threat entity recognition method for air traffic management systems that integrates graph convolutional networks (GCN) with a Transformer. Text graphs are constructed based on syntactic parsing and word co-occurrence
while semantic subgraphs are generated and standardized through node importance ranking and breadth-first search. A hierarchically regularized deep graph convolutional neural network (HR-DGCNN) is designed
incorporating parent-child label similarity constraints to enhance the recognition of hierarchical threat entities. In addition
a Transformer encoder is used to extract global semantic features
and a conditional random field (CRF) is employed to decode the optimal entity sequence. Experiments on a self-built ATC threat corpus show that the proposed model outperforms baseline models
including BiLSTM-CRF and BERT-Tagging
in terms of F1 score
precision
and recall. The results demonstrate that the proposed model provides an effective approach for network threat entity recognition in ATC systems and has both theoretical significance and practical value.
CHEN K , NADIRSHA T N M , LILITH N , et al . Tangible digital twin with shared visualization for collaborative air traffic management operations [J ] . Transportation Research Part C: Emerging Technologies , 2024 , 161 : 104546 .
DE GIOVANNI L , LANCIA C , LULLI G . Data-Driven Optimization for Air Traffic Flow Management with Trajectory Preferences [J ] . Transportation Science , 2024 , 58 ( 2 ): 540 - 556 .
Joseph Post . The Next Generation Air Transportation System of the United States: Vision, Accomplishments, and Future Directions [J ] . Engineering , 2021 , 7 ( 4 ): 427 - 430 .
YU X , CHEN C H , YANG H . Cognitive workload quantification for air traffic controllers: An ensemble semi-supervised learning approach [J ] . Advanced Engineering Informatics , 2025 , 64 : 103065 .
Lanka Bogoda , John Mo , et al . A systems engineering approach to appraise cybersecurity risks of CNS/ATM and avionics systems [C ] // 2019 Integrated Communications, Navigation and Surveillance Conference (ICNS) . IEEE , 2019 : 1 - 15 .
湖北机场集团聚焦“三力”构筑航空网安屏障 . 2024 . 中国民航局 [R ] . Retrieved May 24, 2024 from http://www.caac.gov.cn/PHONE/GLJ_PHONE/ZNGLJ/ZN_XXGK/ZN_HYDT/202404/t20240425_223987.html .
鹏远国际物流讯 . 2023 . 航运业的网络勒索金额飙升 [R ] . Retrieved Feb 23, 2024 from . https://business.sohu.com/a/729266437_121747908.
丁兆云 , 刘凯 , 刘斌 , 等 . 网络安全知识图谱研究综述 [J ] . 华中科技大学学报:自然科学版 , 2021 , 49 ( 7 ): 13 - 19 .
Ren , Yitong , et al . CSKG4APT: A cybersecurity knowledge graph for advanced persistent threat organization attribution [J ] . IEEE Transactions on Knowledge and Data Engineering , 2022 .
Peng J , Fang Y , Huang C , et al . Cyber security named entity recognition based on deep active learning [J ] . Journal of Sichuan University (Natural Science Edition) , 2019 , 56 ( 3 ): 457 - 462 .
McCallum A , Li W . Early results for named entity recognition with conditional random fields [J ] . Feature induction and web-enhanced lexicons . 2003 .
Chauhan V K , Dahiya K , Sharma A . Problem formulations and solvers in linear SVM: a review [J ] . Artificial Intelligence Review , 2019 , 52 ( 2 ): 803 - 855 .
Yang H , Li L , Yang R , et al. , 2018, Recognition Model of Electronic Medical Record Named Entity Based on Bidirectional LSTM Neural Network [J ] . Chinese Tissue Engineering Research , 22 ( 20 ): 3237 - 3242 .
Meng F , Yang S , Wang J , et al . Creating knowledge graph of electric power equipment faults based on BERT-BiLSTM-CRF model [J ] . Journal of Electrical Engineering & Technology , 2022 , 17 ( 4 ): 2507 - 2516 .
Vaswani A , Shazeer N , Parmar N , et al . Attention is all you need [J ] . Advances in Neural Information Processing Systems , 2017 : 5998 - 6008 .
Fu X , Pan Y , Zhang L . A causal-temporal graphic convolutional network (CT-GCN) approach for TBM load prediction in tunnel excavation [J ] . Expert Systems with Applications , 2024 , 238 : 121977 .
Evangelatos P , Iliou C , Mavropoulos T , et al . Named entity recognition in cyber threat intelligence using transformer-based models [C ] // 2021 IEEE International Conference on Cyber Security and Resilience (CSR) . IEEE , 2021 : 348 - 353 .
Liu X , Chen H , Xia W . Overview of named entity recognition [J ] . Journal of Contemporary Educational Research , 2022 , 6 ( 5 ): 65 - 68 .
Kong J , Zhang L , Jiang M , et al . 2021, Incorporating Multi-Level CNN and Attention Mechanism for Chinese Clinical Named Entity Recognition [J ] . Journal of Biomedical Informatics , 116 : 103737 .
Cao Y , Zhou Y , Shen F , et al . 2019, Research on Named Entity Recognition of Chinese Electronic Medical Records Based on CNN-CRF [J ] . Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition) , 2019 ( 6 ): 869 - 875 .
Yang H , Li L , Yang R , et al. , 2018, Recognition Model of Electronic Medical Record Named Entity Based on Bidirectional LSTM Neural Network [J ] . Chinese Tissue Engineering Research , 22 ( 20 ): 3237 - 3242 .
Meng F , Yang S , Wang J , et al . Creating knowledge graph of electric power equipment faults based on BERT-BiLSTM-CRF model [J ] . Journal of Electrical Engineering & Technology , 2022 , 17 ( 4 ): 2507 - 2516 .
Li Bo , Kang X , Zhang H , et al. , 2020, Named Entity Recognition of Chinese Electronic Medical Records Using Transformer-CRF [J ] . Computer Engineering and Applications , 56 ( 5 ): 153 - 159 .
Yan H , Deng B , Li X , et al . 2019, TENER: Adapting Transformer Encoder for Named Entity Recognition [J ] , arXiv: 1911.04474 .
Wu Z , Pan S , Chen F , et al . A comprehensive survey on graph neural networks [J ] . IEEE transactions on neural networks and learning systems , 2020 , 32 ( 1 ): 4 - 24 .
Zhang S , Tong H , Xu J , et al . Graph convolutional networks: a comprehensive review [J ] . Computational Social Networks , 2019 , 6 ( 1 ): 1 - 23 .
Wang Y , Sun Y , Liu Z , et al . Dynamic graph cnn for learning on point clouds [J ] . ACM Transactions on Graphics (tog) , 2019 , 38 ( 5 ): 1 - 12 .
Shaw P , Uszkoreit J , Vaswani A . Self-attention with relative position representations [J ] . arxiv preprint arxiv: 1803.02155 , 2018 .
Jiang C , Yang Z , Yao J . Three-Way Decision Enhanced Graph Convolutional Networks for Text Classification [J ] . Neural Processing Letters , 2025 , 57 ( 2 ): 37 .
Wang , Ma H , Zhang Y , et al . Dual-view graph-of-graph representation learning with graph Transformer for graph-level anomaly detection [J ] . Neural Networks , 2025 , 187 : 107291 .
Zhu Q , Wang Y , Li W , et al . Advancing multi-modal beam prediction with cross-modal feature enhancement and dynamic fusion mechanism [J ] . IEEE Transactions on Communications , 2025 .
Kumar S , Alam M S , Khursheed Z , et al . Enhancing Relational Database Interaction through Open AI and Stanford Core NLP-Based on Natural Language Interface [C ] // 2024 5th International Conference on Recent Trends in Computer Science and Technology (ICRTCST) . IEEE , 2024 : 589 - 602 .
Wang G , Du Y , Jiang Y , et al . Label-text bi-attention capsule networks model for multi-label text classification [J ] . Neurocomputing , 2024 , 588 : 127671 .
Pennington J , Socher R , Manning C D . Glove: Global vectors for word representation [C ] // Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) . 2014 : 1532 - 1543 .
Chand P K , Kumar M , Molla A R . Agent-driven bfs tree in anonymous graphs with applications [C ] // International Conference on Networked Systems . Cham : Springer Nature Switzerland , 2024 : 67 - 82 .
McCallum A. , & Li W. ( 2003 ). Early results for named entity recognition with conditional random fields . Feature induction and web-enhanced lexicons .
Mayfield J. , McNamee P. , & Piatko C. ( 2003 ). Named Entity Recognition using Hundreds of Thousands of Features. In Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 (CoNLL-2003) (pp . 184 - 187 ).
Collobert R. , Weston J. , Bottou L. , Karlen M. , Kavukcuoglu K. , & Kuksa P. ( 2011 ). Natural language processing (almost) from scratch . Journal of Machine Learning Research , 12 , 2493 - 2537 .
Cao Y. , Zhou Y. , Shen F. , et al . ( 2019 ). Research on Named Entity Recognition of Chinese Electronic Medical Records Based on CNN-CRF . Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition) , ( 6 ): 869 - 875 .
Huang Z. , Xu W. , & Yu K. ( 2015 ). Bidirectional LSTM-CRF Models for Sequence Tagging . arXiv preprint arXiv: 1508.01991 .
Devlin J. , Chang M. W. , Lee K. , & Toutanova K. ( 2019 ). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) (pp. 4171 - 4186 ).
Li B. , Kang X. , Zhang H. , et al . ( 2020 ). Named Entity Recognition of Chinese Electronic Medical Records Using Transformer-CRF . Computer Engineering and Applications , 56 ( 5 ): 153 - 159 .
Yao L. , Mao C. , & Luo Y. ( 2019 ). Graph Convolutional Networks for Text Classification . In Proceedings of the AAAI Conference on Artificial Intelligence , 33 ( 01 ), 7370 - 7377 .
Kipf T N , Welling M . Semi-Supervised Classification with Graph Convolutional Networks [C ] // International Conference on Learning Representations (ICLR) , 2017 .
Veličković P , Cucurull G , Casanova A , et al . Graph Attention Networks [C ] // International Conference on Learning Representations (ICLR) , 2018 .
0
浏览量
1
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010602201714号