基于强化学习的局部高密度无人机避撞决策

江波 ,  胡潇瀚 ,  郑远 ,  李诚龙 ,  刘旭川

科学技术与工程 ›› 2025, Vol. 25 ›› Issue (30) :13167-13178

PDF (8482KB)
科学技术与工程 ›› 2025, Vol. 25 ›› Issue (30) :13167-13178 DOI: 10.12404/j.issn.1671-1815.2408581
航空、航天

基于强化学习的局部高密度无人机避撞决策

作者信息 +

Local High-density UAV Collision Avoidance Decision Based on Reinforcement Learning

Author information +
文章历史 +

摘要

城市空中交通等低空经济概念的提出,描绘了城市超低空无人机高密度运行的愿景,形成了相关无人机高密度运行的技术浪潮。其中,避撞技术作为保障无人机高密度运行安全的关键核心技术之一,直接影响着高密度运行的可靠性。在局部高密度空域的多无人机避撞场景中,现有避撞决策方法无法提供实时可靠的避撞策略。针对上述问题,提出了基于D3QN(dueling double DQN)算法的高密度避撞决策方法。具体地,对状态空间进行重构,基于固定扇区,在能够处理高密度避撞输入的同时,保证了神经网络的稳定性。其次,借鉴现有民航空管体系管制避撞规则,基于同伦理论,设计了由规则引导及自由避撞构成的两阶段高密度避撞决策方法。仿真实验表明,相比于传统方法,本文提出的高密度避撞决策方法在单位密度>30架次/km2的高密度空域中,仍能够维持避撞成功率在99.66%以上,为城市低空无人机的高密度运行提供了切实可行的避撞策略。

Abstract

The vision of ultra-low-altitude urban drone operations at high density is depicted by the introduction of concepts such as urban air mobility and the low-altitude economy, and a technological wave in high-density drone operations is generated. Collision avoidance technology is recognized as one of the key core technologies for ensuring the safety of high-density drone operations, and its impact on operational reliability is directly acknowledged. In multi-drone collision avoidance scenarios within localized high-density airspace, real-time and reliable collision avoidance strategies are found to be beyond the capabilities of existing decision-making methods. To address this issue, a high-density collision avoidance decision-making method based on the D3QN (dueling double DQN) algorithm was proposed. Specifically, the state space was reconstructed using fixed sectors, thereby enabling high-density collision avoidance inputs to be processed while neural network stability was ensured. Furthermore, existing civil aviation air traffic control collision avoidance rules were referenced, and a two-stage collision avoidance decision-making method was designed, which comprises both rule-guided and free collision avoidance components, based on homotopy theory. Simulation experiments have demonstrated that, compared to conventional methods, a collision avoidance success rate exceeding 99.66% is maintained in airspace densities greater than 30 flights per square kilometer, thus providing a feasible collision avoidance strategy for high-density urban drone operations.

关键词

避撞 / 冲突解脱规则 / 同伦理论 / 自主决策 / 深度强化学习

Key words

collision avoidance / conflict resolution rules / homotopy theory / autonomous decision-making / deep reinforcement learning

引用本文

引用格式 ▾
江波, 胡潇瀚, 郑远, 李诚龙, 刘旭川. 基于强化学习的局部高密度无人机避撞决策[J]. 科学技术与工程, 2025, 25(30): 13167-13178 DOI:10.12404/j.issn.1671-1815.2408581
JIANG Bo, HU Xiao-han, ZHENG Yuan, LI Cheng-long, LIU Xu-chuan. Local High-density UAV Collision Avoidance Decision Based on Reinforcement Learning[J]. Science Technology and Engineering, 2025, 25(30): 13167-13178 DOI:10.12404/j.issn.1671-1815.2408581

登录浏览全文

4963

注册一个新账户 忘记密码

参考文献

基金资助

国家自然科学基金民航联合基金(U2333214)

民航局安全能力建设项目(MHAQ2024033)

民航飞行技术与飞行安全重点实验室开放项目(FZ2022KF10)

四川省自然科学基金(2023NSFSC0903)

PDF (8482KB)

37

访问

0

被引

详细

导航
相关文章

/

〈 〉