利用实例分割与关键点定位的自主破岩石块击打点识别方法
DOI:
作者:
作者单位:

1.昆明理工大学 交通工程学院;2.昆明理工大学 机电工程学院

作者简介:

通讯作者:

中图分类号:

TP391.41

基金项目:


Rock Impact Point Recognition Method for Autonomous Rock Breaking Using Instance Segmentation and Keypoint Localization
Author:
Affiliation:

1.Kunming University of Science and Technology;2.Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对自动驾驶挖掘机自主破岩场景中堆积石块边界模糊、相邻目标接触粘连及复杂遮挡条件下击打点难以稳定获取的问题,提出一种面向自主破岩的两阶段视觉"实例分割—击打点定位"方法,实现石块实例感知、击打点自动生成及关键点预测的一体化处理,为自主破岩击打规划提供可靠的视觉感知基础。首先,在YOLOv8-seg基础上构建改进实例分割模型MineBOC-YOLO,设计边界纹理解耦模块BTDMC2f、目标感知门控聚合模块OAGM和接触关系分离模块CRSM,分别用于增强边界与纹理表达、关键特征聚合以及接触区域分离能力,从而提升密集堆叠与遮挡场景下的实例分割质量。随后,根据实例分割掩码自动计算石块击打点并生成单关键点标注,利用YOLOv8-pose实现击打点预测。实验结果表明:MineBOC-YOLO的掩码精确率、交并比阈值为0.50的平均精度以及交并比阈值为0.50~0.95的平均精度分别达到0.846、0.914和0.683;相较YOLOv8n-seg,后两项指标分别提升2.40%和3.50%,且模型参数量仅由3.264×10?增加至3.407×10?;击打点定位实验中,A、B两组样本的平均误差分别为7.07 px和7.98 px,均低于10 px阈值。所提方法实现了实例分割结果向击打点定位结果的自动转换,在保持轻量化与实时性的同时,可输出满足自主破岩击打规划需求的石块击打位置,为自主破岩作业提供视觉感知支撑。

    Abstract:

    To address the difficulty of stable impact-point acquisition caused by blurred boundaries of stacked rocks, contact adhesion between adjacent targets, and complex occlusion in autonomous rock-breaking scenarios of driverless excavators, a two-stage vision-based method integrating instance segmentation and impact-point localization is proposed. The method realizes the integrated processing of rock instance perception, automatic impact-point generation, and keypoint prediction, providing a reliable visual perception basis for impact planning in autonomous rock-breaking operations. First, an improved instance segmentation model, MineBOC-YOLO, is constructed using YOLOv8-seg. Three modules are designed, namely the boundary-texture decoupling module BTDMC2f, the object-aware gated aggregation module OAGM, and the contact-relationship separation module CRSM. These modules enhance boundary-texture representation, key feature aggregation, and contact-region separation, respectively, thereby improving instance segmentation quality in densely stacked and occluded scenes. Subsequently, rock impact points are automatically calculated from instance segmentation masks, and single-keypoint annotations are generated. YOLOv8-pose is then used to predict the impact points. The experimental results show that the mask precision, mAP50, and mAP50–95 of MineBOC-YOLO reach 0.846, 0.914, and 0.683, respectively. Compared with YOLOv8n-seg, mAP50 and mAP50–95 are improved by 2.40% and 3.50%, respectively, while the number of model parameters increases only from 3.264×10? to 3.407×10?. In the impact-point localization experiment, the average errors of groups A and B are 7.07 px and 7.98 px, respectively, both lower than the 10 px threshold. The proposed method realizes the automatic transformation from instance segmentation results to impact-point localization results. While maintaining lightweight design and real-time performance, it can output rock impact positions for autonomous rock-breaking impact planning, thereby providing visual perception support for autonomous rock-breaking operations.

    参考文献
    相似文献
    引证文献
引用本文

杨秀建,赵幸龙,沈世全,等. 利用实例分割与关键点定位的自主破岩石块击打点识别方法[J]. 科学技术与工程, , ():

复制
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-04-25
  • 最后修改日期:2026-07-07
  • 录用日期:2026-08-01
  • 在线发布日期:
  • 出版日期:
×
2026年会通知 | “技术经济学驱动智能经济生态构建与治理变革”——中国技术经济学会第三十三届学术年会(2026)会议通知暨征文启事(第一轮)
亟待确认版面费归属稿件,敬请作者关注