基于改进Swin Transformer的双编码网络手术器械分割方法

宋政 ,  孟晓亮 ,  张立晔 ,  王晓雨 ,  韩储屺

科学技术与工程 ›› 2025, Vol. 25 ›› Issue (21) :8973-8979

PDF (7713KB)
科学技术与工程 ›› 2025, Vol. 25 ›› Issue (21) :8973-8979 DOI: 10.12404/j.issn.1671-1815.2404319
自动化技术、计算机技术

基于改进Swin Transformer的双编码网络手术器械分割方法

作者信息 +

Surgical Instrument Segmentation Method of Double Encoding Network Based on Improved Swin Transformer

Author information +
文章历史 +

摘要

为实现手术器械的准确分割,提出一种基于改进Swin Transformer的双编码网络手术器械分割方法,利用Swin Transformer和卷积神经网络(convolutional neural network, CNN)不同的编码优势,有效捕获图像特征的全局语义信息和局部细节信息,提高模型的表达能力。为尽可能弥补下采样过程中的特征细节损失,设计了一个多尺度分辨率特征金字塔池化(multi-resolution feature pyramid pooling, MFPP)模块,通过结合不同维度特征,获取更多尺度的上下文信息,增强局部细节信息表达。最后,在跳跃连接中增加一个坐标注意力模块,将目标位置信息与通道信息相融合,对手术器械目标进行精确感知。实验结果表明,所提方法在手术器械二值分割和部分分割中,均获得了更为精确的分割结果,进一步验证了所提方法的有效性和准确性。

Abstract

In order to achieve accurate segmentation of surgical instruments, a dual-encoding network surgical instrument segmentation method was proposed based on improved Swin Transformer. By taking advantage of different coding advantages of Swin Transformer and convolutional neural network(CNN), the global semantic information and local details of image features can be effectively captured to improve the expression ability of the model. To compensate for the loss of feature details during the downsampling process as much as possible, the multi-resolution feature pyramid pooling(MFPP) block was constructed to obtain more scale context information by combining different dimensional features and enhance the expression of local detail information. Finally, a coordinate attention block was added in the skip connection to fuse target position information with feature information for precise perception of the surgical instrument targets. The experimental results show that the proposed method achieves more accurate segmentation results in both binary and parts segmentation of surgical instruments, further verifying the effectiveness and accuracy of the proposed method.

关键词

手术器械 / 语义分割 / Swin Transformer / 深度学习 / 注意力机制

Key words

surgical instruments / semantic segmentation / Swin Transformer / deep learning / attention mechanism

引用本文

引用格式 ▾
宋政, 孟晓亮, 张立晔, 王晓雨, 韩储屺. 基于改进Swin Transformer的双编码网络手术器械分割方法[J]. 科学技术与工程, 2025, 25(21): 8973-8979 DOI:10.12404/j.issn.1671-1815.2404319
SONG Zheng, MENG Xiao-liang, ZHANG Li-ye, WANG Xiao-yu, HAN Chu-qi. Surgical Instrument Segmentation Method of Double Encoding Network Based on Improved Swin Transformer[J]. Science Technology and Engineering, 2025, 25(21): 8973-8979 DOI:10.12404/j.issn.1671-1815.2404319

登录浏览全文

4963

注册一个新账户 忘记密码

参考文献

基金资助

国家自然科学基金(62001272)

PDF (7713KB)

35

访问

0

被引

详细

导航
相关文章

/

〈 〉