基于姿态估计和Transformer模型的遮挡行人重识别

陈禹 ,  刘慧 ,  梁东升 ,  张雷

科学技术与工程 ›› 2024, Vol. 24 ›› Issue (12) :5051-5058

PDF (2002KB)
科学技术与工程 ›› 2024, Vol. 24 ›› Issue (12) :5051-5058 DOI: 10.12404/j.issn.1671-1815.2303944
自动化技术、计算机技术

基于姿态估计和Transformer模型的遮挡行人重识别

作者信息 +

Person Re-identification Based on Pose Estimation and Transformer Model

Author information +
文章历史 +

摘要

行人重识别(re-identification, ReID)是利用人工智能解决边防检查、人员追踪等公共安全应用问题的技术,具有从跨设备采集的图像中识别某一特定行人的能力。但是在人员追踪等问题中,往往会出现行人刻意遮挡、复杂场景环境遮挡等因素,大大提高了行人重识别的难度。针对行人重识别遮挡问题,基于ResNet50网络,结合姿态估计和Transformer模型,提出了一种改进的行人重识别网络PT-Net,以提高遮挡条件下的行人重识别能力。该方法首先利用现有的姿态估计方法对输入图像进行关键点检测,并将关键点信息与行人特征图像结合起来生成一个基于姿态的行人特征表示;然后利用Transformer模型对基于姿态的行人特征表示编码,用来实现特征对齐和特征融合。基于国际公开的数据集Occluded-Duke开展实验验证。结果表明:PT-Net方法相对于基线模型,其均值平均精度(mAP)和相似度排序Rank-1指标分别提高了1.3、1.5个百分点,验证了该方法的有效性和优越性。

Abstract

Person re-identification (ReID) is a technology that utilizes artificial intelligence to solve public safety application problems such as border inspection and personnel tracking. It has the ability to identify a specific person from images collected across devices. However, in person tracking and other issues, deliberate person occlusion and complex scene environment occlusion greatly increases the difficulty of person re-identification. An improved person re-identification network PT-Net based on ResNet50 network was proposed, which combined with pose estimation and Transformer models to improve the person re-identification ability under occlusion conditions. The existing pose estimation method was utilized to detect key-points in the input image, and combined the key-point information with the person feature maps to generate a pose based person feature representation. Then, the Transformer model was used to encode the pose-based person feature representation for feature alignment and fusion. Based on the internationally available dataset Occluded-Duke, the experimental validation was conducted. The results show that the PT-Net method improves its mean average precision (mAP) and similarity ranking Rank-1 increase by 1.3, 1.5 percentage points compared to the baseline model, respectively, verifying the effectiveness and superiority of the method.

引用本文

引用格式 ▾
陈禹, 刘慧, 梁东升, 张雷. 基于姿态估计和Transformer模型的遮挡行人重识别[J]. 科学技术与工程, 2024, 24(12): 5051-5058 DOI:10.12404/j.issn.1671-1815.2303944
CHEN Yu, LIU Hui, LIANG Dong-sheng, ZHANG Lei. Person Re-identification Based on Pose Estimation and Transformer Model[J]. Science Technology and Engineering, 2024, 24(12): 5051-5058 DOI:10.12404/j.issn.1671-1815.2303944

登录浏览全文

4963

注册一个新账户 忘记密码

参考文献

基金资助

辽宁省科技攻关专项(2022JH1/10800104)

PDF (2002KB)

36

访问

0

被引

详细

导航
相关文章

/

〈 〉