Infrared and Visible Image Registration Based on Compound 2S Network

Bo-wen ZHENG , Zhuo WANG , Xin-yu CAO

Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (16) : 6783 -6791.

PDF
Science Technology and Engineering ›› 2024, Vol. 24 ›› Issue (16) : 6783-6791 DOI: 10.12404/j.issn.1671-1815.2304805
research-article
Infrared and Visible Image Registration Based on Compound 2S Network
Author information +
History +
PDF

Abstract

Aiming at the problem that traditional image registration methods have poor effect in infrared and visible image registration tasks. A feature matching method based on Superpoint + Superglue (2S) composite network was proposed for infrared and visible image registration. The method first used Superpoint's unique feature extraction method to fully extract common features between infrared and visible light images. Secondly, the idea of adding matching constraints and using attention mechanism in Superlube feature matching method was used to give full play to the advantages of neural network and improve the matching efficiency. In the training phase, the method of using self built datasets was used to improve the generalization and accuracy of the neural network. The results show that the repeatability and accuracy scores of traditional registration methods for feature point extraction on three sets of experimental images are (0.006 7, 0.006 1), (0.001 0, 0.000 8), and (0, 0), respectively. The correct matching logarithms of feature points are 7 pairs, 1 pair, and 0 pairs, with an average number lower than the minimum four matching point pairs required to estimate the transformation matrix. The scores of infrared and visible image registration methods based on Superpoint + Superglue are (0.240 2, 0.262 5), (0.193 9, 0.172 2), (0.263 0, 0.264 4), and the correct matching logarithms of feature points are 252, 165, and 252 pairs. The evaluation index of feature point extraction and the number of correct matching of feature point pairs are significantly increased compared with traditional methods, which can better complete the registration task.

Cite this article

Download citation ▾
Bo-wen ZHENG, Zhuo WANG, Xin-yu CAO. Infrared and Visible Image Registration Based on Compound 2S Network. Science Technology and Engineering, 2024, 24(16): 6783-6791 DOI:10.12404/j.issn.1671-1815.2304805

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (2889KB)

16

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉