Multi-stage Face Image Restoration Method Based on CLIP and Attention Mechanism Optimization

Yang ZHAO , Jian-wei DING

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (4) : 1575 -1585.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (4) : 1575-1585 DOI: 10.12404/j.issn.1671-1815.2500712
Papers
Multi-stage Face Image Restoration Method Based on CLIP and Attention Mechanism Optimization
Author information +
History +
PDF

Abstract

The existing face image restoration methods often generate images with structural incoordination and contextual semantic incoherence when dealing with large-area occlusion,and are unable to accurately restore facial details. Aiming at this problem,a multi-stage face image restoration algorithm based on contrastive language-image pre-training (CLIP) and attention mechanism optimization was proposed. First of all,the initial facial recovery was carried out through the codec structure. Then,local feature processing was carried out for the mask-covered areas,and aggregated contextual transformations(AOT) blocks were introduced into the local detail network to enhance the detail reconstruction effect of the facial edges and covered areas. Finally,the pre-trained CLIP model was embedded into the global encoder to capture the overall fine-grained details of the image,and the global facial information was integrated through the attention mechanism to ensure that the restored image meets the requirements of high-quality restoration in terms of global consistency and local details. This method was compared with various algorithms on multiple datasets. The experimental results show that the proposed method performs outstandingly in both subjective and objective evaluations,achieving a better balance between integrating computational efficiency and improving the quality of restoration.

Graphical abstract

Keywords

attention mechanism / face image restoration / contrastive language-image pre-training(CLIP) / multi-stage repair / generative adversarial network

Cite this article

Download citation ▾
Yang ZHAO, Jian-wei DING. Multi-stage Face Image Restoration Method Based on CLIP and Attention Mechanism Optimization. Science Technology and Engineering, 2026, 26(4): 1575-1585 DOI:10.12404/j.issn.1671-1815.2500712

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (17809KB)

18

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉