Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition

Aishanjiang YINGTEZHAER , Yaermaimaiti YIlIHAMU·

Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (2) : 695 -703.

PDF
Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (2) : 695-703 DOI: 10.12404/j.issn.1671-1815.2401917
research-article
Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition
Author information +
History +
PDF

Abstract

Aiming at the shortcomings of low-quality face recognition algorithms based on unified feature space, such as poor robustness to low-quality faces and limited feature representation capability, a low-quality face image recognition algorithm based on knowledge distillation was proposed. First, the ResNeXt network was used as the backbone feature extraction network, and the two-channel attention module was introduced to construct a teacher-student knowledge distillation framework with an attention mechanism. Secondly, the output features of the teacher network were adopted as labeled knowledge, and the effective recognition features were passed to the student network. And the attention graph features were adopted as the intermediate layer knowledge to solve the lack of single knowledge information in the output layer, and the feature knowledge was enriched by combining two kinds of knowledge distillation to ensure the diversity of knowledge information in the teacher network model. Then, the weighted average of labeled knowledge distillation loss, attention graph distillation loss, and recognition loss were fused as the total network loss function to ensure that the student network model has a better learning ability. Finally, tested under different quality images in AgeDB-30 and CPLFW test sets, the results of the ablation experiments show that compared to the generic face recognition model without distillation, the model with two types of knowledge distillation gains 2.25%, 11.33%, 24.64% and 2.8%, 10.58%, 27.85% improvement in recognition accuracy, respectively. Comparative experiments show that the algorithm proposed in this paper also obtains different degrees of improvement in accuracy compared to other mainstream algorithms.

Keywords

low quality face images / knowledge distillation / attention mechanism / Resnext

Cite this article

Download citation ▾
Aishanjiang YINGTEZHAER, Yaermaimaiti YIlIHAMU·. Knowledge Distillation Based Algorithm for Low Quality Face Image Recognition. Science Technology and Engineering, 2025, 25(2): 695-703 DOI:10.12404/j.issn.1671-1815.2401917

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (8394KB)

18

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉