State Space Model-based Deep Multi-task Learning for Face Attribute Recognition Method

Yao TANG , Biao XU , Guan-ci YANG

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (11) : 4750 -4757.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (11) : 4750-4757 DOI: 10.12404/j.issn.1671-1815.2502781
research-article
State Space Model-based Deep Multi-task Learning for Face Attribute Recognition Method
Author information +
History +
PDF

Abstract

Face attributes are represented as human-interpretable visual characteristics in facial images, and the accurate recognition of facial attributes is regarded as the foundation for human-robot interaction in embodied robots. To enable the simultaneous recognition of facial expressions, facial features, skin tone, age, and other facial attributes, a state space model-based deep multi-task learning method for face attribute recognition (SSM-FAR) was proposed. Firstly, ConvNext's capability to encode local image features was leveraged in SSM-FAR, so that fine-grained image features were fully encoded by the backbone network for facial attribute recognition. In addition, a feature fusion module was employed to enhance the model's ability to recognize multi-scale and complex features. Secondly, a feature enhancement module based on the state space model was utilized to compensate for the backbone network's inadequacy in encoding global features. Our method reached accurate classification of facial expressions and the remaining 40 facial attributes in multi-task for face attribute recognition. Experimental results show that average accuracy rates of 91.70%, 86.73%, 91.23% and 66.51%are achieved on the CelebA, LFW-A, RAF-DB, and AffectNet datasets, and that SSM-FAR outperforms all compared state-of-the-art methods.

Graphical abstract

Keywords

facial attribute recognition / multi-task learning / convolutional neural network / state space model

Cite this article

Download citation ▾
Yao TANG, Biao XU, Guan-ci YANG. State Space Model-based Deep Multi-task Learning for Face Attribute Recognition Method. Science Technology and Engineering, 2026, 26(11): 4750-4757 DOI:10.12404/j.issn.1671-1815.2502781

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (4859KB)

27

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉