Multimodal Aspect-based Sentiment Analysis Based on Prompt Learning and Attention Mechanism

Zhen ZENG , Mao-xi LIAO , Nan YANG , Yan LUO , Chao YANG

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (2) : 708 -716.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (2) : 708-716 DOI: 10.12404/j.issn.1671-1815.2500343
research-article
Multimodal Aspect-based Sentiment Analysis Based on Prompt Learning and Attention Mechanism
Author information +
History +
PDF

Abstract

Aiming at the problem that the existing multimodal aspect-based sentiment analysis models have weak correlation between different modalities and it is difficult to effectively utilize the relevant information between them, a multimodal aspect-based sentiment analysis based on prompt learning and attention mechanism was proposed. Firstly, before the text and image features were respectively input into the multi-layer Transformer layer, prompt information was added to the text features and projected into the image features through the coupling function. Secondly, the cross-modal attention mechanism was used for feature fusion, and the irrelevant information in the fusion process was filtered out through BiGRU (bidirectional gated recurrent unit). Then, an attention module guided by aspect information was constructed to strengthen the attention to aspect information. Finally, the sentiment classification results were obtained through the fully connected layer and the softmax classification layer. The model was experimented on the public Twitter-15 and Twitter-17 datasets respectively. The results show that compared with multiple baseline models, the accuracy and F1 value of the proposed model are improved, which proves the effectiveness of the proposed model in the multimodal aspect-based sentiment analysis task.

Graphical abstract

Keywords

aspect-based sentiment analysis / multimodal / prompt learning / feature extraction / attention mechanism / natural language processing

Cite this article

Download citation ▾
Zhen ZENG, Mao-xi LIAO, Nan YANG, Yan LUO, Chao YANG. Multimodal Aspect-based Sentiment Analysis Based on Prompt Learning and Attention Mechanism. Science Technology and Engineering, 2026, 26(2): 708-716 DOI:10.12404/j.issn.1671-1815.2500343

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (3321KB)

20

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉