Multimodal Feature Fusion for Fine-grained Weakly Supervised Video Anomaly Detection

Xin-yi ZHANG , Te-li LIU , Wen-bin LI , Fang GUO

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (30) : 13134 -13144.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (30) : 13134-13144 DOI: 10.12404/j.issn.1671-1815.2507807
Papers
Multimodal Feature Fusion for Fine-grained Weakly Supervised Video Anomaly Detection
Author information +
History +
PDF

Abstract

To address the limitations of existing video anomaly detection methods in fine-grained anomaly event prediction, a CLIP-based multimodal feature fusion method for fine-grained weakly supervised video anomaly detection, named ClipFusionVAD, was proposed. First, features from video frames and text were extracted separately using the pre-trained CLIP model. A feature aggregator and a feature projector were designed to achieve multi-dimensional feature fusion, enhancing the representation capability of multimodal features and enabling accurate fine-grained anomaly event classification. Furthermore, GAM (global attention module), which combines channel and spatial attention mechanisms, was introduced to improve the discriminative power of visual features. Experimental results demonstrate that ClipFusionVAD achieves outstanding performance on fine-grained anomaly detection tasks, with mAP attaining 9.4% on the UCF-Crime dataset and 28.07% on the XD-Violence dataset, which further verifies the effectiveness of the proposed method.

Graphical abstract

Keywords

video anomaly detection / fine-grained anomaly detection / global attention module / multi-modal feature fusion

Cite this article

Download citation ▾
Xin-yi ZHANG, Te-li LIU, Wen-bin LI, Fang GUO. Multimodal Feature Fusion for Fine-grained Weakly Supervised Video Anomaly Detection. Science Technology and Engineering, 2026, 26(30): 13134-13144 DOI:10.12404/j.issn.1671-1815.2507807

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (7315KB)

7

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉