Fire Accident Information Extraction Method Based on Adversarial Training and Multi-head Attention Mechanism

Bao-xi ZHAO , Ming-da WANG , Gao-qiang LENG

Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (3) : 1307 -1313.

PDF
Science Technology and Engineering ›› 2026, Vol. 26 ›› Issue (3) : 1307-1313 DOI: 10.12404/j.issn.1671-1815.2501485
research-article
Fire Accident Information Extraction Method Based on Adversarial Training and Multi-head Attention Mechanism
Author information +
History +
PDF

Abstract

In order to tackle the challenges of uneven entity distribution and fuzzy boundaries in fire accident information extraction, a fire information extraction model RA-BMAF (residual attention-based multi-head fusion) based on adversarial training and multi-head attention mechanism was proposed. A total of 264 fire accident reports were used as samples for entity labeling, and fire text test data were constructed. The RoBERTa-wwn-ext model was employed to generate dynamic word vectors, and adversarial samples were generated by perturbing these vectors through adversarial training. These samples were then co-embedded with the original inputs for joint training, thereby alleviating the problem of entity distribution imbalance in fire samples. Additionally, in the feature extraction layer, the multi-head attention mechanism was incorporated to further optimize the weight distribution of the sequence features extracted by the BiGRU (bidirectional gated recurrent unit) model and to enhance focus on the fuzzy boundaries of entities. In the decoding layer, conditional random fields were used to predict the sequence features. The results show that the model achieved precision, recall, and F1 scores of 83.10%, 91.13%, and 86.89%, respectively, outperforming the RoBERTa-wwn-ext-BiGRU-CRF (conditional random field) baseline model. It is concluded that the proposed approach significantly enhances the entity extraction process by addressing both entity imbalance and fuzzy boundaries in fire accident reports.

Graphical abstract

Keywords

fire accident text / named entity recognition / natural language processing / multi-head attention mechanism / FGM adversarial training

Cite this article

Download citation ▾
Bao-xi ZHAO, Ming-da WANG, Gao-qiang LENG. Fire Accident Information Extraction Method Based on Adversarial Training and Multi-head Attention Mechanism. Science Technology and Engineering, 2026, 26(3): 1307-1313 DOI:10.12404/j.issn.1671-1815.2501485

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (3453KB)

18

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉