Named Entity Recognition for Chinese Electronic Medical Records Using MacBERT and Global Pointer Network

Tian-yu WU , Dong-dong GUO , Wen-qiao LI , Zi-kang LI , Lin MIAO

Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (11) : 4656 -4665.

PDF
Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (11) : 4656-4665 DOI: 10.12404/j.issn.1671-1815.2403519
research-article
Named Entity Recognition for Chinese Electronic Medical Records Using MacBERT and Global Pointer Network
Author information +
History +
PDF

Abstract

Addressing the limitation of existing sequence labeling approaches in effectively recognizing nested entities within Chinese electronic health records (EHRs), a novel named entity recognition model that integrates MacBERT and a global pointer network was proposed. Initially, the MacBERT-large pre-trained model transformed the text into context-sensitive dynamic vectors. Subsequently, the fast gradient method (FGM) was employed to generate adversarial samples, which were incorporated into the original vectors and fed into a BiLSTM (bi-directional long short-term memory) network to capture contextual features. To enhance the capture of long-distance semantic features, an attention mechanism was introduced. Finally, a global pointer network model was leveraged to decode simultaneously considering both head and tail feature information, thereby achieving superior prediction performance for medical nested entities. Experimental results demonstrate that compared to the state-of-the-art global pointer model, the proposed model achieves an improvement of 1.8%, 1.37%, and 1.72% in F1-score on the CCKS2019 dataset and two versions of the CMeEE Chinese EHR dataset, respectively, validating the effectiveness of the proposed approach.

Keywords

named entity recognition / Chinese electronic medical record / global pointer network / attention mechanism

Cite this article

Download citation ▾
Tian-yu WU, Dong-dong GUO, Wen-qiao LI, Zi-kang LI, Lin MIAO. Named Entity Recognition for Chinese Electronic Medical Records Using MacBERT and Global Pointer Network. Science Technology and Engineering, 2025, 25(11): 4656-4665 DOI:10.12404/j.issn.1671-1815.2403519

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

PDF (4085KB)

18

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉