
科学技术与工程

中国技术经济学会
Named Entity Recognition for Chinese Electronic Medical Records Using MacBERT and Global Pointer Network
Tian-yu WU , Dong-dong GUO , Wen-qiao LI , Zi-kang LI , Lin MIAO
Science Technology and Engineering ›› 2025, Vol. 25 ›› Issue (11) : 4656 -4665.
Addressing the limitation of existing sequence labeling approaches in effectively recognizing nested entities within Chinese electronic health records (EHRs), a novel named entity recognition model that integrates MacBERT and a global pointer network was proposed. Initially, the MacBERT-large pre-trained model transformed the text into context-sensitive dynamic vectors. Subsequently, the fast gradient method (FGM) was employed to generate adversarial samples, which were incorporated into the original vectors and fed into a BiLSTM (bi-directional long short-term memory) network to capture contextual features. To enhance the capture of long-distance semantic features, an attention mechanism was introduced. Finally, a global pointer network model was leveraged to decode simultaneously considering both head and tail feature information, thereby achieving superior prediction performance for medical nested entities. Experimental results demonstrate that compared to the state-of-the-art global pointer model, the proposed model achieves an improvement of 1.8%, 1.37%, and 1.72% in F1-score on the CCKS2019 dataset and two versions of the CMeEE Chinese EHR dataset, respectively, validating the effectiveness of the proposed approach.
named entity recognition / Chinese electronic medical record / global pointer network / attention mechanism
/
| 〈 |
|
〉 |