融合N-Gram和多重注意力机制的能源领域新词发现方法

王祎涵 ,  张思佳 ,  曹恒 ,  刘珈宁 ,  张正龙

科学技术与工程 ›› 2025, Vol. 25 ›› Issue (18) :7668-7677

PDF (6848KB)
科学技术与工程 ›› 2025, Vol. 25 ›› Issue (18) :7668-7677 DOI: 10.12404/j.issn.1671-1815.2404063
自动化技术、计算机技术

融合N-Gram和多重注意力机制的能源领域新词发现方法

作者信息 +

New Word Discovery Method in the Energy Field Combining N-Gram and Multiple Attention Mechanism

Author information +
文章历史 +

摘要

随着能源行业的快速发展和技术革新,大量的专业术语和表达方式不断更新,新词不断涌现。然而,传统的新词发现方法通常依赖于词典或规则,且难以高效率地处理和更新大量的专业术语,特别是在快速变化的能源领域。因此,结合能源领域文本数据特性,提出了一种融合N-Gram和多重注意力机制的能源领域新词发现方法(new word discovery method in the energy field combining N-Gram and multiple attention mechanism, ENFM)。该方法首先利用N-Gram模型对能源领域的文本数据进行初步处理,通过统计和分析词频来生成新词候选列表。随后,引入融合多重注意力机制的ERNIE-BiLSTM-CRF模型,以进一步提升新词发现的准确性和效率。与传统的新词发现技术相比,在新词的准确识别和整体效率上均有显著提升,将其于能源领域政策文本数据集,准确率、召回率和F1分别为95.71%、95.56%、95.63%。实验结果表明,该方法能够准确地在能源领域的大量文本数据中识别新词,有效识别出能源领域特有的词汇和表达方式,显著提高了中文分词任务中对能源领域专业术语的识别能力。

Abstract

With the rapid development of the energy industry and technological innovation, a large number of professional terms and expressions are constantly updated, and new words continue to emerge. However, traditional neologism discovery methods often rely on dictionaries or rules, and it is difficult to efficiently process and update a large number of specialized terms, especially in the rapidly changing energy field. Therefore, combined with the characteristics of text data in the energy field, a new word discovery method in ENFM(energy field combining N-Gram and multiple attention mechanism) was proposed. Firstly, the N-Gram model was used to process the text data in the field of energy, and the candidate list of new words was generated by statistics and analysis of word frequency. Subsequently, the ERNIE-BiLSTM-CRF model integrating multiple attention mechanism was introduced to further improve the accuracy and efficiency of neologism discovery. Compared with the traditional neologism discovery technology, the accurate identification and overall efficiency of neologism have been significantly improved. The accuracy rate, recall rate and F1 value of neologism in the data set of policy text in the energy field are 95.71%, 95.56% and 95.63%, respectively. The experimental results show that this method can accurately identify new words in a large number of text data in the field of energy, effectively identify the specific words and expressions in the field of energy, and significantly improve the recognition ability of professional terms in the field of energy in Chinese word segmentation tasks.

关键词

能源领域 / 新词发现 / 预训练模型 / N-Gram / 中文分词

Key words

energy field / new word discovery / pre-trained model / N-Gram / Chinese word segmentation

引用本文

引用格式 ▾
王祎涵, 张思佳, 曹恒, 刘珈宁, 张正龙. 融合N-Gram和多重注意力机制的能源领域新词发现方法[J]. 科学技术与工程, 2025, 25(18): 7668-7677 DOI:10.12404/j.issn.1671-1815.2404063
WANG Yi-han, ZHANG Si-jia, CAO Heng, LIU Jia-ning, ZHANG Zheng-long. New Word Discovery Method in the Energy Field Combining N-Gram and Multiple Attention Mechanism[J]. Science Technology and Engineering, 2025, 25(18): 7668-7677 DOI:10.12404/j.issn.1671-1815.2404063

登录浏览全文

4963

注册一个新账户 忘记密码

参考文献

基金资助

辽宁省教育厅高等学校基本科研项目面上项目(LJKMZ20221095)

辽宁省重点研发计划(2023JH26/10200015)

中国科学院战略性先导科技专项(A类)(XDA21000000)

PDF (6848KB)

37

访问

0

被引

详细

导航
相关文章

/

〈 〉