Research on named entity recognition of traditional Chinese medicine based on feature enhancement

doi:10.3969/j.issn.1000-1565.2024.02.011

Abstract

Abstract: Traditional Chinese medicine(TCM)herbal literature contains rich knowledge of TCM and is an important carrier of theoretical research in TCM. In order to better explore the knowledge of TCM herbal literature and accurately achieve the task of named entity recognition in TCM herbal literature, a Bert-BiGRU-CRF named entity recognition model for TCM herbal literature based on feature enhancement is proposed, which uses a feature fusion tool to concatenate the word vector generated by Bert with entity features as input, With Bi directional gated recurrent unit(BiGRU)as the feature extractor and Conditional random field(CRF)as the tag prediction, the method of feature enhancement is used to better identify the entities and their boundary information such as the name, property, taste and meridian tropism of TCM herbs, and complete the task of naming entities of TCM herbs. The experimental results on the dataset of TCM herbs show that the F1 value of the model incorporating features reaches 90.54%,- DOI:10.3969/j.issn.1000-1565.2024.02.011基于特征增强的中医本草命名实体识别方法马月坤^1,2,吴国仲¹(1.华北理工大学人工智能学院,河北省工业智能感知重点实验室,河北唐山 063210;2.北京科技大学计算机与通信工程学院,材料领域知识工程北京市重点实验室,北京 100083)摘要:传统中医本草文献含有丰富的中医知识,是中医理论研究的重要载体.为了更好地挖掘中医本草知识,精准地实现中医本草文献命名实体识别任务,提出了一种基于特征增强的Bert-BiGRU-CRF中医本草命名实体识别模型,使用特征融合器拼接Bert生成的词向量与实体特征作为输入,以双向门控循环单元(bi-directional gated recurrent unit,BiGRU)为特征提取器,以条件随机场(conditional random fields,CRF)进行标签预测,通过特征增强的方法更好地识别中医本草的药名、药性、药味、归经等实体及其边界信息,完成中医本草命名实体任务.在中医本草数据集上的实验结果表明,融入特征的模型F1值达到了90.54%,证明了所提出的方法可以更好地提高中医本草命名实体识别精度.关键词:命名实体识别;中草药;特征增强;词典信息中图分类号:TP391.1;R271.14 文献标志码:A 文章编号:1000-1565(2024)02-0199-09Research on named entity recognition of traditional Chinese medicine based on feature enhancementMA Yuekun^1,2, WU Guozhong¹(1. Hebei Key Laboratory of Industrial Intelligent Perception, Institute for Artificial Intelligence, North China University of Science and Technology, Tangshan 063210, China;2. Beijing Key Laboratory of Knowledge Engineering in the Field of Materials, Institute for Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China)Abstract: Traditional Chinese medicine(TCM)herbal literature contains rich knowledge of TCM and is an important carrier of theoretical research in TCM. In order to better explore the knowledge of TCM herbal literature and accurately achieve the task of named entity recognition in TCM herbal literature, a Bert-BiGRU-CRF named entity recognition model for TCM herbal literature based on feature enhancement is proposed, which uses a feature fusion tool to concatenate the word vector generated by Bert with entity features as input, With Bi directional gated recurrent unit(BiGRU)as the feature extractor and Conditional random field(CRF)as the tag prediction, the method of feature enhancement is used to better identify the entities and their boundary information such as the name, property, taste and meridian tropism of TCM herbs, and complete the task of naming entities of TCM herbs. The experimental results on the dataset of TCM herbs show that the F1 value of the model incorporating features reaches 90.54%,- 收稿日期:2023-01-10;修回日期:2023-04-26 基金项目:河北省三三三人才项目(A201803082) 第一作者:马月坤(1976—),女,华北理工大学教授,博士,主要从事自然语言处理. E-mail:mayuekun@163.com第2期马月坤等:基于特征增强的中医本草命名实体识别方法proving that the proposed method can better improve the accuracy of named entity recognition in TCM herbs.

Key words: named entity recognition, Chinese herbal medicine, feature enhancement, dictionary information

CLC Number:

MA Yuekun, WU Guozhong. Research on named entity recognition of traditional Chinese medicine based on feature enhancement[J]. Journal of Hebei University(Natural Science Edition), 2024, 44(2): 199-207.

References

[1] 康怡琳,孙璐冰,朱容波,等.深度学习中文命名实体识别研究综述[J].华中科技大学学报(自然科学版),2022,50(11):44-53. DOI:10.13245/j.hust.221104.
[2] 肖瑞,胡冯菊,裴卫.基于BiLSTM-CRF的中医文本命名实体识别[J].世界科学技术-中医药现代化,2020,22(7):2504-2510. DOI:10.11842/wst.20190513001.
[3] 李学良.基于知识图谱的中医药问答系统的研究与实现[D].青岛:青岛大学,2021. DOI:10.27262/d.cnki.gqdau.2021.001635.
[4] FRIEDMAN C, ALDERSON P O, AUSTIN J H, et al. A general natural-language text processor for clinical radiology[J]. Journal of the American Medical Informatics Association, 1994, 1(2): 161-174. DOI:10.1136/jamia.1994.95236146.
[5] ZHOU G D, SU J. Named entity recognition using an HMM-based chunk tagger[C] //Proceedings of the 40th Annual Meeting on Association for Fomputational Linguistics. ACM, 2002: 473-480. DOI:10.3115/1073083.1073163.
[6] WU Y C, FAN T K, LEE Y S, et al. Extracting named entities using support vector machines[M] //BREMER E G, HAKENBERG J, HAN E H, et al, eds. Knowledge Discovery in Life Science Literature. Berlin, Heidelberg: Springer Berlin Heidelberg, 2006: 91-103. DOI: 10.1007/11683568_8.
[7] HAN L, WANG L, ZHANG W, et al. Rockhead profile simulation using an improved generation method of conditional random field[J]. Journal of Rock Mechanics and Geotechnical Engineering, 2022, 14(3): 896-908. DOI:10.1016/j.jrmge.2021.09.007.
[8] KOWSHER M, SAMI A A, PROTTASHA N J, et al. Bangla-BERT: transformer-based efficient model for transfer learning and language understanding[J]. IEEE Access, 2022, 10: 91855-91870. DOI:10.1109/ACCESS.2022.3197662.
[9] QU Q Q, KAN H X, WU Y T, et al. Named entity recognition of TCM text based on bert model[C] //2020 7th International Forum on Electrical Engineering and Automation(IFEEA). Hefei, China. IEEE, 2020: 652-655. DOI: 10.1109/IFEEA51475.2020.00139.
[10] QIN Q L, ZHAO S, LIU C M. A BERT-BiGRU-CRF model for entity recognition of Chinese electronic medical records[J]. Complexity, 2021, 2021: 6631837 DOI:10.1155/2021/6631837.
[11] TONG B A, PAN J, ZHENG L X, et al. Research on Named Entity Recognition Based on Bert-BiGRU-CRF model in Spacecraft Field[C] //2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology(CEI). Fuzhou, China IEEE, 2021: 747-753. DOI: 10.1109/CEI52496.2021.9574470.
[12] 谢靖,刘江峰,王东波.古代中国医学文献的命名实体识别研究: 以Flat-lattice增强的SikuBERT预训练模型为例[J].图书馆论坛, 2022, 42(10): 51-60. DOI: 10.3969/j.issn.1002-1167.2022.10.008.
[13] 陈淑振,窦全胜,唐焕玲等.基于词融合与跨度检测的中文嵌套命名实体识别[J].计算机应用研究,2023,40(8):2382-2386+2392.DOI:10.19734/j.issn.1001-3695.2022.11.0767.
[14] 李宝昌,郭卫斌.词典信息分层调整的中文命名实体识别方法[J].华东理工大学学报(自然科学版), 2023, 49(2): 276-283. DOI: 10.14135/j.cnki.1006-3080.20211105003.
[15] 赵萍.基于特征增强的中文命名实体识别方法研究[D].烟台:山东工商学院,2022. DOI:10.27903/d.cnki.gsdsg.2022.000146.
[16] 雷迪.面向中医药知识图谱的命名实体识别及关系抽取[D].石家庄: 河北地质大学, 2022.
[17] LI J Y, FEI H, LIU J, et al. Unified named entity recognition as word-word relation classification[J]. Proc AAAI Conf Artif Intell, 2022, 36(10): 10965-10973. DOI: 10.1609/aaai.v36i10.21344.
[18] LIU J, JI D H, LI J Y, et al. TOE: a grid-tagging discontinuous NER model enhanced by embedding tag/word relations and more fine-grained tags[J]. IEEE/ACM Trans Audio Speech Lang Process, 31: 177-187. DOI: 10.1109/TASLP.2022.3221009.
[19] WARTO, MULJONO, PURWANTO, et al. Capitalization feature and learning rate for improving NER based on RNN BiLSTM-CRF[C] //2022 IEEE International Conference on Cybernetics and Computational Intelligence(CyberneticsCom). Malang, Indonesia. IEEE, 2022: 398-403. DOI: 10.1109/CyberneticsCom55287.2022.9865660.
[20] PARK C, JEONG S, KIM J. ADMit: improving NER in automotive domain with domain adversarial training and multi-task learning[J]. Expert Syst Appl, 2023, 225: 120007. DOI: 10.1016/j.eswa.2023.120007.
[21] DENG N, FU H, CHEN X. Named entity recognition of traditional Chinese medicine patents based on BiLSTM-CRF[J]. Wirel Commun Mob Comput, 2021, 2021: 6696205. DOI: 10.1155/2021/6696205.
[22] ZHANG M Z, YANG Z G, LIU C, et al. Traditional Chinese Medicine Knowledge Service based on Semi-Supervised BERT-BiLSTM-CRF Model[C] //2020 International Conference on Service Science(ICSS). Xining, China. IEEE, 2020: 64-69. DOI: 10.1109/ICSS50103.2020.00018. (