Abstract
Percutaneous coronary intervention (PCI) is a vital treatment method for coronary artery disease, but the unstructured nature of its clinical data makes it challenging to utilize directly. The data for this study was obtained from the Cardiovascular Treatment Center of the People’s Hospital of Liaoning Province, China. A representative dataset of 5.8% of PCI patients’ surgical records was selected for labeling, and a language model-based PCI surgical information entity recognition model was developed. First, Encoder Representations from Transformers (BERT) was employed to express the semantic relationship between characters accurately. Then, BiLSTM was used as a feature extractor to extract contextual relations, and finally, conditional random field (CRF) was applied to optimize the prediction results. Experimental results demonstrated that the F1 score in the PCI surgical information entity recognition model reached 85.49%, which is 25.66% higher than the traditional HMM and 0.94% higher than BiLSTM in deep learning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Grishman R, Sundheim BM (1996) Message understanding conference-6: a brief history. In: COLING 1996: the 16th international conference on computational linguistics, vol 1
Song M, Yu H, Han WS (2015) Developing a hybrid dictionary-based bio-entity recognition technique. BMC Med Inf Decis Making 15(1):1–8
McCallum A, Li W (2003) Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons
Chieu HL, Ng HT (2002) Named entity recognition: a maximum entropy approach using global information. In: COLING 2002: the 19th international conference on computational linguistics
Bender O, Och FJ, Ney H (2003) Maximum entropy models for named entity recognition. In: Proceedings of the seventh conference on natural language learning at HLT-NAACL 2003, pp 148–151
Wang X, Zhang Y, Ren X, Zhang Y, Zitnik M, Shang J, Langlotz C, Han J (2019) Cross-type biomedical named entity recognition with deep multi-task learning. Bioinformatics 35(10):1745–1752
Cai X, Dong S, Hu J (2019) A deep learning model incorporating part of speech and self-matching attention for named entity recognition of chinese electronic medical records. BMC Med Inf Decis Making 19(2):101–109
Li L, Jiang Y (2018) Integrating language model and reading control gate in BLSTM-CRF for biomedical named entity recognition. IEEE/ACM Trans Comput Biol Bioinform 17(3):841–846
Chen X, Ouyang C, Liu Y, Bu Y (2020) Improving the named entity recognition of Chinese electronic medical records by combining domain dictionary and rules. Int J Environ Res Publ Health 17(8):2687
Devlin J, Chang MW, Lee K, Toutanova K (2018) BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Process Syst 26
Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543
Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Trans Assoc Comput Linguist 5:135–146
Viterbi AJ (2006) A personal history of the Viterbi algorithm. IEEE Sig Process Mag 23(4):120–142
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zheng, Y., Wang, L., Li, F., Xu, H., Ge, J. (2024). Named Entity Recognition of PCI Surgery Information Based on BERT+BiLSTM+CRF. In: Wang, W., Liu, X., Na, Z., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2023. Lecture Notes in Electrical Engineering, vol 1032. Springer, Singapore. https://doi.org/10.1007/978-981-99-7505-1_11
Download citation
DOI: https://doi.org/10.1007/978-981-99-7505-1_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7539-6
Online ISBN: 978-981-99-7505-1
eBook Packages: EngineeringEngineering (R0)