Character-Level Embedding using FastText and LSTM for Biomedical Named Entity Recognition
Open Access
- 1 October 2024
- journal article
- research article
- Published by Scalable Computing: Practice and Experience in Scalable Computing: Practice and Experience
- Vol. 25 (6) , 5258-5264
Abstract
Extracting biomedical entities has caught many researchers’ attention in which the recent technique of word embedding is employed for such a task. Yet, the traditional word embedding architectures of Word2vec or Glove are still suffering from the ‘out-of-vocabulary’ (OOV) problem. This problem occurs when an unseen term might be encountered during the testing which leads to absence of embedding vector. Hence, this study aims to propose a character-level embedding through FastText architecture. In fact, handling the character-level seems a promising solution for the OOV problem. To this end, the proposed FastText architecture has been used to generate embedding vectors for the possible N-gram combinations of each word. Consequentially, these vectors have been fed to a Long Short Term Memory (LSTM) architecture for classifying the words into its biomedical classes. Using two benchmark datasets of BioCreative-II and NCBI, the proposed method was able to produce an f-measure of 0.912 and 0.918 respectively. Comparing these results with the baseline studies demonstrates the superiority of the proposed character-level embedding of FastText in terms of Biomedical Named Entity Recognition (BNER) task.Keywords
This publication has 11 references indexed in Scilit:
- Hierarchical shared transfer learning for biomedical named entity recognitionBMC Bioinformatics, 2022
- Deep learning methods for biomedical named entity recognition: a survey and qualitative comparisonBriefings in Bioinformatics, 2021
- Named Entity Recognition and Relation ExtractionACM Computing Surveys, 2021
- Biomedical named entity recognition using deep neural networks with contextual informationBMC Bioinformatics, 2019
- Character convolutions for Arabic Named Entity Recognition with Long Short-Term Memory NetworksComputer Speech & Language, 2019
- Named entity recognition from Chinese adverse drug event reports with lexical feature based BiLSTM-CRF and tri-trainingJournal of Biomedical Informatics, 2019
- GRAM-CNN: a deep learning approach with local context for named entity recognition in biomedical textBioinformatics, 2017
- Character-level neural network for biomedical named entity recognitionJournal of Biomedical Informatics, 2017
- NCBI disease corpus: A resource for disease name recognition and concept normalizationJournal of Biomedical Informatics, 2014
- Overview of BioCreative II gene mention recognitionGenome Biology, 2008