Biomedical Word Sense Disambiguation with Contextualized Representation Learning
Authors:
Open Access
- 25 April 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 843-848
Abstract
Representation learning is an important component in solving most Natural Language Processing (NLP) problems, including Word Sense Disambiguation (WSD). The WSD task tries to find the best meaning in a knowledge base for a word with multiple meanings (ambiguous word). WSD methods choose this best meaning based on the context, i.e., the words around the ambiguous word in the input text document. Thus, word representations may improve the effectiveness of the disambiguation models if they carry useful information from the context and the knowledge base. Most of the current representation learning approaches are that they are mostly trained on the general English text and are not domain specified. In this paper, we present a novel contextual-knowledge base aware sense representation method in the biomedical domain. The novelty in our representation is the integration of the knowledge base and the context. This representation lies in a space comparable to that of contextualized word vectors, thus allowing a word occurrence to be easily linked to its meaning by applying a simple nearest neighbor approach. Comparing our approach with state-of-the-art methods shows the effectiveness of our method in terms of text coherence.Keywords
This publication has 22 references indexed in Scilit:
- Deep Contextualized Word Representations2018
- Neural Sequence Learning Models for Word Sense Disambiguation2017
- Entity disambiguation to Wikipedia using collective rankingInformation Processing & Management, 2016
- context2vec: Learning Generic Context Embedding with Bidirectional LSTM2016
- Mining Missing Hyperlinks from Human Navigation Traces2015
- Random Walks for Knowledge-Based Word Sense DisambiguationComputational Linguistics, 2014
- A Unified Model for Word Sense Representation and Disambiguation2014
- Word Sense Disambiguation Based on Wikipedia Link Structure2009
- A method for disambiguating word senses in a large corpusComputers and the Humanities, 1992
- Introduction to WordNet: An On-line Lexical Database*International Journal of Lexicography, 1990