BioSentVec: creating sentence embeddings for biomedical texts
Authors:
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Sentence embeddings have become an essential part of today’s natural language processing (NLP) systems, especially together advanced deep learning methods. Although pre-trained sentence encoders are available in the general domain, none exists for biomedical texts to date. In this work, we introduce BioSentVec: the first open set of sentence embeddings trained with over 30 million documents from both scholarly articles in PubMed and clinical notes in the MIMICIII Clinical Database. We evaluate BioSentVec embeddings in two sentence pair similarity tasks in different biomedical text genres. Our benchmarking results demonstrate that the BioSentVec embeddings can better capture sentence semantics compared to the other competitive alternatives and achieve state-of-the-art performance in both tasks. We expect BioSentVec to facilitate the research and development in biomedical text mining and to complement the existing resources in biomedical word embeddings. The embeddings are publicly available at https://github.com/ncbi-nlp/BioSentVec.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Opportunities and obstacles for deep learning in biology and medicineJournal of The Royal Society Interface, 2018
- A Pilot Study of Biomedical Text Comprehension using an Attention-Based Deep Neural Reader: Design and Experimental AnalysisJMIR Medical Informatics, 2018
- Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features2018
- BIOSSES: a semantic sentence similarity estimation system for the biomedical domainBioinformatics, 2017
- Deep learning for extracting protein-protein interactions from biomedical literature2017
- MIMIC-III, a freely accessible critical care databaseScientific Data, 2016
- Automatic semantic classification of scientific literature according to the hallmarks of cancerBioinformatics, 2015
- A Review on Multi-Label Learning AlgorithmsIEEE Transactions on Knowledge and Data Engineering, 2013
- Representation Learning: A Review and New PerspectivesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Hallmarks of Cancer: The Next GenerationCell, 2011