- 1 February 2010
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in Journal of Bioinformatics and Computational Biology
- Vol. 08 (01) , 163-179
Abstract
The CALBC initiative aims to provide a large-scale biomedical text corpus that contains semantic annotations for named entities of different kinds. The generation of this corpus requires that the annotations from different automatic annotation systems be harmonized. In the first phase, the annotation systems from five participants (EMBL-EBI, EMC Rotterdam, NLM, JULIE Lab Jena, and Linguamatics) were gathered. All annotations were delivered in a common annotation format that included concept identifiers in the boundary assignments and that enabled comparison and alignment of the results. During the harmonization phase, the results produced from those different systems were integrated in a single harmonized corpus ("silver standard" corpus) by applying a voting scheme. We give an overview of the processed data and the principles of harmonization — formal boundary reconciliation and semantic matching of named entities. Finally, all submissions of the participants were evaluated against that silver standard corpus. We found that species and disease annotations are better standardized amongst the partners than the annotations of genes and proteins. The raw corpus is now available for additional named entity annotations. Parts of it will be made available later on for a public challenge. We expect that we can improve corpus building activities both in terms of the numbers of named entity classes being covered, as well as the size of the corpus in terms of annotated documents.Keywords
This publication has 8 references indexed in Scilit:
- High-performance gene name normalization with GeNoBioinformatics, 2009
- Evaluation of text-mining systems for biology: overview of the Second BioCreative community challengeGenome Biology, 2008
- Text processing through Web services: calling WhatizitBioinformatics, 2007
- OSIRIS: a tool for retrieving literature about sequence variantsBioinformatics, 2006
- Overview of BioCreAtIvE: critical assessment of information extraction for biologyBMC Bioinformatics, 2005
- ABNER: an open source tool for automatically tagging genes, proteins and other entity names in textBioinformatics, 2005
- Exploring semantic groups through visual approachesJournal of Biomedical Informatics, 2003
- Multiple classifier decision combination strategies for character recognition: A reviewInternational Journal on Document Analysis and Recognition (IJDAR), 2003