The OWL Reasoner Evaluation (ORE) 2015 Competition Report
Open Access
- 21 February 2017
- journal article
- research article
- Published by Springer Nature in Journal of Automated Reasoning
- Vol. 59 (4) , 455-482
Abstract
The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we discuss the design, execution and results of the 2015 competition with particular attention to lessons learned for benchmarking, comparative experiments, and future competitions.Keywords
Funding Information
- University of Manchester
This publication has 26 references indexed in Scilit:
- Description LogicsIEEE Intelligent Systems, 2013
- The Incredible ELKJournal of Automated Reasoning, 2013
- The Drosophila phenotype ontologyJournal of Biomedical Semantics, 2013
- How Ontologies Can Improve Semantic Interoperability in Health Care2013
- A Snapshot of the OWL WebLecture Notes in Computer Science, 2013
- OBML – Ontologies in Biomedicine and Life SciencesJournal of Biomedical Semantics, 2011
- The TPTP Problem Library and Associated InfrastructureJournal of Automated Reasoning, 2009
- BioPortal: ontologies and integrated data resources at the click of a mouseNucleic Acids Research, 2009
- Pellet: A practical OWL-DL reasonerJournal of Web Semantics, 2007
- A Little Semantic Web Goes a Long Way in BiologyLecture Notes in Computer Science, 2005