Dan Sullivan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Dan Sullivan has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
- Bruno Walther Santos Sobral
One Health Institute, Colorado State University, Fort Collins, CO, USA
3 shared publications BalaKrishna Kolluru
School of Computer Science, University of Manchester, Manchester, United Kingdom
1 shared publicationChunhong Mao
Virginia Bioinformatics Institute at Virginia Tech, Blacksburg, Virginia, United States of America
1 shared publication- Chunhong Mao
Virginia Bioinformatics Institute, Virginia Tech, Blacksburg, VA 24061, USA
1 shared publication - Chunxia Wang
Virginia Bioinformatics Institute, Virginia Tech, Blacksburg, Virginia, USA
1 shared publication Gina-Anne Levow
School of Computer Science, University of Manchester, Manchester, United Kingdom
1 shared publication
Latest Publications
- Open Access
- 26 June 2012
- Published by Springer Nature in BMC Bioinformatics
- Vol. 13 (S11) , S2
Overview of the ID, EPI and REL tasks of BioNLP Shared Task 2011
We present the preparation, resources, results and analysis of three tasks of the BioNLP Shared Task 2011: the main tasks on Infectious Diseases (ID) and Epigenetics and Post-translational Modifications (EPI), and the supporting task on Entity Relations (REL). The two main tasks represent extensions of the event extraction model introduced in the BioNLP Shared Task 2009 (ST'09) to two new areas of biomedical scientific literature, each motivated by the needs of specific biocuration tasks. The ID task concerns the molecular mechanisms of infection, virulence and resistance, focusing in particular on the functions of a class of signaling systems that are ubiquitous in bacteria. The EPI task is dedicated to the extraction of statements regarding chemical modifications of DNA and proteins, with particular emphasis on changes relating to the epigenetic control of gene expression. By contrast to these two application-oriented main tasks, the REL task seeks to support extraction in general by separating challenges relating to part-of relations into a subproblem that can be addressed by independent systems. Seven groups participated in each of the two main tasks and four groups in the supporting task. The participating systems indicated advances in the capability of event extraction methods and demonstrated generalization in many aspects: from abstracts to full texts, from previously considered subdomains to new ones, and from the ST'09 extraction targets to other entities and events. The highest performance achieved in the supporting task REL, 58% F-score, is broadly comparable with levels reported for other relation extraction tasks. For the ID task, the highest-performing system achieved 56% F-score, comparable to the state-of-the-art performance at the established ST'09 task. In the EPI task, the best result was 53% F-score for the full set of extraction targets and 69% F-score for a reduced set of core extraction targets, approaching a level of performance sufficient for user-facing applications. In this study, we extend on previously reported results and perform further analyses of the outputs of the participating systems. We place specific emphasis on aspects of system performance relating to real-world applicability, considering alternate evaluation metrics and performing additional manual analysis of system outputs. We further demonstrate that the strengths of extraction systems can be combined to improve on the performance achieved by any system in isolation. The manually annotated corpora, supporting resources, and evaluation tools for all tasks are available from http://www.bionlp-st.org and the tasks continue as open challenges for all interested parties.
- 26 June 2012
- Published by Springer Nature in BMC Bioinformatics
- Vol. 13 (S11) , S2
Open AccessOverview of the ID, EPI and REL tasks of BioNLP Shared Task 2011
We present the preparation, resources, results and analysis of three tasks of the BioNLP Shared Task 2011: the main tasks on Infectious Diseases (ID) and Epigenetics and Post-translational Modifications (EPI), and the supporting task on Entity Relations (REL). The two main tasks represent extensions of the event extraction model introduced in the BioNLP Shared Task 2009 (ST'09) to two new areas of biomedical scientific literature, each motivated by the needs of specific biocuration tasks. The ID task concerns the molecular mechanisms of infection, virulence and resistance, focusing in particular on the functions of a class of signaling systems that are ubiquitous in bacteria. The EPI task is dedicated to the extraction of statements regarding chemical modifications of DNA and proteins, with particular emphasis on changes relating to the epigenetic control of gene expression. By contrast to these two application-oriented main tasks, the REL task seeks to support extraction in general by separating challenges relating to part-of relations into a subproblem that can be addressed by independent systems. Seven groups participated in each of the two main tasks and four groups in the supporting task. The participating systems indicated advances in the capability of event extraction methods and demonstrated generalization in many aspects: from abstracts to full texts, from previously considered subdomains to new ones, and from the ST'09 extraction targets to other entities and events. The highest performance achieved in the supporting task REL, 58% F-score, is broadly comparable with levels reported for other relation extraction tasks. For the ID task, the highest-performing system achieved 56% F-score, comparable to the state-of-the-art performance at the established ST'09 task. In the EPI task, the best result was 53% F-score for the full set of extraction targets and 69% F-score for a reduced set of core extraction targets, approaching a level of performance sufficient for user-facing applications. In this study, we extend on previously reported results and perform further analyses of the outputs of the participating systems. We place specific emphasis on aspects of system performance relating to real-world applicability, considering alternate evaluation metrics and performing additional manual analysis of system outputs. We further demonstrate that the strengths of extraction systems can be combined to improve on the performance achieved by any system in isolation. The manually annotated corpora, supporting resources, and evaluation tools for all tasks are available from http://www.bionlp-st.org and the tasks continue as open challenges for all interested parties.
- Open Access
- 29 March 2011
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 6 (3) , e14780
Named Entity Recognition for Bacterial Type IV Secretion Systems
Research on specialized biological systems is often hampered by a lack of consistent terminology, especially across species. In bacterial Type IV secretion systems genes within one set of orthologs may have over a dozen different names. Classifying research publications based on biological processes, cellular components, molecular functions, and microorganism species should improve the precision and recall of literature searches allowing researchers to keep up with the exponentially growing literature, through resources such as the Pathosystems Resource Integration Center (PATRIC, patricbrc.org). We developed named entity recognition (NER) tools for four entities related to Type IV secretion systems: 1) bacteria names, 2) biological processes, 3) molecular functions, and 4) cellular components. These four entities are important to pathogenesis and virulence research but have received less attention than other entities, e.g., genes and proteins. Based on an annotated corpus, large domain terminological resources, and machine learning techniques, we developed recognizers for these entities. High accuracy rates (>80%) are achieved for bacteria, biological processes, and molecular function. Contrastive experiments highlighted the effectiveness of alternate recognition strategies; results of term extraction on contrasting document sets demonstrated the utility of these classes for identifying T4SS-related documents.
- 29 March 2011
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 6 (3) , e14780
Open AccessNamed Entity Recognition for Bacterial Type IV Secretion Systems
Research on specialized biological systems is often hampered by a lack of consistent terminology, especially across species. In bacterial Type IV secretion systems genes within one set of orthologs may have over a dozen different names. Classifying research publications based on biological processes, cellular components, molecular functions, and microorganism species should improve the precision and recall of literature searches allowing researchers to keep up with the exponentially growing literature, through resources such as the Pathosystems Resource Integration Center (PATRIC, patricbrc.org). We developed named entity recognition (NER) tools for four entities related to Type IV secretion systems: 1) bacteria names, 2) biological processes, 3) molecular functions, and 4) cellular components. These four entities are important to pathogenesis and virulence research but have received less attention than other entities, e.g., genes and proteins. Based on an annotated corpus, large domain terminological resources, and machine learning techniques, we developed recognizers for these entities. High accuracy rates (>80%) are achieved for bacteria, biological processes, and molecular function. Contrastive experiments highlighted the effectiveness of alternate recognition strategies; results of term extraction on contrasting document sets demonstrated the utility of these classes for identifying T4SS-related documents.
- Open Access
- 20 May 2010
- Published by Wiley in Chemistry & Biodiversity
- Vol. 7 (5) , 1124-1141
Data Integration for Dynamic and Sustainable Systems Biology Resources: Challenges and Lessons Learned
Systems‐biology and infectious‐disease (host–pathogen–environment) research and development is becoming increasingly dependent on integrating data from diverse and dynamic sources. Maintaining integrated resources over long periods of time presents distinct challenges. This review describes experiences and lessons learned from integrating data in two five‐year projects focused on pathosystems biology: thePathosystems Resource Integration Center(PATRIC, http://patric.vbi.vt.edu/), with a goal of developing bioinformatics resources for the research and countermeasures‐development communities based on genomics data, and theResource Center for Biodefense Proteomics Research(RCBPR, http://www.proteomicsresource.org/), with a goal of developing resources based on the experiment data such as microarray and proteomics data from diverse sources and technologies. Some challenges include integrating genomic sequence and experiment data, data synchronization, data quality control, and usability engineering. We present examples of a variety of data‐integration problems drawn from our experiences with PATRIC and RBPRC, as well as open research questions related to long‐term sustainability, and describe the next steps to meeting these challenges. Novel contributions of this work include1) an approach for addressing discrepancies between experiment results and interpreted results, and2) expanding the range of data‐integration techniques to include usability engineering at the presentation level.
- 20 May 2010
- Published by Wiley in Chemistry & Biodiversity
- Vol. 7 (5) , 1124-1141
Open AccessData Integration for Dynamic and Sustainable Systems Biology Resources: Challenges and Lessons Learned
Systems‐biology and infectious‐disease (host–pathogen–environment) research and development is becoming increasingly dependent on integrating data from diverse and dynamic sources. Maintaining integrated resources over long periods of time presents distinct challenges. This review describes experiences and lessons learned from integrating data in two five‐year projects focused on pathosystems biology: thePathosystems Resource Integration Center(PATRIC, http://patric.vbi.vt.edu/), with a goal of developing bioinformatics resources for the research and countermeasures‐development communities based on genomics data, and theResource Center for Biodefense Proteomics Research(RCBPR, http://www.proteomicsresource.org/), with a goal of developing resources based on the experiment data such as microarray and proteomics data from diverse sources and technologies. Some challenges include integrating genomic sequence and experiment data, data synchronization, data quality control, and usability engineering. We present examples of a variety of data‐integration problems drawn from our experiences with PATRIC and RBPRC, as well as open research questions related to long‐term sustainability, and describe the next steps to meeting these challenges. Novel contributions of this work include1) an approach for addressing discrepancies between experiment results and interpreted results, and2) expanding the range of data‐integration techniques to include usability engineering at the presentation level.