A user-centred evaluation framework for the Sealife semantic web browsers
Authors:
- Helen OliverHOHelen Oliver
- Gayo DialloGDGayo Diallo
- Ed de QuinceyEQEd de Quincey
- Dimitra AlexopoulouDADimitra Alexopoulou
- Bianca HabermannBHBianca Habermann
- Patty KostkovaPKPatty Kostkova
- Michael SchroederMSMichael Schroeder
- Simon JuppSJSimon Jupp
- Khaled KhelifKKKhaled Khelif
- Robert StevensRSRobert Stevens
- Gawesh JawaheerGJGawesh Jawaheer
- Gemma MadleGMGemma Madle
Open Access
- 1 October 2009
- journal article
- research article
- Published by Springer Nature in BMC Bioinformatics
- Vol. 10 (S10) , S14
Abstract
Semantically-enriched browsing has enhanced the browsing experience by providing contextualised dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure. This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system. It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers. Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.Keywords
This publication has 15 references indexed in Scilit:
- Web-based provision of information on infectious diseases: a systems studyHealth Informatics Journal, 2006
- GoPubMed: exploring PubMed with the Gene OntologyNucleic Acids Research, 2005
- New measurements for search engine evaluation proposed and testedInformation Processing & Management, 2004
- A comprehensive and systematic model of user evaluation of Web search engines: II. An evaluation by undergraduatesJournal of the American Society for Information Science and Technology, 2003
- Student vs. Search Engine: Undergraduates Rank Results for Relevanceportal: Libraries and the Academy, 2003
- The Mice that WarredScientific American, 2001
- The Semantic WebScientific American, 2001
- National electronic Library for Health (NeLH)BMJ, 1999
- Evaluation of user interface designs for information retrieval systems: a computer-based experimentDecision Support Systems, 1999
- Designing the user interface strategies for effective human-computer interactionACM SIGBIO Newsletter, 1987