Developing a holistic model for digital library evaluation
Author:
- 9 December 2009
- journal article
- research article
- Published by Wiley in Journal of the American Society for Information Science and Technology
- Vol. 61 (1) , 88-110
Abstract
This article reports the author's recent research in developing a holistic model for various levels of digital library (DL) evaluation in which perceived important criteria from heterogeneous stakeholder groups are organized and presented. To develop such a model, the author applied a three‐stage research approach: exploration, confirmation, and verification. During the exploration stage, a literature review was conducted followed by an interview, along with a card sorting technique, to collect important criteria perceived by DL experts. Then the criteria identified were used for developing an online survey during the confirmation stage. Survey respondents (431 in total) from 22 countries rated the importance of the criteria. A holistic DL evaluation model was constructed using statistical techniques. Eventually, the verification stage was devised to test the reliability of the model in the context of searching and evaluating an operational DL. The proposed model fills two lacunae in the DL domain: (a) the lack of a comprehensive and flexible framework to guide and benchmark evaluations, and (b) the uncertainty about what divergence exists among heterogeneous DL stakeholders, including general users.Keywords
This publication has 56 references indexed in Scilit:
- Service equality in virtual referenceJournal of the American Society for Information Science and Technology, 2008
- The Galician virtual libraryOnline Information Review, 2007
- State digital library usability: Contributing organizational factorsJournal of the American Society for Information Science and Technology, 2002
- Evaluation of Digital Library Impact and User Communities by Analysis of Usage PatternsD-Lib Magazine, 2002
- Usability, user preferences, effectiveness, and user behaviors when searching individual and integrated full-text databases: implications for digital librariesJournal of the American Society for Information Science, 2000
- Alexandria digital library: user evaluation studies and system designJournal of the American Society for Information Science, 2000
- Project SoupD-Lib Magazine, 1999
- TIME – a multi-leveled framework for evaluating and designing digital librariesInternational Journal on Digital Libraries, 1999
- Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTDInternational Journal on Digital Libraries, 1999
- Concept mappingACM SIGOIS Bulletin, 1995