A Call for the Evaluation of Web-Based Climate Data and Analysis Tools
- 1 February 2019
- journal article
- research article
- Published by American Meteorological Society in Bulletin of the American Meteorological Society
- Vol. 100 (2) , 257-268
Abstract
Researchers are producing an ever greater number of web-based climate data and analysis tools in support of natural resource research and management. Yet the apparent absence or underreporting of evaluation in the development of these applications has raised questions as to whether, by whom, and for what they are utilized, and, relatedly, whether they meet the rationale for their development. This paper joins recent efforts to address these questions by introducing one approach to evaluation—developmental evaluation—and reporting on its use in the evaluation of the Southwest Climate and Environmental Information Collaborative (SCENIC). A web interface under development at the Western Regional Climate Center, SCENIC provides access to climate data and analysis tools to environmental scientists in support of natural resource research and management in the southwestern United States. Evaluation findings highlight subtlety in the improvements necessary for ensuring a useful and usable application that could not have been ascertained in the absence of end-user feedback. We therefore urge researchers to systematically evaluate web-based climate data and analysis tools in the interest of ensuring their usefulness, usability, and fulfillment of the proposed rationale. In so doing, we recommend that researchers test and apply established evaluation frameworks, thereby engaging end users directly in the process of application development.Keywords
This publication has 36 references indexed in Scilit:
- Delivering Climate Services: Organizational Strategies and Approaches for Producing Useful Climate-Science InformationWeather, Climate, and Society, 2012
- Developmental EvaluationHealth Promotion Practice, 2011
- Creating usable science: Opportunities and constraints for climate knowledge use and their implications for science policyGlobal Environmental Change, 2011
- Using Programme Theory to Evaluate Complicated and Complex Aspects of InterventionsEvaluation, 2008
- Countering the Loading-Dock Approach to Linking Science and Decision MakingScience, Technology, & Human Values, 2006
- A Professional Development Unit for Reflecting on Program Evaluator CompetenciesAmerican Journal of Evaluation, 2006
- The co-production of science and policy in integrated climate assessmentsGlobal Environmental Change, 2005
- Establishing Essential Competencies for Program EvaluatorsAmerican Journal of Evaluation, 2005
- Evaluation ModelsNew Directions for Evaluation, 2001
- Program Evaluation1983