Evaluability Assessment: Clarifying Organizational Support and Data Availability
Authors:
Open Access
- 29 July 2014
- journal article
- Published by The Evaluation Center at Western Michigan University in Journal of Multidisciplinary Evaluation
- Vol. 10 (23) , 9-25
Abstract
Background: Evaluability assessment (EA) emerged in the 1970s as a way to ensure a program was ready for summative evaluation. The primary purpose was assessing the presence of measurable program objectives (Trevisan, 2007), yet evaluators conducting EA encountered difficulty with unclear, ambiguous methods (Smith, 2005). Purpose: The purpose of this qualitative study was to clarify two aspects of evaluability assessment, organizational support and data availability. In practice, organizational stakeholders must support the evaluation project to ensure it is pursued to completion. In addition, the availability of operational data facilitates analysis of the evaluand effect. Setting: Participants from both human services and corporate organizations participated in interviews. Participants worked on evaluation projects serving in three roles: organizational stakeholder, program evaluator, and information technology personnel. Intervention: NA Research Design: A qualitative research design was selected to best understand the experiences with regard to organizational support and data sufficiency of individuals who have engaged in evaluation studies and to understand how these domains affected their ability to conduct an evaluation. Data Collection and Analysis: This study consisted of purposive sampling of 13 participants serving various roles to add breadth to the data. The researchers conducted semi-structured interviews and analyzed the data using thematic analysis. Findings: The findings indicate the importance of specific organizational and data related considerations that affect evaluability. The researchers recommend considerations that elaborate upon the existing EA framework. The recommended evaluability considerations assist evaluators in identifying ill-advised evaluations and enhancing the likelihood of success in ongoing studies.Keywords
This publication has 15 references indexed in Scilit:
- An evaluability assessment of a West Africa based Non-Governmental Organization's (NGO) progressive evaluation strategyEvaluation and Program Planning, 2013
- Overview and rationale for the Systematic Screening and Assessment MethodNew Directions for Evaluation, 2010
- Methodologies for data quality assessment and improvementACM Computing Surveys, 2009
- Participatory evaluation: not working or not tested?American Journal of Evaluation, 1999
- Values in Evaluation and Social Research1999
- Making Strategy: The Journey of Strategic Management1998
- Data quality in contextCommunications of the ACM, 1997
- Beyond Accuracy: What Data Quality Means to Data ConsumersJournal of Management Information Systems, 1996
- Stakeholder Participation and Utilization in Program EvaluationEvaluation Review, 1988
- Evaluability assessment: Developing program theoryNew Directions for Program Evaluation, 1987