Arlene Fink
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Arlene Fink has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- Lorna Kwan
University of California, Los Angeles 2 Los Angeles
4 shared publications - Mark S. Litwin
University of California Los Angeles, Los Angeles, CA, USA
3 shared publications - Alan E. Mast
Thrombosis and Hemostasis Program, Versiti Blood Research Institute, Milwaukee, WI
1 shared publication - Alexis Cooke
Comagine Health, Portland, OR, USA
1 shared publication - Allen Enrique D. Siapno
Department of Urology, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
1 shared publication - Ann Lucas
Parent Project Muscular Dystrophy, Hackensack, NJ, United States
1 shared publication
Latest Publications
- 7 December 2023
- Published by Taylor & Francis
- p. 110-128
Collecting Program Evaluation Information
An evaluation's purpose is to produce unbiased information about a program's effectiveness, quality, and value. This chapter discusses evaluation information sources such as self-administered questionnaires (on and offline), tests, database reviews, observations, interviews (in person, on the phone, online), and the literature. The advantages, limitations, and sources of bias inherent in using each of these data sources are discussed. This chapter also explains how to identify, search, and evaluate the published research literature because evaluators frequently rely on it to find useful data sources and measures.
- 7 December 2023
- Published by Taylor & Francis
- p. 110-128
Collecting Program Evaluation Information
An evaluation's purpose is to produce unbiased information about a program's effectiveness, quality, and value. This chapter discusses evaluation information sources such as self-administered questionnaires (on and offline), tests, database reviews, observations, interviews (in person, on the phone, online), and the literature. The advantages, limitations, and sources of bias inherent in using each of these data sources are discussed. This chapter also explains how to identify, search, and evaluate the published research literature because evaluators frequently rely on it to find useful data sources and measures.
- 7 December 2023
- Published by Taylor & Francis
- p. 66-95
Designing Program Evaluations
An evaluation's design is its unique research structure. The structure consists of evaluation questions and hypotheses; anticipated evidence of program effectiveness, quality, and value; criteria for study eligibility; rules for assigning study participants to programs; and rules for the timing and frequency of measurement. Each of these design elements is discussed in detail in this chapter, which also explains blocking, stratification, and blinding. The chapter also details the advantages and limitations of experimental and observational evaluation designs and discusses how to minimize evaluation design bias through blocking, stratification, and blinding. A focus of the chapter is comparative effectiveness research (CER). CER is characterized by evaluating programs in their natural rather than experimental settings. Finally, in the real world, evaluators must deal with practical and methodological challenges that prevent them from conducting the perfect study. Because these challenges “threaten” or bias the internal and external validity of the evaluation's findings, the chapter explains how to recognize and deal with them.
- 7 December 2023
- Published by Taylor & Francis
- p. 66-95
Designing Program Evaluations
An evaluation's design is its unique research structure. The structure consists of evaluation questions and hypotheses; anticipated evidence of program effectiveness, quality, and value; criteria for study eligibility; rules for assigning study participants to programs; and rules for the timing and frequency of measurement. Each of these design elements is discussed in detail in this chapter, which also explains blocking, stratification, and blinding. The chapter also details the advantages and limitations of experimental and observational evaluation designs and discusses how to minimize evaluation design bias through blocking, stratification, and blinding. A focus of the chapter is comparative effectiveness research (CER). CER is characterized by evaluating programs in their natural rather than experimental settings. Finally, in the real world, evaluators must deal with practical and methodological challenges that prevent them from conducting the perfect study. Because these challenges “threaten” or bias the internal and external validity of the evaluation's findings, the chapter explains how to recognize and deal with them.
- 7 December 2023
- Published by Taylor & Francis
- p. 161-181
Analyzing Evaluation Data
Program evaluators use statistical and qualitative methods to analyze data and answer questions about a program's effectiveness, quality, and value. This chapter explains why data analysis depends as much on the characteristics of the evaluation's questions and the quality of its data as it does on the evaluator's skills in doing the analysis. It also discusses the logic that evaluators use in planning data analysis. Program evaluators rely on statistical methods to analyze data, and so, this chapter covers hypothesis testing, confidence intervals, odds and risks, and meta-analyses, commonly used data-analytic evaluation methods. Finally, because evaluators may use qualitative as well as statistical methods, the chapter includes a discussion of a commonly used qualitative method: content analysis.
- 7 December 2023
- Published by Taylor & Francis
- p. 161-181
Analyzing Evaluation Data
Program evaluators use statistical and qualitative methods to analyze data and answer questions about a program's effectiveness, quality, and value. This chapter explains why data analysis depends as much on the characteristics of the evaluation's questions and the quality of its data as it does on the evaluator's skills in doing the analysis. It also discusses the logic that evaluators use in planning data analysis. Program evaluators rely on statistical methods to analyze data, and so, this chapter covers hypothesis testing, confidence intervals, odds and risks, and meta-analyses, commonly used data-analytic evaluation methods. Finally, because evaluators may use qualitative as well as statistical methods, the chapter includes a discussion of a commonly used qualitative method: content analysis.
- 7 December 2023
- Published by Taylor & Francis
- p. 96-109
Sampling in Program Evaluations
This chapter discusses why program evaluators typically use samples in their studies rather than entire populations of people. It also explains the advantages and limitations of five commonly used evaluation sampling methods: random, systematic, stratified, cluster, and convenience sampling. The chapter also explains the difference between the unit of sampling (schools and hospitals) and the unit of data analysis (school or student; hospital or patients) and discusses how to calculate an appropriate sample size. A form for reporting on sampling strategy is also offered. This form is designed to show the logical relationships among the evaluation questions, standards, independent variables, sampling strata, inclusion and exclusion criteria, dependent variables, measures, sampling methods, and sample size.
- 7 December 2023
- Published by Taylor & Francis
- p. 96-109
Sampling in Program Evaluations
This chapter discusses why program evaluators typically use samples in their studies rather than entire populations of people. It also explains the advantages and limitations of five commonly used evaluation sampling methods: random, systematic, stratified, cluster, and convenience sampling. The chapter also explains the difference between the unit of sampling (schools and hospitals) and the unit of data analysis (school or student; hospital or patients) and discusses how to calculate an appropriate sample size. A form for reporting on sampling strategy is also offered. This form is designed to show the logical relationships among the evaluation questions, standards, independent variables, sampling strata, inclusion and exclusion criteria, dependent variables, measures, sampling methods, and sample size.
- 7 December 2023
- Published by Taylor & Francis
- p. 129-143
Evaluation Measures
This chapter discusses measurement validity. An evaluation's data sources or measures include surveys, achievement tests, observations, database or record reviews, and interviews. Reliable and valid measures are the foundation of unbiased evaluation information. A reliable measure is consistent in its findings, and a valid one is accurate. The chapter also explains how to develop reliable and valid new measures, select appropriate measures among those that are currently available, and create a measurement chart to establish logical connections among the evaluation's questions and hypotheses, design, and measures.
- 7 December 2023
- Published by Taylor & Francis
- p. 129-143
Evaluation Measures
This chapter discusses measurement validity. An evaluation's data sources or measures include surveys, achievement tests, observations, database or record reviews, and interviews. Reliable and valid measures are the foundation of unbiased evaluation information. A reliable measure is consistent in its findings, and a valid one is accurate. The chapter also explains how to develop reliable and valid new measures, select appropriate measures among those that are currently available, and create a measurement chart to establish logical connections among the evaluation's questions and hypotheses, design, and measures.
- 7 December 2023
- Published by Taylor & Francis
Program Evaluation
This timely, unique, and insightful book provides students and practitioners with the tools and skills needed to evaluate social and policy programs across a range of disciplines—from public health to social work to education—enabling the allocation of scarce human and financial resources to advance the health and well-being of individuals and populations. The chapters are organized according to the main tasks involved in conducting an evaluation to produce unbiased evidence of program effectiveness, quality, and value. The chapters include methods for selecting and justifying evaluation questions or hypotheses, designing evaluations, sampling participants, selecting information sources, and ensuring reliable and valid measurement. The final section of the book is focused around managing and analyzing data and transparently reporting the results in written and oral form. The book features international case studies throughout, covers quantitative, qualitative, and mixed-method approaches, and is also informed by new online methods developed during the COVID-19 pandemic. Among the book’s unique features is a focus on international standards for conducting ethical evaluations and avoiding research misconduct. Also featuring checklists, example forms, and summaries of the key ideas and topics, this very practical book is essential reading for students in the social, behavioral, and health sciences, and will be a key resource for professionals in the field.
- 7 December 2023
- Published by Taylor & Francis
Program Evaluation
This timely, unique, and insightful book provides students and practitioners with the tools and skills needed to evaluate social and policy programs across a range of disciplines—from public health to social work to education—enabling the allocation of scarce human and financial resources to advance the health and well-being of individuals and populations. The chapters are organized according to the main tasks involved in conducting an evaluation to produce unbiased evidence of program effectiveness, quality, and value. The chapters include methods for selecting and justifying evaluation questions or hypotheses, designing evaluations, sampling participants, selecting information sources, and ensuring reliable and valid measurement. The final section of the book is focused around managing and analyzing data and transparently reporting the results in written and oral form. The book features international case studies throughout, covers quantitative, qualitative, and mixed-method approaches, and is also informed by new online methods developed during the COVID-19 pandemic. Among the book’s unique features is a focus on international standards for conducting ethical evaluations and avoiding research misconduct. Also featuring checklists, example forms, and summaries of the key ideas and topics, this very practical book is essential reading for students in the social, behavioral, and health sciences, and will be a key resource for professionals in the field.
- 7 December 2023
- Published by Taylor & Francis
- p. 1-42
Introducing Program Evaluation
An evaluation is a systematic assessment of a program's effectiveness, quality, and value. High-quality evaluations are scientific studies that result in unbiased evidence of the program's achievements, impact, and costs. Stakeholders use evaluation information to better understand their program and to make informed decisions about program improvement, continuation, and funding. This chapter defines and discusses effectiveness, quality, and value and explains the methods that evaluators use to obtain unbiased evidence. The chapter gives examples of program evaluations and describes their purposes, methods, and stakeholders. The chapter also discusses formative and summative evaluations, qualitative and mixed-methods research, and stakeholder engagement in participatory and collaborative projects. It introduces comparative, pragmatic, and cost-effectiveness evaluations and describes their methods and importance. The chapter also provides examples of program evaluation frameworks that can be used to structure the evaluation process. The chapter discusses how to conduct and report on evaluations that follow internationally accepted ethics principles by respecting the uniqueness and independence of individuals, securing their well-being, and balancing the risks and benefits of participation in evaluation studies. It also explains how to recognize research misconduct. The evaluator's job is complex, and evaluation project management includes organizing the evaluation team and creating and justifying a budget and a timeline. The chapter provides a job description that lists the skills that program evaluators must have to ensure a successful evaluation. Evaluators are also responsible for following a budget, and the chapter gives a checklist for creating one that will support the team's activities. Keeping to a timeline is extremely important, and the chapter gives an example of a timeline for a four-year evaluation.
- 7 December 2023
- Published by Taylor & Francis
- p. 1-42
Introducing Program Evaluation
An evaluation is a systematic assessment of a program's effectiveness, quality, and value. High-quality evaluations are scientific studies that result in unbiased evidence of the program's achievements, impact, and costs. Stakeholders use evaluation information to better understand their program and to make informed decisions about program improvement, continuation, and funding. This chapter defines and discusses effectiveness, quality, and value and explains the methods that evaluators use to obtain unbiased evidence. The chapter gives examples of program evaluations and describes their purposes, methods, and stakeholders. The chapter also discusses formative and summative evaluations, qualitative and mixed-methods research, and stakeholder engagement in participatory and collaborative projects. It introduces comparative, pragmatic, and cost-effectiveness evaluations and describes their methods and importance. The chapter also provides examples of program evaluation frameworks that can be used to structure the evaluation process. The chapter discusses how to conduct and report on evaluations that follow internationally accepted ethics principles by respecting the uniqueness and independence of individuals, securing their well-being, and balancing the risks and benefits of participation in evaluation studies. It also explains how to recognize research misconduct. The evaluator's job is complex, and evaluation project management includes organizing the evaluation team and creating and justifying a budget and a timeline. The chapter provides a job description that lists the skills that program evaluators must have to ensure a successful evaluation. Evaluators are also responsible for following a budget, and the chapter gives a checklist for creating one that will support the team's activities. Keeping to a timeline is extremely important, and the chapter gives an example of a timeline for a four-year evaluation.
- 7 December 2023
- Published by Taylor & Francis
- p. 43-65
Evaluation Questions and Evidence of Effectiveness, Quality, and Value
This chapter begins with a discussion of commonly asked evaluation questions and their associated hypotheses. It continues with an explanation of how to select and justify the questions and the evidence of effectiveness, quality, and value. The chapter gives examples of evaluation questions that focus on programs, participants, outcomes, impact, and costs. It emphasizes the importance of selecting a comprehensive and meaningful set of questions because the answers to the questions constitute evidence of effectiveness, quality, and value. The chapter also explains the relationship between evidence that is based on statistical significance and evidence based on an effect size that confers practical or clinical meaning. Information in the chapter is given on the sources of practical or clinical significance, which include experts and consumers, large databases, and the research literature. The chapter also discusses the relationships among evaluation questions and hypotheses; evidence of effectiveness, quality, value; and the independent and dependent variables. Their connection is illustrated in a special reporting form: The QEV or Questions, Evidence, Variables Report.
- 7 December 2023
- Published by Taylor & Francis
- p. 43-65
Evaluation Questions and Evidence of Effectiveness, Quality, and Value
This chapter begins with a discussion of commonly asked evaluation questions and their associated hypotheses. It continues with an explanation of how to select and justify the questions and the evidence of effectiveness, quality, and value. The chapter gives examples of evaluation questions that focus on programs, participants, outcomes, impact, and costs. It emphasizes the importance of selecting a comprehensive and meaningful set of questions because the answers to the questions constitute evidence of effectiveness, quality, and value. The chapter also explains the relationship between evidence that is based on statistical significance and evidence based on an effect size that confers practical or clinical meaning. Information in the chapter is given on the sources of practical or clinical significance, which include experts and consumers, large databases, and the research literature. The chapter also discusses the relationships among evaluation questions and hypotheses; evidence of effectiveness, quality, value; and the independent and dependent variables. Their connection is illustrated in a special reporting form: The QEV or Questions, Evidence, Variables Report.
- 7 December 2023
- Published by Taylor & Francis
- p. 182-201
Evaluation Reports
This chapter explains how to prepare a transparent program evaluation report. A transparent report provides a detailed and accurate explanation of the evaluation's purposes, methods, and conclusions. Transparency improves with the use of standardized reporting checklists such as the Consolidated Standards of Reporting Trials (CONSORT Statement) and Transparent Reporting of Evaluations with Nonrandomized Designs (TREND). Evaluation reports take the form of printed or online manuscripts, oral presentations, or posters. The chapter first discusses how to prepare manuscripts and describes the figures and tables you need to show results. Next, the chapter examines oral reports and explains how to prepare slides and posters for online and in-person presentations.
- 7 December 2023
- Published by Taylor & Francis
- p. 182-201
Evaluation Reports
This chapter explains how to prepare a transparent program evaluation report. A transparent report provides a detailed and accurate explanation of the evaluation's purposes, methods, and conclusions. Transparency improves with the use of standardized reporting checklists such as the Consolidated Standards of Reporting Trials (CONSORT Statement) and Transparent Reporting of Evaluations with Nonrandomized Designs (TREND). Evaluation reports take the form of printed or online manuscripts, oral presentations, or posters. The chapter first discusses how to prepare manuscripts and describes the figures and tables you need to show results. Next, the chapter examines oral reports and explains how to prepare slides and posters for online and in-person presentations.
- 7 December 2023
- Published by Taylor & Francis
- p. 144-160
Managing Evaluation Data and Managing the Evaluation
The term data management refers to what evaluators do with data from the moment it is collected until it is ready to be shared with other evaluators, researchers, program and policy experts, and funders. This chapter discusses how evaluators manage their project by completing nine activities: Selecting a statistical software platform. Drafting an analysis plan that defines and “codes” the variables to be analyzed. Creating a codebook or data dictionary. Ensuring the reliability of the coders. Reviewing the data for completeness and accuracy. Entering data into a database and validating the accuracy of the entry. Cleaning the data. Creating the final data set for analysis. Storing and archiving the data.
- 7 December 2023
- Published by Taylor & Francis
- p. 144-160
Managing Evaluation Data and Managing the Evaluation
The term data management refers to what evaluators do with data from the moment it is collected until it is ready to be shared with other evaluators, researchers, program and policy experts, and funders. This chapter discusses how evaluators manage their project by completing nine activities: Selecting a statistical software platform. Drafting an analysis plan that defines and “codes” the variables to be analyzed. Creating a codebook or data dictionary. Ensuring the reliability of the coders. Reviewing the data for completeness and accuracy. Entering data into a database and validating the accuracy of the entry. Cleaning the data. Creating the final data set for analysis. Storing and archiving the data.