Rick Davies
Research Subjects
Rick Davies has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Lara Mani
Centre for the Study of Existential Risk, University of Cambridge, Cambridge, UK
2 shared publications Lina Payne
Department for International Development, UK
1 shared publicationS. J. Beard
Centre for the Study of Existential Risk; Climate Ethics and Future Generations
1 shared publication- Sj Beard
Centre for the Study of Existential Risk, University of Cambridge, Cambridge CB2 1TN, UK
1 shared publication Tom Hobson
Independent
1 shared publication- Tom Hobson
Centre for the Study of Existential Risk
1 shared publication
Latest Publications
- 1 June 2024
- Published by Wiley in New Directions for Evaluation
- Vol. 2024 (182) , 31-44
Integrating foresight and evaluation: The example of ParEvo
This paper aims to encourage connections between the fields of program evaluation and foresight practice by describing the use of a web application ParEvo as an example of how foresight methods can incorporate evaluative thinking. It begins by introducing the field of foresight practice, along with its differences and commonalities with that of evaluation. It then introduces ParEvo.org and its uses to date, along with a detailed description of how a ParEvo exercise is implemented. An overview is also given of how different types of evaluation activities are built throughout the implementation process. Attention is then focused on three different types of embedded theories of change, and how they can be evaluated. The paper concludes with two observations about the breadth and depth of evaluative thinking present in ParEvo processes and the supporting platform. Some limitations are also acknowledged, arising from the rich nature of the outputs generated and the decentralized nature of the design and operation of ParEvo exercises.
- 1 June 2024
- Published by Wiley in New Directions for Evaluation
- Vol. 2024 (182) , 31-44
Integrating foresight and evaluation: The example of ParEvo
This paper aims to encourage connections between the fields of program evaluation and foresight practice by describing the use of a web application ParEvo as an example of how foresight methods can incorporate evaluative thinking. It begins by introducing the field of foresight practice, along with its differences and commonalities with that of evaluation. It then introduces ParEvo.org and its uses to date, along with a detailed description of how a ParEvo exercise is implemented. An overview is also given of how different types of evaluation activities are built throughout the implementation process. Attention is then focused on three different types of embedded theories of change, and how they can be evaluated. The paper concludes with two observations about the breadth and depth of evaluative thinking present in ParEvo processes and the supporting platform. Some limitations are also acknowledged, arising from the rich nature of the outputs generated and the decentralized nature of the design and operation of ParEvo exercises.
- 10 September 2023
- Published by SAGE Publications in Evaluation
- Vol. 30 (1) , 27-49
ParEvo: A methodology for the exploration and evaluation of alternative futures
Evaluators’ main encounter with views of the future is in the form of theories of change, about how a programme will work to achieve a desired end, in a given context. These are typically focussed on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This article explains how the ParEvo process works, the theory informing its design, and its usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results and (c) identifying longer-term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021–2022 are used as illustrative examples.
- 10 September 2023
- Published by SAGE Publications in Evaluation
- Vol. 30 (1) , 27-49
ParEvo: A methodology for the exploration and evaluation of alternative futures
Evaluators’ main encounter with views of the future is in the form of theories of change, about how a programme will work to achieve a desired end, in a given context. These are typically focussed on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This article explains how the ParEvo process works, the theory informing its design, and its usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results and (c) identifying longer-term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021–2022 are used as illustrative examples.
- Open Access
- 1 January 2023
- Published by Elsevier in SSRN Electronic Journal
ParEvo: A Methodology for the Exploration and Evaluation of Alternative Futures
Evaluators’ main encounter with views of the future is in the form of theories of change, about how a program will work to achieve a desired end, in a given context. These are typically focused on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners, working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This paper explains how the ParEvo process works, the theory informing its design, and usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results, and (c) identifying longer term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021-22 are used as illustrative examples.
- 1 January 2023
- Published by Elsevier in SSRN Electronic Journal
Open AccessParEvo: A Methodology for the Exploration and Evaluation of Alternative Futures
Evaluators’ main encounter with views of the future is in the form of theories of change, about how a program will work to achieve a desired end, in a given context. These are typically focused on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners, working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This paper explains how the ParEvo process works, the theory informing its design, and usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results, and (c) identifying longer term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021-22 are used as illustrative examples.
- Open Access
- 29 October 2022
- Published by Elsevier in SSRN Electronic Journal
ParEvo: Enabling the Participatory Exploration of Alternative Futures
ParEvo is an online method of developing alternative future scenarios or past histories, using a participatory evolutionary process (hence ParEvo). This involves the re-iteration of variation, selection, and reproduction i.e., an embodiment of the evolutionary algorithm (Campbell, 1960; Dennett, 1996). The process is designed to be used by multiple people, to produce a collective good – a set of storylines. In addition, the process generates data on the structure of participation – how people have collaborated to produce those storylines. For users, ParEvo.org can be used to achieve two related kinds of purposes. The first is cognitive: to enable participants to creatively think about alternative futures, and how they do that thinking (meta-cognition). The second is more behavioural: to prompt consideration of ways of responding to possible futures, in anticipation and/or in response, and to exploit and/or mitigate the consequences. This paper illustrates how a ParEvo exercise is implemented and analysed, along with an explanation of its origins and subsequent use. Illustrative references are made to two recent exercises carried out by the Centre for the Study of Existential Risk (CSER), in Cambridge, UK. Three types of evaluation challenges are highlighted, concerning the performance of individual participants, specific exercises and the platform as a whole. Researchers in collective intelligence are invited to explore the uses of the application, and to address some of the challenges raised in this paper
- 29 October 2022
- Published by Elsevier in SSRN Electronic Journal
Open AccessParEvo: Enabling the Participatory Exploration of Alternative Futures
ParEvo is an online method of developing alternative future scenarios or past histories, using a participatory evolutionary process (hence ParEvo). This involves the re-iteration of variation, selection, and reproduction i.e., an embodiment of the evolutionary algorithm (Campbell, 1960; Dennett, 1996). The process is designed to be used by multiple people, to produce a collective good – a set of storylines. In addition, the process generates data on the structure of participation – how people have collaborated to produce those storylines. For users, ParEvo.org can be used to achieve two related kinds of purposes. The first is cognitive: to enable participants to creatively think about alternative futures, and how they do that thinking (meta-cognition). The second is more behavioural: to prompt consideration of ways of responding to possible futures, in anticipation and/or in response, and to exploit and/or mitigate the consequences. This paper illustrates how a ParEvo exercise is implemented and analysed, along with an explanation of its origins and subsequent use. Illustrative references are made to two recent exercises carried out by the Centre for the Study of Existential Risk (CSER), in Cambridge, UK. Three types of evaluation challenges are highlighted, concerning the performance of individual participants, specific exercises and the platform as a whole. Researchers in collective intelligence are invited to explore the uses of the application, and to address some of the challenges raised in this paper
- 2 October 2018
- Published by Taylor & Francis in Journal of Development Effectiveness
- Vol. 10 (4) , 438-461
Representing theories of change: technical challenges with evaluation consequences
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
- 2 October 2018
- Published by Taylor & Francis in Journal of Development Effectiveness
- Vol. 10 (4) , 438-461
Representing theories of change: technical challenges with evaluation consequences
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
- 7 April 2015
- Published by SAGE Publications in Evaluation
- Vol. 21 (2) , 216-231
Evaluability Assessments: Reflections on a review of the literature
In 2012 the United Kingdom’s Department for International Development (DFID) funded a review of the literature on Evaluability Assessments, which was undertaken by Rick Davies. Although the review focused on practical guidance Evaluability Assessments are not unproblematic. Evaluability Assessments involve an additional layer of cost and procedure. The diversity of evaluation approaches is a challenge to any categorical judgement about evaluability. The reach of an evaluability assessment can become over-extended. Evaluability questions asked of individual projects may not be so easily applied to larger portfolios of projects. The purpose of this article is to give more attention to the problematic aspects of Evaluability Assessments. In doing so it does not seek to revise the broad conclusions of the Working Paper, which unambiguously encouraged the wider use of Evaluability Assessments.
- 7 April 2015
- Published by SAGE Publications in Evaluation
- Vol. 21 (2) , 216-231
Evaluability Assessments: Reflections on a review of the literature
In 2012 the United Kingdom’s Department for International Development (DFID) funded a review of the literature on Evaluability Assessments, which was undertaken by Rick Davies. Although the review focused on practical guidance Evaluability Assessments are not unproblematic. Evaluability Assessments involve an additional layer of cost and procedure. The diversity of evaluation approaches is a challenge to any categorical judgement about evaluability. The reach of an evaluability assessment can become over-extended. Evaluability questions asked of individual projects may not be so easily applied to larger portfolios of projects. The purpose of this article is to give more attention to the problematic aspects of Evaluability Assessments. In doing so it does not seek to revise the broad conclusions of the Working Paper, which unambiguously encouraged the wider use of Evaluability Assessments.