RDRick Davies

Rick Davies

*This is an algorithmically generated author record based on publicly available information.

Rick Davies has a total of 6 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Integrating foresight and evaluation: The example of ParEvo

    by Rick J. Davies

    This paper aims to encourage connections between the fields of program evaluation and foresight practice by describing the use of a web application ParEvo as an example of how foresight methods can incorporate evaluative thinking. It begins by introducing the field of foresight practice, along with its differences and commonalities with that of evaluation. It then introduces ParEvo.org and its uses to date, along with a detailed description of how a ParEvo exercise is implemented. An overview is also given of how different types of evaluation activities are built throughout the implementation process. Attention is then focused on three different types of embedded theories of change, and how they can be evaluated. The paper concludes with two observations about the breadth and depth of evaluative thinking present in ParEvo processes and the supporting platform. Some limitations are also acknowledged, arising from the rich nature of the outputs generated and the decentralized nature of the design and operation of ParEvo exercises.


  • ParEvo: A methodology for the exploration and evaluation of alternative futures

    by Rick Davies, Tom Hobson, Lara Mani, Sj Beard

    Evaluators’ main encounter with views of the future is in the form of theories of change, about how a programme will work to achieve a desired end, in a given context. These are typically focussed on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This article explains how the ParEvo process works, the theory informing its design, and its usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results and (c) identifying longer-term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021–2022 are used as illustrative examples.


  • Open Access

    ParEvo: A Methodology for the Exploration and Evaluation of Alternative Futures

    by Rick Davies, Tom Hobson, Lara Mani, S. J. Beard

    Evaluators’ main encounter with views of the future is in the form of theories of change, about how a program will work to achieve a desired end, in a given context. These are typically focused on specific relatively short-term futures, which are both desired and expected. But even in the short term, reality often involves unpredictable events which must be responded to. Other ways of thinking about the future may be helpful and complementary, notably those developed by foresight practitioners, working in the field of futures studies. These pay more attention to a range of possible futures, rather than a single perspective. One way of exploring such futures is by using ParEvo.org, an online process that enables the participatory exploration of alternative futures. This paper explains how the ParEvo process works, the theory informing its design, and usage to date. Attention is given to three evaluation challenges, and methods to address them: (a) optimising exercise design, (b) analysis of immediate results, and (c) identifying longer term impacts. Two exercises undertaken by the Cambridge-based Centre for the Study of Existential Risk (CSER) in 2021-22 are used as illustrative examples.


  • Open Access

    ParEvo: Enabling the Participatory Exploration of Alternative Futures

    by Rick Davies

    ParEvo is an online method of developing alternative future scenarios or past histories, using a participatory evolutionary process (hence ParEvo). This involves the re-iteration of variation, selection, and reproduction i.e., an embodiment of the evolutionary algorithm (Campbell, 1960; Dennett, 1996). The process is designed to be used by multiple people, to produce a collective good – a set of storylines. In addition, the process generates data on the structure of participation – how people have collaborated to produce those storylines. For users, ParEvo.org can be used to achieve two related kinds of purposes. The first is cognitive: to enable participants to creatively think about alternative futures, and how they do that thinking (meta-cognition). The second is more behavioural: to prompt consideration of ways of responding to possible futures, in anticipation and/or in response, and to exploit and/or mitigate the consequences. This paper illustrates how a ParEvo exercise is implemented and analysed, along with an explanation of its origins and subsequent use. Illustrative references are made to two recent exercises carried out by the Centre for the Study of Existential Risk (CSER), in Cambridge, UK. Three types of evaluation challenges are highlighted, concerning the performance of individual participants, specific exercises and the platform as a whole. Researchers in collective intelligence are invited to explore the uses of the application, and to address some of the challenges raised in this paper


  • Representing theories of change: technical challenges with evaluation consequences

    by Rick Davies

    This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.


  • Evaluability Assessments: Reflections on a review of the literature

    by Rick Davies, Lina Payne

    In 2012 the United Kingdom’s Department for International Development (DFID) funded a review of the literature on Evaluability Assessments, which was undertaken by Rick Davies. Although the review focused on practical guidance Evaluability Assessments are not unproblematic. Evaluability Assessments involve an additional layer of cost and procedure. The diversity of evaluation approaches is a challenge to any categorical judgement about evaluability. The reach of an evaluability assessment can become over-extended. Evaluability questions asked of individual projects may not be so easily applied to larger portfolios of projects. The purpose of this article is to give more attention to the problematic aspects of Evaluability Assessments. In doing so it does not seek to revise the broad conclusions of the Working Paper, which unambiguously encouraged the wider use of Evaluability Assessments.