PMPaul Millin

Paul Millin

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Paul Millin has a total of 14 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    ‘Let's work together to pass medical school’: a qualitative study of medical student attitudes to teamwork, competition and collaboration

    by Helen R. Watson, Paul Millin, James Close, Robert Jeffery, Holly Stephenson, Daniel Zahra

    Teamwork is vital to all types of work, and graduates of higher education programmes must be prepared to contribute to a wide variety of professional teams. This is especially true in healthcare, where graduates will work in multidisciplinary teams (MDTs) under considerable pressure. This study is a follow‐up to a previous study, where we described how competition between students is a barrier to constructive teamwork. Since then, we have made considerable enhancements to our transferable skills curriculum, moved away from norm referencing, and there have been national changes to the way that graduate Foundation training places are allocated. Here we present findings from a qualitative study of students from all six stages of our medical degree programme (5 years plus predegree foundation year). We explored whether there had been changes in how students perceived the importance of teamwork, their own teamwork development and how they collaborated with their peers. Following analysis of in‐depth, semi‐structured interviews, five themes emerged: (a) competition between students; (b) importance of teamwork; (c) what makes effective teamwork; (d) preparing for work in MDTs; and (e) recommendations for teamwork education. Competition between students was perceived as both positive and negative, but there has been a shift since our last study towards collaboration, with students now more willing to help each other succeed. Students also show more insight into their teamwork development, and were able to discuss what aspects of the programme, and higher education more broadly, were most valuable in helping them develop.


  • Open Access

    Medical students' perceptions of a novel international adaptive progress test

    by Jolanta Kisielewska, Paul Millin, Neil Rice, Jose Miguel Pego, Steven Burr, Michal Nowakowski, Thomas Gale

    Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.


  • Open Access

    A narrative review of adaptive testing and its application to medical education

    by Steven A. Burr, Thomas Gale, Jolanta Kisielewska, Paul Millin, José M. Pêgo, Gergo Pinter, Iain M. Robinson, Daniel Zahra

    Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.