Jolanta Kisielewska
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jolanta Kisielewska has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Steven Ashley Burr
Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Plymouth University Peninsula Schools of Medicine and Dentistry, Plymouth, UK
3 shared publications Daniel Zahra
2 shared publications- José Miguel Pêgo
Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho
2 shared publications - Paul Millin
Peninsula Medical School University of Plymouth UK
2 shared publications Adele Drew-Hill
1 shared publication- Ann E. Rigby-Jones
Research Fellow, Anaesthesia Research Group, Peninsula College of Medicine & Dentistry, University of Plymouth, Plymouth, UK
1 shared publication
Latest Publications
- Open Access
- 28 April 2025
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 15
Physician Associate graduates have comparable knowledge to medical graduates
Background Physician associates (PAs) are medical associate professionals who work under the supervision of a doctor within multi-disciplinary teams. Though newly qualified PAs are expected to perform at the same level as newly qualified doctors, no studies have compared the level of medical knowledge upon graduation. The aim of this analysis was to determine the knowledge of PAs in comparison to medical students and Foundation Year 1 (FY1) doctors in the UK. Methods We undertook a retrospective analysis of assessment data from identical medical knowledge progress tests taken by PA students, medical students, and FY1 doctors. Student performance data were collated for each of the 88 identical items, from all cohorts, across all stages of the PA and medical programmes, as well as all cohorts of FY1 doctors sitting the exam. Results Analysis showed that PA student performance was comparable to medical students and FY1 doctors. At Stage 1 end, PA student mean performance was consistent with Stage 3 medicine (36.35%, 34.81%, respectively), whereas at Stage 2 end, PA performance was consistent with Stage 4 medicine (51.63%, 49.92%, respectively). Growth between Stage 1 and 2 PA, and Stage 3 and 4 medicine was almost identical. Significantly, many Stage 2 PA students met or exceeded Stage 5 medicine and FY1 performance upon graduation. Conclusions This is the first UK analysis that directly compares PA medical knowledge to medical students and FY1 doctors, provides evidence of the standard of PA knowledge, and reassurance that graduates are achieving the required standard.
- 28 April 2025
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 15
Open AccessPhysician Associate graduates have comparable knowledge to medical graduates
Background Physician associates (PAs) are medical associate professionals who work under the supervision of a doctor within multi-disciplinary teams. Though newly qualified PAs are expected to perform at the same level as newly qualified doctors, no studies have compared the level of medical knowledge upon graduation. The aim of this analysis was to determine the knowledge of PAs in comparison to medical students and Foundation Year 1 (FY1) doctors in the UK. Methods We undertook a retrospective analysis of assessment data from identical medical knowledge progress tests taken by PA students, medical students, and FY1 doctors. Student performance data were collated for each of the 88 identical items, from all cohorts, across all stages of the PA and medical programmes, as well as all cohorts of FY1 doctors sitting the exam. Results Analysis showed that PA student performance was comparable to medical students and FY1 doctors. At Stage 1 end, PA student mean performance was consistent with Stage 3 medicine (36.35%, 34.81%, respectively), whereas at Stage 2 end, PA performance was consistent with Stage 4 medicine (51.63%, 49.92%, respectively). Growth between Stage 1 and 2 PA, and Stage 3 and 4 medicine was almost identical. Significantly, many Stage 2 PA students met or exceeded Stage 5 medicine and FY1 performance upon graduation. Conclusions This is the first UK analysis that directly compares PA medical knowledge to medical students and FY1 doctors, provides evidence of the standard of PA knowledge, and reassurance that graduates are achieving the required standard.
- Open Access
- 25 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 11323-11338
Medical students' perceptions of a novel international adaptive progress test
Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.
- 25 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 11323-11338
Open AccessMedical students' perceptions of a novel international adaptive progress test
Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.
- Open Access
- 24 October 2023
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 13, 221
A narrative review of adaptive testing and its application to medical education
Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.
- 24 October 2023
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 13, 221
Open AccessA narrative review of adaptive testing and its application to medical education
Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.