The progress test as a structuring initiative for programmatic assessment
Authors:
- Débora Cristina AlavarceDADébora Cristina Alavarce
- Melyssa Lima de MedeirosMMMelyssa Lima de Medeiros
- Danylo de Araújo VianaDVDanylo de Araújo Viana
- Flávia AbadeFAFlávia Abade
- Joaquim Edson VieiraJVJoaquim Edson Vieira
- José Lúcio Martins MachadoJMJosé Lúcio Martins Machado
- Carlos Fernando CollaresCCCarlos Fernando Collares
Open Access
- 21 May 2024
- journal article
- research article
- Published by Springer Nature in BMC Medical Education
- Vol. 24 (1) , 1-7
Abstract
Background: The Progress Test is an individual assessment applied to all students at the same time and on a regular basis. The test was structured in the medical undergraduate education of a conglomerate of schools to structure a programmatic assessment integrated into teaching. This paper presents the results of four serial applications of the progress test and the feedback method to students. Methods: This assessment comprises 120 items offered online by means of a personal password. Items are authored by faculty, peer-reviewed, and approved by a committee of experts. The items are classified by five major areas, by topics used by the National Board of Medical Examiners and by medical specialties related to a national Unified Health System. The correction uses the Item Response Theory with analysis by the “Rasch” model that considers the difficulty of the item. Results: Student participation increased along the four editions of the tests, considering the number of enrollments. The median performances increased in the comparisons among the sequential years in all tests, except for test1 – the first test offered to schools. Between subsequent years of education, 2nd-1st; 4th-3rd and 5th-4th there was an increase in median scores from progress tests 2 through 4. The final year of undergraduate showed a limited increase compared to the 5th year. There is a consistent increase in the median, although with fluctuations between the observed intervals. Conclusion: The progress test promoted the establishment of regular feedback among students, teachers and coordinators and paved the road to engagement much needed to construct an institutional programmatic assessment.Keywords
This publication has 14 references indexed in Scilit:
- Ottawa 2020 consensus statements for programmatic assessment – 2. Implementation and practiceMedical Teacher, 2021
- Using longitudinal progress test data to determine the effect size of learning in undergraduate medical education – a retrospective, single-center, mixed model analysis of progress testing resultsMedical Education Online, 2021
- Curriculum management/monitoring in undergraduate medical education: a systematized reviewBMC Medical Education, 2019
- 2018 Consensus framework for good assessmentMedical Teacher, 2018
- Progress test utopiaPerspectives on Medical Education, 2018
- Embedding of the progress test in an assessment program designed according to the principles of programmatic assessmentMedical Teacher, 2016
- Estruturação de Sistemas para Avaliação Programática do Estudante de MedicinaRevista Brasileira de Educação Médica, 2016
- Twelve tips for blueprintingMedical Teacher, 2009
- The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11Medical Teacher, 2009
- The assessment of clinical skills/competence/performanceAcademic Medicine, 1990