José Miguel Pêgo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
José Miguel Pêgo has a total of 219 co-authors. Here are the top co-authors by number of shared publications:
- Nuno Sousa
Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho
32 shared publications - João José Cerqueira
Life and Health Sciences Research Institute (ICVS), University of Minho, 4710-057 Braga, Portugal
14 shared publications - Ana João Rodrigues
Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal
10 shared publications - Jorge Correia-Pinto
School of Medicine, University of Minho, Braga, Portugal
10 shared publications - Osborne F. X. Almeida
Max Planck Institute of Psychiatry, 80804 Munich, Germany
9 shared publications - Carla Rolanda
Department of Gastroenterology, Braga Hospital, Braga, Portugal
7 shared publications
Latest Publications
- Open Access
- 10 October 2026
- Published by Taylor & Francis in Medical Education Online
- Vol. 31 (1)
Entrustable professional activities in medical education: strategies and results - a systematic review
The evolution of medical education is closely linked to the evolution of medicine and important landmarks can be found through the centuries, laying the foundations for Competence-Based Medical Edu...
- 10 October 2026
- Published by Taylor & Francis in Medical Education Online
- Vol. 31 (1)
Open AccessEntrustable professional activities in medical education: strategies and results - a systematic review
The evolution of medical education is closely linked to the evolution of medicine and important landmarks can be found through the centuries, laying the foundations for Competence-Based Medical Edu...
- Open Access
- 18 December 2025
- Published by Ordem dos Medicos in Acta Medica Portuguesa
- Vol. 39 (1) , 23-32
Development and Psychometric Validation of the Minho Suture Assessment Scale (Minho-SAS) for Medical Students
Introduction: Even though mastery of suturing is a core technical skill in surgical education, existing tools for its assessment often lack psychometric validation or are not specifically designed for undergraduate training. The aim of this study was to develop and validate the Minho Suture Assessment Scale (Minho-SAS), a structured instrument to evaluate fundamental suturing competencies in medical students. The research question was whether the Minho-SAS demonstrates validity and reliability as a psychometric tool.Methods: The development process involved collaboration with multidisciplinary surgical teams and experienced practitioners to ensure content validity. Data from a cohort of medical students were utilized for psychometric evaluation. Dimensionality was assessed using parallel analysis, Bayesian information criterion, unidimensional congruence, item unidimensional congruence, explained common variance, item explained common variance and mean of item residual absolute loadings. Validity based on internal structure was assessed with Rasch model analysis and factor analysis from the tetrachoric correlation matrix. Reliability was assessed using Rasch model standard errors of measurement to obtain a conditional reliability curve and Cronbach’s alpha and McDonald’s omega internal consistency coefficients.Results: Analyses supported a unidimensional structure for the Minho-SAS. The single-factor solution explained 39.96% of variance, and Rasch measures accounted for 29.15% (16.43% by persons, 12.72% by items). Residual correlations, factor loadings, and item fit statistics were within acceptable ranges. Reliability indices were satisfactory: Rasch reliability = 0.706; McDonald’s omega = 0.889; Cronbach’s alpha = 0.883.Conclusion: The Minho-SAS is a robust instrument specifically tailored for assessing fundamental suturing skills among medical students. Rasch model analysis yielded less favorable results than factor analysis, yet still acceptable. While demonstrating considerable potential, further exploration of Minho-SAS across diverse populations and educational settings is crucial to affirm its broader applicability and impact in medical education and clinical practice.
- 18 December 2025
- Published by Ordem dos Medicos in Acta Medica Portuguesa
- Vol. 39 (1) , 23-32
Open AccessDevelopment and Psychometric Validation of the Minho Suture Assessment Scale (Minho-SAS) for Medical Students
Introduction: Even though mastery of suturing is a core technical skill in surgical education, existing tools for its assessment often lack psychometric validation or are not specifically designed for undergraduate training. The aim of this study was to develop and validate the Minho Suture Assessment Scale (Minho-SAS), a structured instrument to evaluate fundamental suturing competencies in medical students. The research question was whether the Minho-SAS demonstrates validity and reliability as a psychometric tool.Methods: The development process involved collaboration with multidisciplinary surgical teams and experienced practitioners to ensure content validity. Data from a cohort of medical students were utilized for psychometric evaluation. Dimensionality was assessed using parallel analysis, Bayesian information criterion, unidimensional congruence, item unidimensional congruence, explained common variance, item explained common variance and mean of item residual absolute loadings. Validity based on internal structure was assessed with Rasch model analysis and factor analysis from the tetrachoric correlation matrix. Reliability was assessed using Rasch model standard errors of measurement to obtain a conditional reliability curve and Cronbach’s alpha and McDonald’s omega internal consistency coefficients.Results: Analyses supported a unidimensional structure for the Minho-SAS. The single-factor solution explained 39.96% of variance, and Rasch measures accounted for 29.15% (16.43% by persons, 12.72% by items). Residual correlations, factor loadings, and item fit statistics were within acceptable ranges. Reliability indices were satisfactory: Rasch reliability = 0.706; McDonald’s omega = 0.889; Cronbach’s alpha = 0.883.Conclusion: The Minho-SAS is a robust instrument specifically tailored for assessing fundamental suturing skills among medical students. Rasch model analysis yielded less favorable results than factor analysis, yet still acceptable. While demonstrating considerable potential, further exploration of Minho-SAS across diverse populations and educational settings is crucial to affirm its broader applicability and impact in medical education and clinical practice.
- Open Access
- 20 November 2025
- Published by Elsevier in Journal of Surgical Education
- Vol. 83 (1) , 103779
Assessing the Impact of Different Feedback Mechanisms on Suture Skills Acquisition: A Mixed Methods Study Using Phenomenological and Quantitative Analysis
- 20 November 2025
- Published by Elsevier in Journal of Surgical Education
- Vol. 83 (1) , 103779
Open AccessAssessing the Impact of Different Feedback Mechanisms on Suture Skills Acquisition: A Mixed Methods Study Using Phenomenological and Quantitative Analysis
- 16 July 2024
- Published by Taylor & Francis in Medical Teacher
- Vol. 47 (4) , 677-683
ChatGPT as an item calibration tool: Psychometric insights in a high-stakes examination
ChatGPT has attracted a lot of interest worldwide for its versatility in a range of natural language tasks, including in the education and evaluation industry. It can automate time- and labor-intensive tasks with clear economic and efficiency gains. This study evaluated the potential of ChatGPT to automate psychometric analysis of test questions from the 2020 Portuguese National Residency Selection Exam (PNA). ChatGPT was queried 100 times with the 150 MCQ from the exam. Using ChatGPT's responses, difficulty indices were calculated for each question based on the proportion of correct answers. The predicted difficulty levels were compared to the actual difficulty levels of the 2020 exam MCQ's using methods from classical test theory. ChatGPT's predicted item difficulty indices positively correlated with the actual item difficulties (r (148) = -0.372, p < .001), suggesting a general consistency between the real and the predicted values. There was also a moderate significant negative correlation between the difficulty index predicted by ChatGPT and the number of challenges (r (148) = -0.302, p < .001), highlighting ChatGPT's potential for identifying less problematic questions. These findings unveiled ChatGPT's potential as a tool for assessment development, proving its capability to predict the psychometric characteristics of high-stakes test items in automated item calibration without pre-testing in real-life scenarios.
- 16 July 2024
- Published by Taylor & Francis in Medical Teacher
- Vol. 47 (4) , 677-683
ChatGPT as an item calibration tool: Psychometric insights in a high-stakes examination
ChatGPT has attracted a lot of interest worldwide for its versatility in a range of natural language tasks, including in the education and evaluation industry. It can automate time- and labor-intensive tasks with clear economic and efficiency gains. This study evaluated the potential of ChatGPT to automate psychometric analysis of test questions from the 2020 Portuguese National Residency Selection Exam (PNA). ChatGPT was queried 100 times with the 150 MCQ from the exam. Using ChatGPT's responses, difficulty indices were calculated for each question based on the proportion of correct answers. The predicted difficulty levels were compared to the actual difficulty levels of the 2020 exam MCQ's using methods from classical test theory. ChatGPT's predicted item difficulty indices positively correlated with the actual item difficulties (r (148) = -0.372, p < .001), suggesting a general consistency between the real and the predicted values. There was also a moderate significant negative correlation between the difficulty index predicted by ChatGPT and the number of challenges (r (148) = -0.302, p < .001), highlighting ChatGPT's potential for identifying less problematic questions. These findings unveiled ChatGPT's potential as a tool for assessment development, proving its capability to predict the psychometric characteristics of high-stakes test items in automated item calibration without pre-testing in real-life scenarios.
- Open Access
- 25 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 11323-11338
Medical students' perceptions of a novel international adaptive progress test
Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.
- 25 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 11323-11338
Open AccessMedical students' perceptions of a novel international adaptive progress test
Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.
- Open Access
- 24 October 2023
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 13, 221
A narrative review of adaptive testing and its application to medical education
Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.
- 24 October 2023
- Published by F1000 Research Ltd in MedEdPublish
- Vol. 13, 221
Open AccessA narrative review of adaptive testing and its application to medical education
Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.
- Open Access
- 25 April 2023
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 28 (5) , 1441-1465
A suggestive approach for assessing item quality, usability and validity of Automatic Item Generation
Automatic Item Generation (AIG) refers to the process of using cognitive models to generate test items using computer modules. It is a new but rapidly evolving research area where cognitive and psychometric theory are combined into digital framework. However, assessment of the item quality, usability and validity of AIG relative to traditional item development methods lacks clarification. This paper takes a top-down strong theory approach to evaluate AIG in medical education. Two studies were conducted: Study I—participants with different levels of clinical knowledge and item writing experience developed medical test items both manually and through AIG. Both item types were compared in terms of quality and usability (efficiency and learnability); Study II—Automatically generated items were included in a summative exam in the content area of surgery. A psychometric analysis based on Item Response Theory inspected the validity and quality of the AIG-items. Items generated by AIG presented quality, evidences of validity and were adequate for testing student’s knowledge. The time spent developing the contents for item generation (cognitive models) and the number of items generated did not vary considering the participants' item writing experience or clinical knowledge. AIG produces numerous high-quality items in a fast, economical and easy to learn process, even for inexperienced and without clinical training item writers. Medical schools may benefit from a substantial improvement in cost-efficiency in developing test items by using AIG. Item writing flaws can be significantly reduced thanks to the application of AIG's models, thus generating test items capable of accurately gauging students' knowledge.
- 25 April 2023
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 28 (5) , 1441-1465
Open AccessA suggestive approach for assessing item quality, usability and validity of Automatic Item Generation
Automatic Item Generation (AIG) refers to the process of using cognitive models to generate test items using computer modules. It is a new but rapidly evolving research area where cognitive and psychometric theory are combined into digital framework. However, assessment of the item quality, usability and validity of AIG relative to traditional item development methods lacks clarification. This paper takes a top-down strong theory approach to evaluate AIG in medical education. Two studies were conducted: Study I—participants with different levels of clinical knowledge and item writing experience developed medical test items both manually and through AIG. Both item types were compared in terms of quality and usability (efficiency and learnability); Study II—Automatically generated items were included in a summative exam in the content area of surgery. A psychometric analysis based on Item Response Theory inspected the validity and quality of the AIG-items. Items generated by AIG presented quality, evidences of validity and were adequate for testing student’s knowledge. The time spent developing the contents for item generation (cognitive models) and the number of items generated did not vary considering the participants' item writing experience or clinical knowledge. AIG produces numerous high-quality items in a fast, economical and easy to learn process, even for inexperienced and without clinical training item writers. Medical schools may benefit from a substantial improvement in cost-efficiency in developing test items by using AIG. Item writing flaws can be significantly reduced thanks to the application of AIG's models, thus generating test items capable of accurately gauging students' knowledge.
- Open Access
- 14 October 2022
- Published by Center for Open Science in OSF Preprints
Medical students' perceptions on a novel international adaptive progress test
Purpose of the Article: Between 2018-2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing.Materials and Methods: Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests.Results: Overall satisfaction with the organisation and delivery of online tests was high regardless of previous experience with progress testing. In questions probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study.Conclusions: Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. The assessment linked to students’ true knowledge increases their motivation for learning and in turn, improves their performance.
- 14 October 2022
- Published by Center for Open Science in OSF Preprints
Open AccessMedical students' perceptions on a novel international adaptive progress test
Purpose of the Article: Between 2018-2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing.Materials and Methods: Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests.Results: Overall satisfaction with the organisation and delivery of online tests was high regardless of previous experience with progress testing. In questions probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study.Conclusions: Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. The assessment linked to students’ true knowledge increases their motivation for learning and in turn, improves their performance.
- Open Access
- 6 June 2022
- Published by Elsevier in Computers and Education: Artificial Intelligence
- Vol. 3
The development and implementation of a computer adaptive progress test across European countries
- 6 June 2022
- Published by Elsevier in Computers and Education: Artificial Intelligence
- Vol. 3
Open AccessThe development and implementation of a computer adaptive progress test across European countries
- 1 March 2022
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 27 (2) , 405-425
Feasibility assurance: a review of automatic item generation in medical assessment
Background Current demand for multiple-choice questions (MCQs) in medical assessment is greater than the supply. Consequently, an urgency for new item development methods arises. Automatic Item Generation (AIG) promises to overcome this burden, generating calibrated items based on the work of computer algorithms. Despite the promising scenario, there is still no evidence to encourage a general application of AIG in medical assessment. It is therefore important to evaluate AIG regarding its feasibility, validity and item quality. Objective Provide a narrative review regarding the feasibility, validity and item quality of AIG in medical assessment. Methods Electronic databases were searched for peer-reviewed, English language articles published between 2000 and 2021 by means of the terms ‘Automatic Item Generation’, ‘Automated Item Generation’, ‘AIG’, ‘medical assessment’ and ‘medical education’. Reviewers screened 119 records and 13 full texts were checked according to the inclusion criteria. A validity framework was implemented in the included studies to draw conclusions regarding the validity of AIG. Results A total of 10 articles were included in the review. Synthesized data suggests that AIG is a valid and feasible method capable of generating high-quality items. Conclusions AIG can solve current problems related to item development. It reveals itself as an auspicious next-generation technique for the future of medical assessment, promising several quality items both quickly and economically.
- 1 March 2022
- Published by Springer Nature in Advances in Health Sciences Education
- Vol. 27 (2) , 405-425
Feasibility assurance: a review of automatic item generation in medical assessment
Background Current demand for multiple-choice questions (MCQs) in medical assessment is greater than the supply. Consequently, an urgency for new item development methods arises. Automatic Item Generation (AIG) promises to overcome this burden, generating calibrated items based on the work of computer algorithms. Despite the promising scenario, there is still no evidence to encourage a general application of AIG in medical assessment. It is therefore important to evaluate AIG regarding its feasibility, validity and item quality. Objective Provide a narrative review regarding the feasibility, validity and item quality of AIG in medical assessment. Methods Electronic databases were searched for peer-reviewed, English language articles published between 2000 and 2021 by means of the terms ‘Automatic Item Generation’, ‘Automated Item Generation’, ‘AIG’, ‘medical assessment’ and ‘medical education’. Reviewers screened 119 records and 13 full texts were checked according to the inclusion criteria. A validity framework was implemented in the included studies to draw conclusions regarding the validity of AIG. Results A total of 10 articles were included in the review. Synthesized data suggests that AIG is a valid and feasible method capable of generating high-quality items. Conclusions AIG can solve current problems related to item development. It reveals itself as an auspicious next-generation technique for the future of medical assessment, promising several quality items both quickly and economically.