Yasuhiko Kimura
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yasuhiko Kimura has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
- Hajime Kasai
Department of Medical Education, Graduate School of Medicine, Chiba University, Chiba, Japan
9 shared publications - Kiyoshi Shikino
Department of Community-Oriented Medical Education, Chiba University Graduate School of Medicine, Chiba, Japan
9 shared publications - Shoichi Ito
Department of Medical Education, Graduate School of Medicine, Chiba University, Chiba, Japan
9 shared publications - Ikuo Shimizu
Department of Medical Education, Graduate School of Medicine, Chiba University, Chiba, Japan
8 shared publications - Tomoko Tsukamoto
Chiba University Hospital
6 shared publications - Hiroshi Tajima
Department of Medical Education, Graduate School of Medicine, Chiba University, Chiba, Japan
5 shared publications
Latest Publications
- Open Access
- 31 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
NotebookLM-Supported Learning After Early Clinical Exposure: A Mixed-Methods Study of Learning Processes and Presentation Quality (Preprint)
BACKGROUND Early clinical exposure provides medical students with experiences that require reflection and interpretation. Generative artificial intelligence (GenAI) may support these processes; however, its effects on the underlying learning process remain unclear. OBJECTIVE This study examined how a NotebookLM-supported, source-grounded GenAI approach shaped students’ learning processes after early clinical exposure, with a focus on students’ perceptions, information-handling practices, and final presentation quality. METHODS We conducted a convergent mixed-methods study of a third-year early clinical exposure course at a Japanese medical school. Of 117 enrolled students, 98 completed matched precourse and postcourse survey responses. After peer reflection, students used NotebookLM-supported GenAI to organize and integrate their clinical experiences with related information. We analyzed Likert-scale responses and free-text comments using quantitative analysis and qualitative content analysis, respectively. Three faculty members rated slide decks from the 2023 cohort before GenAI integration (n=15) and the 2025 cohort after GenAI integration (n=14) using a 7-item instrument. Findings were integrated using a joint display. RESULTS Most students (85/98, 86.7%) had never used NotebookLM. Confidence in organizing a topic into slides increased from a mean of 3.3 (SD 1.0) to 3.7 (SD 0.9), and self-rated ability to plan a slide structure increased from 3.0 (SD 1.1) to 3.5 (SD 1.0; both P<.01). The other five paired items showed no significant changes. After the program, 82.7% of students reported that NotebookLM helped them understand and identify key points, 80.6% reported reduced workload, 78.6% reported improved slide-preparation efficiency, and 91.8% agreed that AI outputs required critical evaluations. Qualitative findings indicated that students used GenAI-supported initial structures as starting points for review and revision and that perceived efficiency gains allowed more time for reflection and content refinement. Joint display integration showed convergence between improved self-evaluations and reports of AI-supported organization and revision and between perceived efficiency gains and redistribution of time toward deeper learning. However, these perceived changes were only partly reflected in the final products: only the use of visual materials was rated higher in 2025 than in 2023 (mean 4.1, SD 0.4 vs mean 3.8, SD 0.3; P=.04), whereas evidence-support ratings were unchanged. CONCLUSIONS A NotebookLM-supported, source-grounded GenAI approach may provide temporary scaffolding for organizing and integrating experiences and information after early clinical exposure. Students perceived gains in efficiency and changes in how they reviewed and reconstructed information; however, these changes did not correspond to broad improvements in presentation quality. Therefore, NotebookLM-supported learning should retain peer dialogue, critical appraisal, source verification, and reconstruction as explicit learning activities.
- 31 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessNotebookLM-Supported Learning After Early Clinical Exposure: A Mixed-Methods Study of Learning Processes and Presentation Quality (Preprint)
BACKGROUND Early clinical exposure provides medical students with experiences that require reflection and interpretation. Generative artificial intelligence (GenAI) may support these processes; however, its effects on the underlying learning process remain unclear. OBJECTIVE This study examined how a NotebookLM-supported, source-grounded GenAI approach shaped students’ learning processes after early clinical exposure, with a focus on students’ perceptions, information-handling practices, and final presentation quality. METHODS We conducted a convergent mixed-methods study of a third-year early clinical exposure course at a Japanese medical school. Of 117 enrolled students, 98 completed matched precourse and postcourse survey responses. After peer reflection, students used NotebookLM-supported GenAI to organize and integrate their clinical experiences with related information. We analyzed Likert-scale responses and free-text comments using quantitative analysis and qualitative content analysis, respectively. Three faculty members rated slide decks from the 2023 cohort before GenAI integration (n=15) and the 2025 cohort after GenAI integration (n=14) using a 7-item instrument. Findings were integrated using a joint display. RESULTS Most students (85/98, 86.7%) had never used NotebookLM. Confidence in organizing a topic into slides increased from a mean of 3.3 (SD 1.0) to 3.7 (SD 0.9), and self-rated ability to plan a slide structure increased from 3.0 (SD 1.1) to 3.5 (SD 1.0; both P<.01). The other five paired items showed no significant changes. After the program, 82.7% of students reported that NotebookLM helped them understand and identify key points, 80.6% reported reduced workload, 78.6% reported improved slide-preparation efficiency, and 91.8% agreed that AI outputs required critical evaluations. Qualitative findings indicated that students used GenAI-supported initial structures as starting points for review and revision and that perceived efficiency gains allowed more time for reflection and content refinement. Joint display integration showed convergence between improved self-evaluations and reports of AI-supported organization and revision and between perceived efficiency gains and redistribution of time toward deeper learning. However, these perceived changes were only partly reflected in the final products: only the use of visual materials was rated higher in 2025 than in 2023 (mean 4.1, SD 0.4 vs mean 3.8, SD 0.3; P=.04), whereas evidence-support ratings were unchanged. CONCLUSIONS A NotebookLM-supported, source-grounded GenAI approach may provide temporary scaffolding for organizing and integrating experiences and information after early clinical exposure. Students perceived gains in efficiency and changes in how they reviewed and reconstructed information; however, these changes did not correspond to broad improvements in presentation quality. Therefore, NotebookLM-supported learning should retain peer dialogue, critical appraisal, source verification, and reconstruction as explicit learning activities.
- Open Access
- 20 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Developing the Domains of Competence Required of Attending Physicians: A Modified Delphi Study (Preprint)
BACKGROUND Attending physicians have important educational responsibilities in clinical training; however, the domains of competence required for this role remain unclear. OBJECTIVE This study aimed to identify domains of competence for attending physicians involved in clinical education. METHODS We conducted a two-round modified Delphi study in 2021 with an expert panel comprising 17 attending physicians and 4 medical education faculty members at a Japanese university hospital. An initial list of 14 domains and 51 competencies was developed through a literature review and research team discussion. Panelists rated each domain on a 5-point scale. Consensus was defined as a mean score of ≥4.0, standard deviation <1.0, and ≥80% of panelists rating the item as 4 or 5. RESULTS Of the 13 domains rated in Round 2, 11 met the predefined consensus criteria (mean scores 4.0–4.8; agreement 81.0%–100%): passion for education, self-management, clinical teaching and learning, motivating learners, educational theory and evidence, communication and collaboration, assessment, curriculum development, resource management, diversity and inclusion support, and information and communication technology in education. These domains were organized using an ecological systems framework. CONCLUSIONS The identified domains offer a practical framework for faculty development and reflection among attending physicians with educational responsibilities. The inclusion of two of the domains—information and communication technology in education and diversity and inclusion support—underscores the need for attending physicians to adapt their educational practices to changing technologies, learner diversity, and local educational contexts in order to foster effective and inclusive clinical education.
- 20 October 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDeveloping the Domains of Competence Required of Attending Physicians: A Modified Delphi Study (Preprint)
BACKGROUND Attending physicians have important educational responsibilities in clinical training; however, the domains of competence required for this role remain unclear. OBJECTIVE This study aimed to identify domains of competence for attending physicians involved in clinical education. METHODS We conducted a two-round modified Delphi study in 2021 with an expert panel comprising 17 attending physicians and 4 medical education faculty members at a Japanese university hospital. An initial list of 14 domains and 51 competencies was developed through a literature review and research team discussion. Panelists rated each domain on a 5-point scale. Consensus was defined as a mean score of ≥4.0, standard deviation <1.0, and ≥80% of panelists rating the item as 4 or 5. RESULTS Of the 13 domains rated in Round 2, 11 met the predefined consensus criteria (mean scores 4.0–4.8; agreement 81.0%–100%): passion for education, self-management, clinical teaching and learning, motivating learners, educational theory and evidence, communication and collaboration, assessment, curriculum development, resource management, diversity and inclusion support, and information and communication technology in education. These domains were organized using an ecological systems framework. CONCLUSIONS The identified domains offer a practical framework for faculty development and reflection among attending physicians with educational responsibilities. The inclusion of two of the domains—information and communication technology in education and diversity and inclusion support—underscores the need for attending physicians to adapt their educational practices to changing technologies, learner diversity, and local educational contexts in order to foster effective and inclusive clinical education.
- Open Access
- 27 May 2026
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 13
Impact of Coaching on Medical Students During Their Clinical Clerkship: A Mixed-Methods Study
Background: In undergraduate medical education, clinical clerkships (CC) serve as a platform for acquiring the integrated competencies essential to physicians. Simultaneously, CC plays a crucial role in facilitating a smooth transition to postgraduate training and preventing burnout. This study aims to elucidate the effects of coaching on medical students during CC, with particular focus on self-efficacy and resilience. Methods: This was a mixed-methods study based on an explanatory sequential design. The participants were fifth-year medical students who underwent CC at Chiba University Hospital in Japan between June and October 2021. They received four weeks of one-on-one coaching during one department’s CC by other attending physicians trained as coaches. The participants answered self-assessment web questionnaires using the Japanese version of the Generalised Self-Efficacy Scale (GSE-J) and the Brief Resilience Scale Japanese version (BRS-J) before and after coaching. In addition, they participated in semi-structured focus group interviews related to the effects of coaching. Narrative data were analysed using qualitative content analysis. Results: Fifteen medical students participated in the study. The mean GSE-J and BRS-J scores (n = 13) significantly increased after coaching (from 71.0 (11.7) to 77.5 (16.2), p = 0.018, Cohen’s d = 0.76, Hedges’ g = 0.71 and from 18.5 (4.7) to 21.4 (4.1), p = 0.019, Cohen’s d = 0.75, Hedges’ g = 0.70, respectively). Four focus group interviews were conducted. The effects of coaching were classified into eight categories (goal setting and milestones, positiveness, verbalisation, self-confidence, proactivity, good communication, dealing with difficulties, and reflection and metacognition) related to self-efficacy and resilience. Conclusions: Medical students who receive coaching during CC improved their self-efficacy and resilience. Combining coaching with regular training in CC might serve as a useful educational strategy in terms of a smooth transition to postgraduate training and preventing burnout.
- 27 May 2026
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 13
Open AccessImpact of Coaching on Medical Students During Their Clinical Clerkship: A Mixed-Methods Study
Background: In undergraduate medical education, clinical clerkships (CC) serve as a platform for acquiring the integrated competencies essential to physicians. Simultaneously, CC plays a crucial role in facilitating a smooth transition to postgraduate training and preventing burnout. This study aims to elucidate the effects of coaching on medical students during CC, with particular focus on self-efficacy and resilience. Methods: This was a mixed-methods study based on an explanatory sequential design. The participants were fifth-year medical students who underwent CC at Chiba University Hospital in Japan between June and October 2021. They received four weeks of one-on-one coaching during one department’s CC by other attending physicians trained as coaches. The participants answered self-assessment web questionnaires using the Japanese version of the Generalised Self-Efficacy Scale (GSE-J) and the Brief Resilience Scale Japanese version (BRS-J) before and after coaching. In addition, they participated in semi-structured focus group interviews related to the effects of coaching. Narrative data were analysed using qualitative content analysis. Results: Fifteen medical students participated in the study. The mean GSE-J and BRS-J scores (n = 13) significantly increased after coaching (from 71.0 (11.7) to 77.5 (16.2), p = 0.018, Cohen’s d = 0.76, Hedges’ g = 0.71 and from 18.5 (4.7) to 21.4 (4.1), p = 0.019, Cohen’s d = 0.75, Hedges’ g = 0.70, respectively). Four focus group interviews were conducted. The effects of coaching were classified into eight categories (goal setting and milestones, positiveness, verbalisation, self-confidence, proactivity, good communication, dealing with difficulties, and reflection and metacognition) related to self-efficacy and resilience. Conclusions: Medical students who receive coaching during CC improved their self-efficacy and resilience. Combining coaching with regular training in CC might serve as a useful educational strategy in terms of a smooth transition to postgraduate training and preventing burnout.
- Open Access
- 28 April 2026
- Published by Springer Nature in Medical Science Educator
- Vol. 36 (3) , 1523-1531
Expanding the Roles of Medical Educators in the Generative Artificial Intelligence Era: A Qualitative Study
The rapid advancement of generative artificial intelligence (GAI) necessitates reconceptualizing medical educators’ professional roles. While Harden’s Six Roles of the Teacher have long defined educator identity, GAI integration may require expansion beyond this established framework. This study explored how medical educators perceive role evolution in the GAI era and identified emerging educator functions. A qualitative descriptive study was conducted during a faculty development program at a Japanese medical school in August 2025. Fifty-two faculty members discussed improving education using GAI. From 137 analyzed statements, content analysis applied Harden’s framework deductively, while the SAMR model assessed transformation levels. Statements showing high transformation (Modification/Redefinition) underwent inductive analysis to identify new roles. Traditional roles dominated: resource developer (n = 34), assessor (n = 29), facilitator (n = 29), information provider (n = 23), planner (n = 17), and role model (n = 5). Most statements reflected enhancement of existing practices (Substitution n = 51; Augmentation n = 67). Critically, 19 statements demonstrated transformative potential (Modification n = 15; Redefinition n = 4), revealing five emergent educator roles: analyst (evaluating GAI outputs), coordinator (orchestrating human-AI collaboration), content generator (co-creating with AI), fact checker (verifying AI accuracy), and lifelong learner (continuously adapting to AI evolution). This study demonstrates that GAI is expanding medical educators’ professional identity beyond traditional frameworks. While GAI enhances conventional roles, it simultaneously creates new responsibilities requiring critical judgment, ethical oversight, and adaptive expertise. These findings challenge the notion of AI as mere replacement, instead positioning educators as essential mediators in human-AI educational ecosystems. Faculty development must incorporate AI literacy and reflective practice to support this expanded professional identity.
- 28 April 2026
- Published by Springer Nature in Medical Science Educator
- Vol. 36 (3) , 1523-1531
Open AccessExpanding the Roles of Medical Educators in the Generative Artificial Intelligence Era: A Qualitative Study
The rapid advancement of generative artificial intelligence (GAI) necessitates reconceptualizing medical educators’ professional roles. While Harden’s Six Roles of the Teacher have long defined educator identity, GAI integration may require expansion beyond this established framework. This study explored how medical educators perceive role evolution in the GAI era and identified emerging educator functions. A qualitative descriptive study was conducted during a faculty development program at a Japanese medical school in August 2025. Fifty-two faculty members discussed improving education using GAI. From 137 analyzed statements, content analysis applied Harden’s framework deductively, while the SAMR model assessed transformation levels. Statements showing high transformation (Modification/Redefinition) underwent inductive analysis to identify new roles. Traditional roles dominated: resource developer (n = 34), assessor (n = 29), facilitator (n = 29), information provider (n = 23), planner (n = 17), and role model (n = 5). Most statements reflected enhancement of existing practices (Substitution n = 51; Augmentation n = 67). Critically, 19 statements demonstrated transformative potential (Modification n = 15; Redefinition n = 4), revealing five emergent educator roles: analyst (evaluating GAI outputs), coordinator (orchestrating human-AI collaboration), content generator (co-creating with AI), fact checker (verifying AI accuracy), and lifelong learner (continuously adapting to AI evolution). This study demonstrates that GAI is expanding medical educators’ professional identity beyond traditional frameworks. While GAI enhances conventional roles, it simultaneously creates new responsibilities requiring critical judgment, ethical oversight, and adaptive expertise. These findings challenge the notion of AI as mere replacement, instead positioning educators as essential mediators in human-AI educational ecosystems. Faculty development must incorporate AI literacy and reflective practice to support this expanded professional identity.
- Open Access
- 4 September 2025
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 11, e76702
Development of a Clinical Clerkship Mentor Using Generative AI and Evaluation of Its Effectiveness in a Medical Student Trial Compared to Student Mentors: 2-Part Comparative Study
Background: At the beginning of their clinical clerkships (CCs), medical students face multiple challenges related to acquiring clinical and communication skills, building professional relationships, and managing psychological stress. While mentoring and structured feedback are known to provide critical support, existing systems may not offer sufficient and timely guidance owing to the faculty’s limited availability. Generative artificial intelligence, particularly large language models, offers new opportunities to support medical education by providing context-sensitive responses. Objective: This study aimed to develop a generative artificial intelligence CC mentor (AI-CCM) based on ChatGPT and evaluate its effectiveness in supporting medical students’ clinical learning, addressing their concerns, and supplementing human mentoring. The secondary objective was to compare AI-CCM’s educational value with responses from senior student mentors. Methods: We conducted 2 studies. In study 1, we created 5 scenarios based on challenges that students commonly encountered during CCs. For each scenario, 5 senior student mentors and AI-CCM generated written advice. Five medical education experts evaluated these responses using a rubric to assess accuracy, practical utility, educational appropriateness (5-point Likert scale), and safety (binary scale). In study 2, a total of 17 fourth-year medical students used AI-CCM for 1 week during their CCs and completed a questionnaire evaluating its usefulness, clarity, emotional support, and impact on communication and learning (5-point Likert scale) informed by the technology acceptance model. Results: All results indicated that AI-CCM achieved higher mean scores than senior student mentors. AI-CCM responses were rated higher in educational appropriateness (4.2, SD 0.7 vs 3.8, SD 1.0; P=.001). No significant differences with senior student mentors were observed in accuracy (4.4, SD 0.7 vs 4.2, SD 0.9; P=.11) or practical utility (4.1, SD 0.7 vs 4.0, SD 0.9; P=.35). No safety concerns were identified in AI-CCM responses, whereas 2 concerns were noted in student mentors’ responses. Scenario-specific analysis revealed that AI-CCM performed substantially better in emotional and psychological stress scenarios. In the student trial, AI-CCM was rated as moderately useful (mean usefulness score 3.9, SD 1.1), with positive evaluations for clarity (4.0, SD 0.9) and emotional support (3.8, SD 1.1). However, aspects related to feedback guidance (2.9, SD 0.9) and anxiety reduction (3.2, SD 1.0) received more neutral ratings. Students primarily consulted AI-CCM regarding learning workload and communication difficulties; few students used it to address emotional stress–related issues. Conclusions: AI-CCM has the potential to serve as a supplementary educational partner during CCs, offering comparable support to that of senior student mentors in structured scenarios. Despite challenges of response latency and limited depth in clinical content, AI-CCM was received well by and accessible to students who used ChatGPT’s free version. With further refinements, including specialty-specific content and improved responsiveness, AI-CCM may serve as a scalable, context-sensitive support system in clinical medical education.
- 4 September 2025
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 11, e76702
Open AccessDevelopment of a Clinical Clerkship Mentor Using Generative AI and Evaluation of Its Effectiveness in a Medical Student Trial Compared to Student Mentors: 2-Part Comparative Study
Background: At the beginning of their clinical clerkships (CCs), medical students face multiple challenges related to acquiring clinical and communication skills, building professional relationships, and managing psychological stress. While mentoring and structured feedback are known to provide critical support, existing systems may not offer sufficient and timely guidance owing to the faculty’s limited availability. Generative artificial intelligence, particularly large language models, offers new opportunities to support medical education by providing context-sensitive responses. Objective: This study aimed to develop a generative artificial intelligence CC mentor (AI-CCM) based on ChatGPT and evaluate its effectiveness in supporting medical students’ clinical learning, addressing their concerns, and supplementing human mentoring. The secondary objective was to compare AI-CCM’s educational value with responses from senior student mentors. Methods: We conducted 2 studies. In study 1, we created 5 scenarios based on challenges that students commonly encountered during CCs. For each scenario, 5 senior student mentors and AI-CCM generated written advice. Five medical education experts evaluated these responses using a rubric to assess accuracy, practical utility, educational appropriateness (5-point Likert scale), and safety (binary scale). In study 2, a total of 17 fourth-year medical students used AI-CCM for 1 week during their CCs and completed a questionnaire evaluating its usefulness, clarity, emotional support, and impact on communication and learning (5-point Likert scale) informed by the technology acceptance model. Results: All results indicated that AI-CCM achieved higher mean scores than senior student mentors. AI-CCM responses were rated higher in educational appropriateness (4.2, SD 0.7 vs 3.8, SD 1.0; P=.001). No significant differences with senior student mentors were observed in accuracy (4.4, SD 0.7 vs 4.2, SD 0.9; P=.11) or practical utility (4.1, SD 0.7 vs 4.0, SD 0.9; P=.35). No safety concerns were identified in AI-CCM responses, whereas 2 concerns were noted in student mentors’ responses. Scenario-specific analysis revealed that AI-CCM performed substantially better in emotional and psychological stress scenarios. In the student trial, AI-CCM was rated as moderately useful (mean usefulness score 3.9, SD 1.1), with positive evaluations for clarity (4.0, SD 0.9) and emotional support (3.8, SD 1.1). However, aspects related to feedback guidance (2.9, SD 0.9) and anxiety reduction (3.2, SD 1.0) received more neutral ratings. Students primarily consulted AI-CCM regarding learning workload and communication difficulties; few students used it to address emotional stress–related issues. Conclusions: AI-CCM has the potential to serve as a supplementary educational partner during CCs, offering comparable support to that of senior student mentors in structured scenarios. Despite challenges of response latency and limited depth in clinical content, AI-CCM was received well by and accessible to students who used ChatGPT’s free version. With further refinements, including specialty-specific content and improved responsiveness, AI-CCM may serve as a scalable, context-sensitive support system in clinical medical education.
- Open Access
- 30 May 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Development of a Clinical Clerkship Mentor Using Generative AI and Evaluation of Its Effectiveness in a Medical Student Trial Compared to Student Mentors: 2-Part Comparative Study (Preprint)
BACKGROUND At the beginning of their clinical clerkships (CCs), medical students face multiple challenges related to acquiring clinical and communication skills, building professional relationships, and managing psychological stress. While mentoring and structured feedback are known to provide critical support, existing systems may not offer sufficient and timely guidance owing to the faculty’s limited availability. Generative artificial intelligence, particularly large language models, offers new opportunities to support medical education by providing context-sensitive responses. OBJECTIVE This study aimed to develop a generative artificial intelligence CC mentor (AI-CCM) based on ChatGPT and evaluate its effectiveness in supporting medical students’ clinical learning, addressing their concerns, and supplementing human mentoring. The secondary objective was to compare AI-CCM’s educational value with responses from senior student mentors. METHODS We conducted 2 studies. In study 1, we created 5 scenarios based on challenges that students commonly encountered during CCs. For each scenario, 5 senior student mentors and AI-CCM generated written advice. Five medical education experts evaluated these responses using a rubric to assess accuracy, practical utility, educational appropriateness (5-point Likert scale), and safety (binary scale). In study 2, a total of 17 fourth-year medical students used AI-CCM for 1 week during their CCs and completed a questionnaire evaluating its usefulness, clarity, emotional support, and impact on communication and learning (5-point Likert scale) informed by the technology acceptance model. RESULTS All results indicated that AI-CCM achieved higher mean scores than senior student mentors. AI-CCM responses were rated higher in educational appropriateness (4.2, SD 0.7 vs 3.8, SD 1.0; P=.001). No significant differences with senior student mentors were observed in accuracy (4.4, SD 0.7 vs 4.2, SD 0.9; P=.11) or practical utility (4.1, SD 0.7 vs 4.0, SD 0.9; P=.35). No safety concerns were identified in AI-CCM responses, whereas 2 concerns were noted in student mentors’ responses. Scenario-specific analysis revealed that AI-CCM performed substantially better in emotional and psychological stress scenarios. In the student trial, AI-CCM was rated as moderately useful (mean usefulness score 3.9, SD 1.1), with positive evaluations for clarity (4.0, SD 0.9) and emotional support (3.8, SD 1.1). However, aspects related to feedback guidance (2.9, SD 0.9) and anxiety reduction (3.2, SD 1.0) received more neutral ratings. Students primarily consulted AI-CCM regarding learning workload and communication difficulties; few students used it to address emotional stress–related issues. CONCLUSIONS AI-CCM has the potential to serve as a supplementary educational partner during CCs, offering comparable support to that of senior student mentors in structured scenarios. Despite challenges of response latency and limited depth in clinical content, AI-CCM was received well by and accessible to students who used ChatGPT’s free version. With further refinements, including specialty-specific content and improved responsiveness, AI-CCM may serve as a scalable, context-sensitive support system in clinical medical education.
- 30 May 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDevelopment of a Clinical Clerkship Mentor Using Generative AI and Evaluation of Its Effectiveness in a Medical Student Trial Compared to Student Mentors: 2-Part Comparative Study (Preprint)
BACKGROUND At the beginning of their clinical clerkships (CCs), medical students face multiple challenges related to acquiring clinical and communication skills, building professional relationships, and managing psychological stress. While mentoring and structured feedback are known to provide critical support, existing systems may not offer sufficient and timely guidance owing to the faculty’s limited availability. Generative artificial intelligence, particularly large language models, offers new opportunities to support medical education by providing context-sensitive responses. OBJECTIVE This study aimed to develop a generative artificial intelligence CC mentor (AI-CCM) based on ChatGPT and evaluate its effectiveness in supporting medical students’ clinical learning, addressing their concerns, and supplementing human mentoring. The secondary objective was to compare AI-CCM’s educational value with responses from senior student mentors. METHODS We conducted 2 studies. In study 1, we created 5 scenarios based on challenges that students commonly encountered during CCs. For each scenario, 5 senior student mentors and AI-CCM generated written advice. Five medical education experts evaluated these responses using a rubric to assess accuracy, practical utility, educational appropriateness (5-point Likert scale), and safety (binary scale). In study 2, a total of 17 fourth-year medical students used AI-CCM for 1 week during their CCs and completed a questionnaire evaluating its usefulness, clarity, emotional support, and impact on communication and learning (5-point Likert scale) informed by the technology acceptance model. RESULTS All results indicated that AI-CCM achieved higher mean scores than senior student mentors. AI-CCM responses were rated higher in educational appropriateness (4.2, SD 0.7 vs 3.8, SD 1.0; P=.001). No significant differences with senior student mentors were observed in accuracy (4.4, SD 0.7 vs 4.2, SD 0.9; P=.11) or practical utility (4.1, SD 0.7 vs 4.0, SD 0.9; P=.35). No safety concerns were identified in AI-CCM responses, whereas 2 concerns were noted in student mentors’ responses. Scenario-specific analysis revealed that AI-CCM performed substantially better in emotional and psychological stress scenarios. In the student trial, AI-CCM was rated as moderately useful (mean usefulness score 3.9, SD 1.1), with positive evaluations for clarity (4.0, SD 0.9) and emotional support (3.8, SD 1.1). However, aspects related to feedback guidance (2.9, SD 0.9) and anxiety reduction (3.2, SD 1.0) received more neutral ratings. Students primarily consulted AI-CCM regarding learning workload and communication difficulties; few students used it to address emotional stress–related issues. CONCLUSIONS AI-CCM has the potential to serve as a supplementary educational partner during CCs, offering comparable support to that of senior student mentors in structured scenarios. Despite challenges of response latency and limited depth in clinical content, AI-CCM was received well by and accessible to students who used ChatGPT’s free version. With further refinements, including specialty-specific content and improved responsiveness, AI-CCM may serve as a scalable, context-sensitive support system in clinical medical education.
- Open Access
- 21 May 2025
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 12
Exploring the Essential Competencies for Medical Education in the Post-COVID-19 Pandemic Era: A Mixed-Methods Investigation at a Japanese Medical School
Background: The coronavirus disease 2019 (COVID-19) pandemic has led to considerable advances in medical education through technological integration. The crisis generated by the pandemic in medical practice, education, and evolving technology has led to changes in the skills of medical professionals. This study aimed to examine the competencies required of medical students in the post-pandemic era. Methods: We conducted 2 mixed-methods studies. Study 1 explored medical students’ necessary competencies after the COVID-19 pandemic. We conducted group work with faculty members and students from the Chiba University School of Medicine, captured proposed competencies, discussed them, and qualitatively analyzed the group work data using content analysis to extract the competencies. Study 2 was a secondary data analysis that compared the categories identified in Study 1 with the competencies required prior to the COVID-19 pandemic, which were extracted from the websites of all 82 medical schools and colleges in Japan, to identify the differences in competencies before and after the pandemic. Results: Study 1 resulted in the identification of 12 categories and 62 subcategories. The results of Study 2 showed that the increased occurrence of competencies was related to the utilization of information and communication technology (ICT) and artificial intelligence (AI), self-management, information gathering and explanation, liberal arts and generic skills, and exploring medicine and medical care/research presentations. The prevalence rates of these factors prior to the COVID-19 outbreak were 17.1%, 28.0%, 39.0%, 41.5%, and 48.8%, respectively. Conclusions: Competency-based medical education in ICT, self-management, and medical exploration has become increasingly important after the pandemic. Therefore, it is necessary to develop an educational curriculum to enable medical students to acquire these competencies. The study findings contribute to the literature on medical education and offer valuable insight into setting effective academic goals and designing suitable curricula for undergraduate medical students in the post-pandemic era.
- 21 May 2025
- Published by SAGE Publications in Journal of Medical Education and Curricular Development
- Vol. 12
Open AccessExploring the Essential Competencies for Medical Education in the Post-COVID-19 Pandemic Era: A Mixed-Methods Investigation at a Japanese Medical School
Background: The coronavirus disease 2019 (COVID-19) pandemic has led to considerable advances in medical education through technological integration. The crisis generated by the pandemic in medical practice, education, and evolving technology has led to changes in the skills of medical professionals. This study aimed to examine the competencies required of medical students in the post-pandemic era. Methods: We conducted 2 mixed-methods studies. Study 1 explored medical students’ necessary competencies after the COVID-19 pandemic. We conducted group work with faculty members and students from the Chiba University School of Medicine, captured proposed competencies, discussed them, and qualitatively analyzed the group work data using content analysis to extract the competencies. Study 2 was a secondary data analysis that compared the categories identified in Study 1 with the competencies required prior to the COVID-19 pandemic, which were extracted from the websites of all 82 medical schools and colleges in Japan, to identify the differences in competencies before and after the pandemic. Results: Study 1 resulted in the identification of 12 categories and 62 subcategories. The results of Study 2 showed that the increased occurrence of competencies was related to the utilization of information and communication technology (ICT) and artificial intelligence (AI), self-management, information gathering and explanation, liberal arts and generic skills, and exploring medicine and medical care/research presentations. The prevalence rates of these factors prior to the COVID-19 outbreak were 17.1%, 28.0%, 39.0%, 41.5%, and 48.8%, respectively. Conclusions: Competency-based medical education in ICT, self-management, and medical exploration has become increasingly important after the pandemic. Therefore, it is necessary to develop an educational curriculum to enable medical students to acquire these competencies. The study findings contribute to the literature on medical education and offer valuable insight into setting effective academic goals and designing suitable curricula for undergraduate medical students in the post-pandemic era.
- Open Access
- 30 November 2023
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 9, e53466
Developing Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study
Background: Generative artificial intelligence (GAI), represented by large language models, have the potential to transform health care and medical education. In particular, GAI’s impact on higher education has the potential to change students’ learning experience as well as faculty’s teaching. However, concerns have been raised about ethical consideration and decreased reliability of the existing examinations. Furthermore, in medical education, curriculum reform is required to adapt to the revolutionary changes brought about by the integration of GAI into medical practice and research. Objective: This study analyzes the impact of GAI on medical education curricula and explores strategies for adaptation. Methods: The study was conducted in the context of faculty development at a medical school in Japan. A workshop involving faculty and students was organized, and participants were divided into groups to address two research questions: (1) How does GAI affect undergraduate medical education curricula? and (2) How should medical school curricula be reformed to address the impact of GAI? The strength, weakness, opportunity, and threat (SWOT) framework was used, and cross-SWOT matrix analysis was used to devise strategies. Further, 4 researchers conducted content analysis on the data generated during the workshop discussions. Results: The data were collected from 8 groups comprising 55 participants. Further, 5 themes about the impact of GAI on medical education curricula emerged: improvement of teaching and learning, improved access to information, inhibition of existing learning processes, problems in GAI, and changes in physicians’ professionality. Positive impacts included enhanced teaching and learning efficiency and improved access to information, whereas negative impacts included concerns about reduced independent thinking and the adaptability of existing assessment methods. Further, GAI was perceived to change the nature of physicians’ expertise. Three themes emerged from the cross-SWOT analysis for curriculum reform: (1) learning about GAI, (2) learning with GAI, and (3) learning aside from GAI. Participants recommended incorporating GAI literacy, ethical considerations, and compliance into the curriculum. Learning with GAI involved improving learning efficiency, supporting information gathering and dissemination, and facilitating patient involvement. Learning aside from GAI emphasized maintaining GAI-free learning processes, fostering higher cognitive domains of learning, and introducing more communication exercises. Conclusions: This study highlights the profound impact of GAI on medical education curricula and provides insights into curriculum reform strategies. Participants recognized the need for GAI literacy, ethical education, and adaptive learning. Further, GAI was recognized as a tool that can enhance efficiency and involve patients in education. The study also suggests that medical education should focus on competencies that GAI hardly replaces, such as clinical experience and communication. Notably, involving both faculty and students in curriculum reform discussions fosters a sense of ownership and ensures broader perspectives are encompassed.
- 30 November 2023
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 9, e53466
Open AccessDeveloping Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study
Background: Generative artificial intelligence (GAI), represented by large language models, have the potential to transform health care and medical education. In particular, GAI’s impact on higher education has the potential to change students’ learning experience as well as faculty’s teaching. However, concerns have been raised about ethical consideration and decreased reliability of the existing examinations. Furthermore, in medical education, curriculum reform is required to adapt to the revolutionary changes brought about by the integration of GAI into medical practice and research. Objective: This study analyzes the impact of GAI on medical education curricula and explores strategies for adaptation. Methods: The study was conducted in the context of faculty development at a medical school in Japan. A workshop involving faculty and students was organized, and participants were divided into groups to address two research questions: (1) How does GAI affect undergraduate medical education curricula? and (2) How should medical school curricula be reformed to address the impact of GAI? The strength, weakness, opportunity, and threat (SWOT) framework was used, and cross-SWOT matrix analysis was used to devise strategies. Further, 4 researchers conducted content analysis on the data generated during the workshop discussions. Results: The data were collected from 8 groups comprising 55 participants. Further, 5 themes about the impact of GAI on medical education curricula emerged: improvement of teaching and learning, improved access to information, inhibition of existing learning processes, problems in GAI, and changes in physicians’ professionality. Positive impacts included enhanced teaching and learning efficiency and improved access to information, whereas negative impacts included concerns about reduced independent thinking and the adaptability of existing assessment methods. Further, GAI was perceived to change the nature of physicians’ expertise. Three themes emerged from the cross-SWOT analysis for curriculum reform: (1) learning about GAI, (2) learning with GAI, and (3) learning aside from GAI. Participants recommended incorporating GAI literacy, ethical considerations, and compliance into the curriculum. Learning with GAI involved improving learning efficiency, supporting information gathering and dissemination, and facilitating patient involvement. Learning aside from GAI emphasized maintaining GAI-free learning processes, fostering higher cognitive domains of learning, and introducing more communication exercises. Conclusions: This study highlights the profound impact of GAI on medical education curricula and provides insights into curriculum reform strategies. Participants recognized the need for GAI literacy, ethical education, and adaptive learning. Further, GAI was recognized as a tool that can enhance efficiency and involve patients in education. The study also suggests that medical education should focus on competencies that GAI hardly replaces, such as clinical experience and communication. Notably, involving both faculty and students in curriculum reform discussions fosters a sense of ownership and ensures broader perspectives are encompassed.
- Open Access
- 7 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Developing Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study (Preprint)
BACKGROUND Generative artificial intelligence (GAI), represented by large language models, have the potential to transform health care and medical education. In particular, GAI’s impact on higher education has the potential to change students’ learning experience as well as faculty’s teaching. However, concerns have been raised about ethical consideration and decreased reliability of the existing examinations. Furthermore, in medical education, curriculum reform is required to adapt to the revolutionary changes brought about by the integration of GAI into medical practice and research. OBJECTIVE This study analyzes the impact of GAI on medical education curricula and explores strategies for adaptation. METHODS The study was conducted in the context of faculty development at a medical school in Japan. A workshop involving faculty and students was organized, and participants were divided into groups to address two research questions: (1) How does GAI affect undergraduate medical education curricula? and (2) How should medical school curricula be reformed to address the impact of GAI? The strength, weakness, opportunity, and threat (SWOT) framework was used, and cross-SWOT matrix analysis was used to devise strategies. Further, 4 researchers conducted content analysis on the data generated during the workshop discussions. RESULTS The data were collected from 8 groups comprising 55 participants. Further, 5 themes about the impact of GAI on medical education curricula emerged: improvement of teaching and learning, improved access to information, inhibition of existing learning processes, problems in GAI, and changes in physicians’ professionality. Positive impacts included enhanced teaching and learning efficiency and improved access to information, whereas negative impacts included concerns about reduced independent thinking and the adaptability of existing assessment methods. Further, GAI was perceived to change the nature of physicians’ expertise. Three themes emerged from the cross-SWOT analysis for curriculum reform: (1) learning about GAI, (2) learning with GAI, and (3) learning aside from GAI. Participants recommended incorporating GAI literacy, ethical considerations, and compliance into the curriculum. Learning with GAI involved improving learning efficiency, supporting information gathering and dissemination, and facilitating patient involvement. Learning aside from GAI emphasized maintaining GAI-free learning processes, fostering higher cognitive domains of learning, and introducing more communication exercises. CONCLUSIONS This study highlights the profound impact of GAI on medical education curricula and provides insights into curriculum reform strategies. Participants recognized the need for GAI literacy, ethical education, and adaptive learning. Further, GAI was recognized as a tool that can enhance efficiency and involve patients in education. The study also suggests that medical education should focus on competencies that GAI hardly replaces, such as clinical experience and communication. Notably, involving both faculty and students in curriculum reform discussions fosters a sense of ownership and ensures broader perspectives are encompassed.
- 7 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDeveloping Medical Education Curriculum Reform Strategies to Address the Impact of Generative AI: Qualitative Study (Preprint)
BACKGROUND Generative artificial intelligence (GAI), represented by large language models, have the potential to transform health care and medical education. In particular, GAI’s impact on higher education has the potential to change students’ learning experience as well as faculty’s teaching. However, concerns have been raised about ethical consideration and decreased reliability of the existing examinations. Furthermore, in medical education, curriculum reform is required to adapt to the revolutionary changes brought about by the integration of GAI into medical practice and research. OBJECTIVE This study analyzes the impact of GAI on medical education curricula and explores strategies for adaptation. METHODS The study was conducted in the context of faculty development at a medical school in Japan. A workshop involving faculty and students was organized, and participants were divided into groups to address two research questions: (1) How does GAI affect undergraduate medical education curricula? and (2) How should medical school curricula be reformed to address the impact of GAI? The strength, weakness, opportunity, and threat (SWOT) framework was used, and cross-SWOT matrix analysis was used to devise strategies. Further, 4 researchers conducted content analysis on the data generated during the workshop discussions. RESULTS The data were collected from 8 groups comprising 55 participants. Further, 5 themes about the impact of GAI on medical education curricula emerged: improvement of teaching and learning, improved access to information, inhibition of existing learning processes, problems in GAI, and changes in physicians’ professionality. Positive impacts included enhanced teaching and learning efficiency and improved access to information, whereas negative impacts included concerns about reduced independent thinking and the adaptability of existing assessment methods. Further, GAI was perceived to change the nature of physicians’ expertise. Three themes emerged from the cross-SWOT analysis for curriculum reform: (1) learning about GAI, (2) learning with GAI, and (3) learning aside from GAI. Participants recommended incorporating GAI literacy, ethical considerations, and compliance into the curriculum. Learning with GAI involved improving learning efficiency, supporting information gathering and dissemination, and facilitating patient involvement. Learning aside from GAI emphasized maintaining GAI-free learning processes, fostering higher cognitive domains of learning, and introducing more communication exercises. CONCLUSIONS This study highlights the profound impact of GAI on medical education curricula and provides insights into curriculum reform strategies. Participants recognized the need for GAI literacy, ethical education, and adaptive learning. Further, GAI was recognized as a tool that can enhance efficiency and involve patients in education. The study also suggests that medical education should focus on competencies that GAI hardly replaces, such as clinical experience and communication. Notably, involving both faculty and students in curriculum reform discussions fosters a sense of ownership and ensures broader perspectives are encompassed.