Generative AI in Otolaryngology Residency Personal Statement Writing: A Mixed‐Methods Analysis
Open Access
- 14 April 2025
- journal article
- Published by Wiley in The Laryngoscope
- Vol. 135 (10) , 3570-3578
Abstract
Objective: Generative Artificial Intelligence (GAI) interfaces have rapidly integrated into various societal domains. Widespread accessibility of GAI for drafting personal statements poses challenges for evaluators to gauge writing ability and personal insight. This study aims to compare the quality of GAI‐generated personal statements to those written by successful applicants in OHNS residency programs, via integration of statistical and qualitative thematic analyses.Methods: Personal statements were collected from successful OHNS residency applicants. Characteristic extraction from submitted statements was used to generate GAI‐written personal statements using ChatGPT 4.0. All statements were blindly reviewed by 21 experienced evaluators on a 10‐point Likert scale of authenticity, readability, personability, and overall quality. Thematic analysis of qualitative reviewer comments was conducted to extract deeper insights into evaluators' perceptions. Quantitative results were compared using independent t‐tests, while thematic coding was performed inductively using NVivo software.Results: GAI‐generated personal statements significantly outperformed applicant‐written statements in all assessed domains, including authenticity (7.67 vs. 7.05, p = 0.002), readability (8.03 vs. 7.49, p = 0.002), personability (7.33 vs. 6.72, p = 0.004), and overall score (7.49 vs. 6.90, p = 0.005). Thematic analysis revealed that GAI statements were seen as “well‐constructed but generic,” while applicant statements were often “verbose and lacked focus.” Additionally, reviewers noted concerns regarding personal insight and engagement in AI‐generated statements.Conclusion: GAI‐generated personal statements were rated more favorably across all domains, raising critical questions about the future of personal statements in the residency application process. While AI in medical education continues to evolve, clear guidelines on its ethical use in residency applications are essential.Level of Evidence: N/AKeywords
This publication has 28 references indexed in Scilit:
- Evidence‐Based Medicine in Otolaryngology Part 17: A Qualitative Research PrimerOtolaryngology–Head and Neck Surgery, 2025
- ChatGPT in medicine: A cross-disciplinary systematic review of ChatGPT’s (artificial intelligence) role in research, clinical practice, education, and patient interactionMedicine, 2024
- Digital Ink and Surgical Dreams: Perceptions of Artificial Intelligence–Generated Essays in Residency ApplicationsJournal of Surgical Research, 2024
- Distinguishing Authentic Voices in the Age of ChatGPT: Comparing AI-Generated and Applicant-Written Personal Statements for Plastic Surgery Residency ApplicationAnnals of Plastic Surgery, 2023
- Artificial intelligence software can generate residency application personal statements that program directors find acceptable and difficult to distinguish from applicant compositionsJournal of Clinical Anesthesia, 2023
- ChatGPT and large language model (LLM) chatbots: The current state of acceptability and a proposal for guidelines on utilization in academic medicineJournal of Pediatric Urology, 2023
- Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?Seminars in Nuclear Medicine, 2023
- Will ChatGPT Match to Your Program?American Journal of Physical Medicine & Rehabilitation, 2023
- Promoting Diversity, Equity, and Inclusion in the Selection of Obstetrician–GynecologistsObstetrics & Gynecology, 2021
- Applicant Perspectives on the Otolaryngology Residency Application ProcessJAMA Otolaryngology–Head & Neck Surgery, 2017