HNHoang Nguyen

Hoang Nguyen

*This is an algorithmically generated author record based on publicly available information.

Hoang Nguyen has a total of 29 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    AI for Clinical Competency Assessment: Scoping Review of Methods and Applications

    by Wenjia (Stella) Zhang, Benjamin B Daniels, Carol Mita, Hoang Nguyen, David B Duong

    Background: Strengthening the global health workforce is central to achieving universal health coverage, but health systems cannot improve what they cannot measure. Valid and scalable assessment of clinical competency is essential for monitoring workforce readiness and ensuring that expanded service coverage translates into high-quality care. Traditional standardized patients, however, remain resource-intensive, difficult to scale, and vulnerable to evaluator-related bias. Recent advances in AI have enabled AI-led simulated standardized patients (SSPs) that may address these limitations. Objective: Although existing reviews have examined AI-SSPs broadly within medical education, their use as clinical competency assessment systems remains less well characterized. This scoping review aimed to address this gap by systematically mapping the scope, design features, and validation approaches of AI-SSP tools for clinical competency assessment. Methods: We registered the protocol prospectively with the Open Science Framework and conducted a scoping review following the Joanna Briggs Institute Manual for Evidence Synthesis. We searched MEDLINE, Embase, CINAHL Complete, Education Source, Web of Science Core Collection, Inspec, ERIC, and Cochrane CENTRAL, supplemented by manual searching. Eligible primary studies involved an AI-based SSP interaction that yielded a quantitative score of respondents' clinical competency. Two reviewers independently screened records and resolved conflicts through discussion. Data were charted on study characteristics and populations, frontend platform and interface features, backend AI architectures, performance scoring mechanisms, and tool evaluation methods and outcomes. Results: Of 5987 database records and 4 identified through other methods, 21 studies describing 20 unique AI-SSP systems were included. Studies were published between 2008 and 2026, with 15 (71%) published in 2024 or later. Most studies were conducted in high-income settings and involved medical students. Systems shifted over time from rule-based virtual patient to large language model–enabled conversational platforms after 2022. History-taking was the most frequently assessed competency, and checklist coverage was the most common scoring approach. Among studies comparing AI-generated scores with human ratings, findings were mixed: some reported moderate to strong agreement, while others showed score inflation and inconsistent performance. Most studies focused on feasibility; fewer evaluated large-scale use or sustained real-world implementation. Conclusions: This review is innovative in shifting attention from AI-SSPs as educational simulations to AI-SSPs as emerging infrastructures for clinical competency assessment. Unlike prior reviews of virtual patients or AI in medical education, this review maps not only system design and learner interaction but also which competencies are assessed, how scores are generated, and how the assessment evidence has been validated. AI-SSPs could make clinical competency assessment more scalable and potentially more standardized, although more evidence is still needed to determine whether they achieve validity and reliability across diverse learner or practitioner groups.


  • Open Access

    Large language models for self-administered conversational vignette assessment of provider competencies: A pilot and validation study in Vietnam with automated LLM-powered transcript classification

    by Benjamin Daniels, Wenjia(Stella) Zhang, Hoang Nguyen, David Duong

    We developed and validated a self-administered clinical vignette platform powered by a large language model (LLM), deployed through a SurveyCTO web survey, to measure primary health care provider competencies in Vietnam. In a pilot focus group, nine physicians rated LLM-simulated patient interactions as realistic (mean 3.78/5) and user-friendly. In the validation phase, 22 providers completed 132 vignette interactions across ten clinical scenarios in Vietnamese. Essential diagnostic checklist scores (human-coded from translated transcripts) correlated with expert clinician evaluations (Pearson’s ρ = 0.55–0.60). LLM-automated coding of checklist items from translated English transcripts correlated reasonably with human coding ( ρ = 0.53), and coding directly from Vietnamese transcripts performed comparably ( ρ = 0.51), suggesting that a separate translation step may not be necessary. The total cost of 132 chatbot interactions was under USD 2. LLM-driven conversational vignettes represent a low-cost and scalable method for assessing provider competencies in respondents’ local language, eliminating the need for extensive enumeration staffs while preserving the open-ended format critical to vignette validity, and additionally introducing flexible feature extraction from transcripts using grading rubrics. The platform is open-source and designed for replication in other health system contexts. Author summary: Measuring the clinical skills of healthcare providers is essential for improving the quality of care, but current survey methods are expensive and require trained enumerators to travel to health facilities in person. We developed a new approach that uses large language models (LLMs) – the technology behind tools like ChatGPT and Claude – to simulate patients in realistic clinical conversations that healthcare providers can complete on their phones or laptops over the Internet in their own language. In Vietnam, we tested this tool with 31 physicians across ten clinical scenarios. Providers found the simulated patient conversations realistic and easy to use. We also tested whether LLMs could automatically score the conversations, which showed reasonable agreement with human scoring, and performed nearly as well when scoring directly from Vietnamese, without requiring a separate translation step. When we compared these results from our tool against holistic expert physician ratings of the same conversations, the scores agreed well, suggesting that automatic transcript grading based on rubrics produces meaningful measures of clinical skill. This tool costs less than two US dollars for over a hundred consultations and required no in-person surveyors, making it potentially transformative for routine, large-scale monitoring of healthcare quality in resource-limited settings. The platform and code are openly available for adaptation.


  • Open Access

    Barriers and enablers to people‐centred viral hepatitis care in Vietnam and the Philippines: Results of a patient journey mapping study

    by Bethany Holt, Jhaki Mendoza, Hoang Nguyen, Duong Doan, Vy H Nguyen, Daniel Joy Cabauatan, Lam Dam Duy, Martin Fernandez, Manu Gaspar, Geohari Hamoy, et al.

    In Vietnam and the Philippines, viral hepatitis is the leading cause of cirrhosis and liver cancer. This study aims to understand the barriers and enablers of people receiving care for hepatitis B and C to support both countries' efforts to eliminate viral hepatitis as a public health threat by 2030. Retrospective, semi‐structured interviews were conducted with a purposive, quota‐based sample of 63 people living with hepatitis B or C in one province of Vietnam and one region of the Philippines. A rapid deductive approach to thematic analysis produced key findings among the three phases of care: (1) pre‐awareness and testing, (2) linkage and treatment initiation and (3) ongoing treatment and recovery. The research found that participants followed five typical journeys, from a variety of entry points. Barriers during the pre‐awareness and testing phase included limited awareness about hepatitis and its management, stigma and psychological impacts. Enablers included being familiar with the health system and/or patients benefiting from social connections within the health systems. During the linkage and treatment initiation phase, barriers included difficult physical access, complex navigation and inadequate counselling. In this phase, family support emerged as a critical enabler. During the ongoing treatment and recovery phase, the cost of care and socially and culturally informed perceptions of the disease and medication use were both barriers and enablers. Exploring peoples' journeys with hepatitis B and C in Vietnam and the Philippines revealed many similarities despite the different cultural and health system contexts. Insights from this study may help generate a contextualized, people‐centred evidence base to inform the design and improvement of primary care services for hepatitis in both research sites.