The Role of Large Language Models in Hormonal Contraception Consultation
Open Access
- 15 July 2026
- journal article
- research article
- Published by MDPI AG in Journal of Clinical Medicine
- Vol. 15 (14) , 5543
Abstract
Background: Large Language Models (LLMs) demonstrate promise in medical applications, but their performance in hormonal contraception consultation remains underexplored. Objective: To evaluate the accuracy and comprehensiveness of LLM-generated hormonal contraception counseling compared to evidence-based guidelines. Methods: Ten fictitious clinical case scenarios representing common contraceptive counseling situations were presented to Chat-GPT, Google Gemini, and OpenEvidence. Cases assessed medical eligibility screening, contraindication recognition, drug interactions, side effect management, and emergency contraception guidance. Two board-certified obstetrician–gynecologists independently evaluated the responses based on international clinical guidelines. Results: Across the ten predefined clinical scenarios, all three LLMs achieved high accuracy in identifying contraindications according to Medical Eligibility Criteria (MEC) and provided appropriate alternative contraceptive recommendations. Models demonstrated high proficiency in managing drug interactions, particularly the lamotrigine–estrogen interaction, and provided evidence-based side effect management strategies. However, the communication styles differed. Chat-GPT emphasized structured consultation and shared decision-making, Gemini provided practical action-oriented guidance, and OpenEvidence delivered concise evidence-focused summaries. Conclusions: In this limited set of standardized fictitious cases, the evaluated LLMs generally provided responses that were broadly aligned with selected guideline recommendations. Current LLMs require cautious deployment, given limitations in individualized assessment and health literacy optimization, and are best positioned as complementary educational tools rather than replacements for professional contraceptive counseling.Keywords
This publication has 20 references indexed in Scilit:
- Advancing healthcare with large language models: A scoping review of applications and future directionsInternational Journal of Medical Informatics, 2025
- Artificial intelligence in obstetrics and gynecology: Evaluating ChatGPT and Google Gemini in answering patient questionsInternational Journal of Gynecology & Obstetrics, 2025
- Artificial intelligence in endometriosis care: A comparative analysis of large language model and human specialist responses to endometriosis-related queriesEuropean Journal of Obstetrics & Gynecology and Reproductive Biology, 2025
- Large language models and women’s health: a digital companion for informed decision-makingArchives of Gynecology and Obstetrics, 2025
- Evaluating the use of large language models to provide clinical recommendations in the Emergency DepartmentNature Communications, 2024
- The Transformative Potential of AI in Obstetrics and GynaecologyJournal of Obstetrics and Gynaecology Canada, 2023
- Large language models in medicineNature Medicine, 2023
- The promise and peril of using a large language model to obtain clinical information: ChatGPT performs strongly as a fertility counseling tool with limitationsFertility and Sterility, 2023
- The exciting potential for ChatGPT in obstetrics and gynecologyAmerican Journal of Obstetrics and Gynecology, 2023
- Hormonal Contraception. Guideline of the DGGG, OEGGG and SGGG (S3 Level, AWMF Registry Number 015/015, January 2020)Geburtshilfe und Frauenheilkunde, 2021