Patient-Centred Explainability in IVF Outcome Prediction
Preprint
Abstract
This paper evaluates the user interface of an in vitro fertility (IVF) outcome prediction tool, focussing on its understandability for patients or potential patients. We analyse four years of anonymous patient feedback, followed by a user survey and interviews to quantify trust and understandability. Results highlight a lay user's need for prediction model \emph{explainability} beyond the model feature space. We identify user concerns about data shifts and model exclusions that impact trust. The results call attention to the shortcomings of current practices in explainable AI research and design and the need for explainability beyond model feature space and epistemic assumptions, particularly in high-stakes healthcare contexts where users gather extensive information and develop complex mental models. To address these challenges, we propose a dialogue-based interface and explore user expectations for personalised explanations.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Towards conversational diagnostic artificial intelligenceNature, 2025
- All models are wrong and yours are useless: making clinical prediction models impactful for patientsnpj Precision Oncology, 2024
- External validation of models for predicting cumulative live birth over multiple complete cycles of IVF treatmentHuman Reproduction, 2023
- Explaining machine learning models with interactive natural language conversations using TalkToModelNature Machine Intelligence, 2023
- Does a public online IVF prediction tool help set patient expectations? A mixed methods evaluation studyHuman Reproduction, 2023
- Explaining BDI agent behaviour through dialogueAutonomous Agents and Multi-Agent Systems, 2022
- Explanatory pragmatism: a context-sensitive framework for explainable medical AIEthics and Information Technology, 2022
- Chatbots in the fight against the COVID-19 pandemicnpj Digital Medicine, 2020
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- Development and Testing of an Abbreviated Numeracy Scale: A Rasch Analysis ApproachJournal of Behavioral Decision Making, 2012