The Clinical Suitability of an Artificial Intelligence–Enabled Pain Assessment Tool for Use in Infants: Feasibility and Usability Evaluation Study
Open Access
- 13 February 2023
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25 (1) , e41992
Abstract
Background: Infants are unable to self-report their pain, which, therefore, often goes underrecognized and undertreated. Adequate assessment of pain, including procedural pain, which has short- and long-term consequences, is critical for its management. The introduction of mobile health–based (mHealth) pain assessment tools could address current challenges and is an area requiring further research. Objective: The purpose of this study is to evaluate the accuracy and feasibility aspects of PainChek Infant and, therefore, assess its applicability in the intended setting. Methods: By observing infants just before, during, and after immunization, we evaluated the accuracy and precision at different cutoff scores of PainChek Infant, which is a point-of-care mHealth–based solution that uses artificial intelligence to detect pain and intensity based solely on facial expression. We used receiver operator characteristic analysis to assess interpretability and establish a cutoff score. Clinician comprehensibility was evaluated using a standardized questionnaire. Other feasibility aspects were evaluated based on comparison with currently available observational pain assessment tools for use in infants with procedural pain. Results: Both PainChek Infant Standard and Adaptive modes demonstrated high accuracy (area under the curve 0.964 and 0.966, respectively). At a cutoff score of ≥2, accuracy and precision were 0.908 and 0.912 for Standard and 0.912 and 0.897 for Adaptive modes, respectively. Currently available data allowed evaluation of 16 of the 17 feasibility aspects, with only the cost of the outcome measurement instrument unable to be evaluated since it is yet to be determined. PainChek Infant performed well across feasibility aspects, including interpretability (cutoff score defined), ease of administration, completion time (3 seconds), and clinician comprehensibility. Conclusions: This work provides information on the feasibility of using PainChek Infant in clinical practice for procedural pain assessment and monitoring, and demonstrates the accuracy and precision of the tool at the defined cutoff score.Keywords
This publication has 33 references indexed in Scilit:
- Newborn circumcision outcomes: Are parents satisfied with the results?Pediatric Surgery International, 2013
- Procedural Pain Management in Neonates, Infants and ChildrenReviews in Pain, 2011
- Reliability, validity and clinical utility of three types of pain behavioural observation scales for young children with burns aged 0–5 yearsPain, 2010
- The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi studyQuality of Life Research, 2010
- Facial Expression and Pain Assessment in the Pediatric Patient: The Primal Face of PainJournal for Specialists in Pediatric Nursing, 2008
- Self-assessment of immediate post-vaccination pain after two different MMR vaccines administered as a second dose in 4- to 6-year-old childrenVaccine, 2004
- The expression of pain in infants with developmental delaysChild: Care, Health and Development, 2004
- The Recognition of Facial Expression of Pain in Full-Term Newborns by Parents and Health ProfessionalsArchives of Pediatrics & Adolescent Medicine, 2000
- A revised measure of acute pain in infantsJournal of Pain and Symptom Management, 1995
- Patient OutcomesClinical Nurse Specialist, 1995