Quantifying the Quality of Parent-Child Interaction Through Machine-Learning Based Audio and Video Analysis: Towards a Vision of AI-assisted Coaching Support for Social Workers
Open Access
- 13 January 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Journal on Computing and Sustainable Societies
- Vol. 2 (1) , 1-21
Abstract
Attachment is the emotional bonding between a child and a caregiver. Whether or not there is a secure attachment in early childhood has a profound life-long impact on the child. In recent years, attachment-based interventions have been developed and implemented, especially with families from low socioeconomic backgrounds. One important aspect of the program is to assess the quality of parent-child interactions through audio/video recorded at home while parent-child dyads were engaged in semi-structured interaction tasks, such as “three-bag-assessment.” The current practice relies on human coders to rate the videos, which is a time-consuming process. Using a dataset of 220 video recordings of parent-child dyads collected at home as part of an attachment-based intervention program, we prototype a machine learning approach based on human body keypoints extracted from the posture analysis tool OpenPose and voice activity features derived from audio recordings. The results show that there are potential values in using machine learning to improve the coding efficiency of parent-child interactions. When further developed and improved, this kind of model may contribute to a new vision of AI-assisted parenting coaching support to make evidence-based interventions accessible and affordable at a large scale to children and families.Keywords
This publication has 13 references indexed in Scilit:
- Incorporating Measures of Intermodal Coordination in Automated Analysis of Infant-Mother Interaction2020
- Parent and Child Voice Activity Detection in Pivotal Response Treatment Video Probes2019
- Improving early head start’s impacts on parenting through attachment-based intervention: A randomized controlled trial.Developmental Psychology, 2018
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017
- Attachment and Biobehavioral Catch-up: addressing the needs of infants and toddlers exposed to inadequate or problematic caregivingCurrent Opinion in Psychology, 2017
- Commentary: New Directions in Developmentally Informed Intervention Research for Vulnerable PopulationsChild Development, 2017
- Testing maternal depression and attachment style as moderators of early head start's effects on parentingAttachment & Human Development, 2011
- The Effectiveness of Early Head Start for 3-Year-Old Children and Their Parents: Lessons for Policy and Programs.Developmental Psychology, 2005
- The Ecology of Attachment in the FamilyFamily Process, 2003
- Infant–mother attachment.American Psychologist, 1979