Automated Measurement of Facial Expression in Infant–Mother Interaction: A Pilot Study
Abstract
Automated facial measurement using computer vision has the potential to objectively document continuous changes in behavior. To examine emotional expression and communication, we used automated measurements to quantify smile strength, eye constriction, and mouth opening in two 6‐month‐old infant‐mother dyads who each engaged in a face‐to‐face interaction. Automated measurements showed high associations with anatomically based manual coding (concurrent validity); measurements of smiling showed high associations with mean ratings of positive emotion made by naive observers (construct validity). For both infants and mothers, smile strength and eye constriction (the Duchenne marker) were correlated over time, creating a continuous index of smile intensity. Infant and mother smile activity exhibited changing (nonstationary) local patterns of association, suggesting the dyadic repair and dissolution of states of affective synchrony. The study provides insights into the potential and limitations of automated measurement of facial action.Keywords
This publication has 64 references indexed in Scilit:
- Visual disengagement in the infant siblings of children with an autism spectrum disorder (ASD)Autism, 2008
- Infant Smiling Dynamics and Perceived Positive EmotionJournal of Nonverbal Behavior, 2008
- Active appearance models with occlusionImage and Vision Computing, 2006
- Adult Perceptions of Positive and Negative Infant Emotional ExpressionsInfancy, 2005
- Automatic facial expression analysis: a surveyPattern Recognition, 2003
- Expressions of positive emotion in women's college yearbook pictures and their relationship to personality and life outcomes across adulthood.Journal of Personality and Social Psychology, 2001
- Expressions of positive emotion in women's college yearbook pictures and their relationship to personality and life outcomes across adulthood.Journal of Personality and Social Psychology, 2001
- The effects of averaging subjective probability estimates between and within judges.Journal of Experimental Psychology: Applied, 2000
- Preschoolers' attention and emotion in an achievement and an effect game: A longitudinal studyCognition and Emotion, 1992
- Emotions and emotional communication in infants.American Psychologist, 1989