Limited evidence of test‐retest reliability in infant‐directed speech preference in a large preregistered infant experiment
Authors:
- Melanie S. SchreinerMSMelanie S. Schreiner
- Martin ZetterstenMZMartin Zettersten
- Christina BergmannCBChristina Bergmann
- Michael C. FrankMFMichael C. Frank
- Tom FritzscheTFTom Fritzsche
- Nayeli Gonzalez‐GomezNGNayeli Gonzalez‐Gomez
- Kiley HamlinKHKiley Hamlin
- Natalia KartushinaNKNatalia Kartushina
- Danielle J. KellierDKDanielle J. Kellier
- Nivedita ManiNMNivedita Mani
- Julien MayorJMJulien Mayor
- Jenny SaffranJSJenny Saffran
Open Access
- 22 July 2024
- journal article
- research article
- Published by Wiley in Developmental Science
- Vol. 27 (6) , e13551
Abstract
Test‐retest reliability—establishing that measurements remain consistent across multiple testing sessions—is critical to measuring, understanding, and predicting individual differences in infant language development. However, previous attempts to establish measurement reliability in infant speech perception tasks are limited, and reliability of frequently used infant measures is largely unknown. The current study investigated the test‐retest reliability of infants’ preference for infant‐directed speech over adult‐directed speech in a large sample (N = 158) in the context of the ManyBabies1 collaborative research project. Labs were asked to bring in participating infants for a second appointment retesting infants on their preference for infant‐directed speech. This approach allowed us to estimate test‐retest reliability across three different methods used to investigate preferential listening in infancy: the head‐turn preference procedure, central fixation, and eye‐tracking. Overall, we found no consistent evidence of test‐retest reliability in measures of infants’ speech preference (overall r = 0.09, 95% CI [−0.06,0.25]). While increasing the number of trials that infants needed to contribute for inclusion in the analysis revealed a numeric growth in test‐retest reliability, it also considerably reduced the study's effective sample size. Therefore, future research on infant development should take into account that not all experimental measures may be appropriate for assessing individual differences between infants.Research Highlights: We assessed test‐retest reliability of infants’ preference for infant‐directed over adult‐directed speech in a large pre‐registered sample (N = 158). There was no consistent evidence of test‐retest reliability in measures of infants’ speech preference. Applying stricter criteria for the inclusion of participants may lead to higher test‐retest reliability, but at the cost of substantial decreases in sample size. Developmental research relying on stable individual differences should consider the underlying reliability of its measures.Keywords
Funding Information
- Norges Forskningsråd (301625)
- National Natural Science Foundation of China (NSFDGE‐1747503)
This publication has 34 references indexed in Scilit:
- Testing prosodic development with the Headturn Preference Procedure: A test‐retest reliability studyInfant and Child Development, 2022
- Six solutions for more reliable infant researchInfant and Child Development, 2021
- Contrasting behavioral looking procedures: a case study on infant speech segmentationInfant Behavior and Development, 2020
- Listen up! Developmental differences in the impact of IDS on speech segmentationCognition, 2017
- British English infants segment words only with exaggerated infant-directed speech stimuliCognition, 2016
- Input and uptake at 7 months predicts toddler vocabulary: the role of child-directed speech and infant processing skills in language developmentJournal of Child Language, 2015
- When do infants begin recognizing familiar words in sentences?Journal of Child Language, 2012
- Cerebral responses to infant-directed speech and the effect of talker familiarityNeuroImage, 2012
- Chapter 4. Using infant and toddler testing methods in language acquisition research2010
- A cross-language study of prosodic modifications in mothers' and fathers' speech to preverbal infantsJournal of Child Language, 1989