Assessing and accounting for measurement in intensive longitudinal studies: current practices, considerations, and avenues for improvement
Open Access
- 13 June 2024
- journal article
- research article
- Published by Springer Nature in Quality of Life Research
- Vol. 33 (8) , 2107-2118
Abstract
Purpose: Intensive longitudinal studies, in which participants complete questionnaires multiple times a day over an extended period, are increasingly popular in the social sciences in general and quality-of-life research in particular. The intensive longitudinal methods allow for studying the dynamics of constructs (e.g., how much patient-reported outcomes vary across time). These methods promise higher ecological validity and lower recall bias than traditional methods that question participants only once, since the high frequency means that participants complete questionnaires in their everyday lives and do not have to retrospectively report about a large time interval. However, to ensure the validity of the results obtained from analyzing the intensive longitudinal data (ILD), greater awareness and understanding of appropriate measurement practices are needed. Method: We surveyed 42 researchers experienced with ILD regarding their measurement practices and reasons for suboptimal practices. Results: Results showed that researchers typically do not use measures validated specifically for ILD. Participants assessing the psychometric properties and invariance of measures in their current studies was even less common, as was accounting for these properties when analyzing dynamics. This was mainly because participants did not have the necessary knowledge to conduct these assessments or were unaware of their importance for drawing valid inferences. Open science practices, in contrast, appear reasonably well ingrained in ILD studies. Conclusion: Measurement practices in ILD still need improvement in some key areas; we provide recommendations in order to create a solid foundation for measuring and analyzing psychological constructs.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- A primer on two-level dynamic structural equation models for intensive longitudinal data in Mplus.Psychological Methods, 2020
- Measurement error and person-specific reliability in multilevel autoregressive modeling.Psychological Methods, 2019
- Conversion of standard retrospective patient-reported outcomes to momentary versions: cognitive interviewing reveals varying degrees of momentary compatibilityQuality of Life Research, 2017
- Montreal Accord on Patient-Reported Outcomes (PROs) use series – Paper 2: terminology proposed to measure what matters in healthJournal of Clinical Epidemiology, 2017
- The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research.Emotion, 2017
- Measurement invariance conventions and reporting: The state of the art and future directions for psychological researchDevelopmental Review, 2016
- Hypothesis Testing Using Factor Score RegressionEducational and Psychological Measurement, 2016
- Advantages and psychometric validation of proximal intensive assessments of patient-reported outcomes collected in daily lifeQuality of Life Research, 2015
- Ambulatory and diary methods can facilitate the measurement of patient-reported outcomesQuality of Life Research, 2015
- Reporting practices in confirmatory factor analysis: An overview and some recommendations.Psychological Methods, 2009