Making the Most of Your Research Budget: Efficiency of a Three-Method Measurement Design With Planned Missing Data
Authors:
- 9 September 2018
- journal article
- research article
- Published by SAGE Publications in Assessment
- Vol. 27 (5) , 903-920
Abstract
Planned missing data (PMD) designs are an elegant way to incorporate expensive gold standard methods (e.g., biomarker) and cheaper but systematically biased methods (e.g., questionnaires) in research designs while ensuring high statistical power and low research costs. This article outlines a PMD design with one expensive gold standard and two cheap but biased methods (three-method measurement [3-MM] design). The cost effectiveness of different 3-MM-PMD designs is investigated and compared with the cost effectiveness of corresponding same-price two-method measurement designs using a simulation study. The results underline that PMD designs yield higher statistical power compared with complete data designs in a wide variety of conditions. Adding a second cheap method to the measurement model (i.e., using a 3-MM-PMD design) can increase the statistical power of the research design even further while keeping costs constant, when the additional measure is inexpensive, shares only small amounts of bias variance with the initial cheap measure, and when the gold standard measure is highly expensive compared with the cheap measures. Recommendations as well as a computer program for finding the optimal research design are provided.Keywords
This publication has 27 references indexed in Scilit:
- Two-Method Measurement for Adolescent Obesity Epidemiology: Reducing the Bias in Self-Report of Height and WeightJournal of Adolescent Health, 2013
- Diagnostic procedures in autism spectrum disorders: a systematic literature reviewEuropean Child & Adolescent Psychiatry, 2013
- A Measurement Model of Youth Physical Activity Using Pedometer and Self, Parent, and Peer ReportsInternational Journal of Behavioral Medicine, 2010
- Self‐reports, peer ratings and construct validityEuropean Journal of Personality, 2010
- Informant reports: A cheap, fast, and easy method for personality assessmentJournal of Research in Personality, 2006
- Development and initial validation of a 15-item informant version of the Geriatric Depression ScaleInternational Journal of Geriatric Psychiatry, 2005
- Accuracy of Mothers' Retrospective Reports of Smoking During Pregnancy: Comparison with Twin Sister Informant RatingsTwin Research, 2003
- Responses to stress in adolescence: Measurement of coping and involuntary stress responses.Journal of Consulting and Clinical Psychology, 2000
- Robustness Studies in Covariance Structure ModelingSociological Methods & Research, 1998
- Validity of self-reports of alcohol and other drug use: A multitrait-multimethod assessment.Journal of Personality and Social Psychology, 1985