Evaluation of an Item Bank for a Computerized Adaptive Test of Activity in Children With Cerebral Palsy
Open Access
- 1 June 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Physical Therapy
- Vol. 89 (6) , 589-600
Abstract
Background: Contemporary clinical assessments of activity are needed across the age span for children with cerebral palsy (CP). Computerized adaptive testing (CAT) has the potential to efficiently administer items for children across wide age spans and functional levels. Objective: The objective of this study was to examine the psychometric properties of a new item bank and simulated computerized adaptive test to assess activity level abilities in children with CP. Design: This was a cross-sectional item calibration study. Methods: The convenience sample consisted of 308 children and youth with CP, aged 2 to 20 years (X=10.7, SD=4.0), recruited from 4 pediatric hospitals. We collected parent-report data on an initial set of 45 activity items. Using an Item Response Theory (IRT) approach, we compared estimated scores from the activity item bank with concurrent instruments, examined discriminate validity, and developed computer simulations of a CAT algorithm with multiple stop rules to evaluate scale coverage, score agreement with CAT algorithms, and discriminant and concurrent validity. Results: Confirmatory factor analysis supported scale unidimensionality, local item dependence, and invariance. Scores from the computer simulations of the prototype CATs with varying stop rules were consistent with scores from the full item bank (r=.93–.98). The activity summary scores discriminated across levels of upper-extremity and gross motor severity and were correlated with the Pediatric Outcomes Data Collection Instrument (PODCI) physical function and sports subscale (r=.86), the Functional Independence Measure for Children (Wee-FIM) (r=.79), and the Pediatric Quality of Life Inventory–Cerebral Palsy version (r=.74). Limitations: The sample size was small for such IRT item banks and CAT development studies. Another limitation was oversampling of children with CP at higher functioning levels. Conclusions: The new activity item bank appears to have promise for use in a CAT application for the assessment of activity abilities in children with CP across a wide age range and different levels of motor severity.Keywords
This publication has 50 references indexed in Scilit:
- Development of a parent‐report computer‐adaptive test to assess physical functioning in children with cerebral palsy I: lower‐extremity and mobility skillsDevelopmental Medicine & Child Neurology, 2009
- Measuring global physical health in children with cerebral palsy: illustration of a multidimensional bi-factor model and computerized adaptive testingQuality of Life Research, 2009
- An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Test Statistic in Structural Equation ModelsSociological Methods & Research, 2008
- Measuring Physical Functioning in Children With Spinal Impairments With Computerized Adaptive TestingJournal of Pediatric Orthopaedics, 2008
- Assessing Self-Care and Social Function Using a Computer Adaptive Testing Version of the Pediatric Evaluation of Disability InventoryArchives of Physical Medicine and Rehabilitation, 2008
- Using Cognitive Interviewing for Test Items to Assess Physical Function in Children with Cerebral PalsyPediatric Physical Therapy, 2008
- A Monte Carlo Study of Recovery of Weak Factor Loadings in Confirmatory Factor AnalysisStructural Equation Modeling: A Multidisciplinary Journal, 2006
- Computerized adaptive testing for measuring development of young childrenStatistics in Medicine, 2006
- Who best to make the assessment? Professionals' and families' classifications of gross motor function in cerebral palsy are highly consistentArchives of Disease in Childhood, 2006
- Recent Developments in the Factor Analysis of Categorical VariablesJournal of Educational Statistics, 1986