The PROMIS of Better Outcome Assessment: Responsiveness, Floor and Ceiling Effects, and Internet Administration
- 1 August 2011
- journal article
- research article
- Published by The Journal of Rheumatology in The Journal of Rheumatology
- Vol. 38 (8) , 1759-1764
Abstract
Objective.: Use of item response theory (IRT) and, subsequently, computerized adaptive testing (CAT), under the umbrella of the NIH-PROMIS initiative (National Institutes of Health – Patient-Reported Outcomes Measurement Information System), to bring strong new assets to the development of more sensitive, more widely applicable, and more efficiently administered patient-reported outcome (PRO) instruments. We present data on current progress in 3 crucial areas: floor and ceiling effects, responsiveness to change, and interactive computer-based administration over the Internet.Methods.: We examined nearly 1000 patients with rheumatoid arthritis and related diseases in a series of studies including a one-year longitudinal examination of detection of change; compared responsiveness of the Legacy SF-36 and HAQ-DI instruments with IRT-based instruments; performed a randomized head-to-head trial of 4 modes of item administration; and simulated the effect of lack of floor and ceiling items upon statistical power and sample sizes.Results.: IRT-based PROMIS instruments are more sensitive to change, resulting in the potential to reduce sample size requirements substantially by up to a factor of 4. The modes of administration tested did not differ from each other in any instance by more than one-tenth of a standard deviation. Floor and ceiling effects greatly reduce the number of available subjects, particularly at the ceiling.Conclusion.: Failure to adequately address floor and ceiling effects, which determine the range of an instrument, can result in suboptimal assessment of many patients. Improved items, improved instruments, and computer-based administration improve PRO assessment and represent a fundamental advance in clinical outcomes research.Keywords
This publication has 27 references indexed in Scilit:
- Better assessment of physical function: item improvement is neglected but essentialArthritis Research & Therapy, 2009
- The Patient-Reported Outcomes Measurement Information System (PROMIS)Medical Care, 2007
- Evaluation of Item CandidatesMedical Care, 2007
- The Effects of Data Collection Mode and Disclosure on Adolescent Reporting of Health BehaviorSocial Science Computer Review, 2006
- Evaluating Patients’ Experiences with Individual PhysiciansMedical Care, 2006
- Comparability and Reliability of Paper- and Computer-Based Measures of Psychosocial Constructs for Adolescent Physical Activity and Sedentary BehaviorsResearch Quarterly for Exercise and Sport, 2005
- Untersuchung zum WILDE-Intelligenz-Test (WIT): Vergleichbarkeit der Anwendung der Papier-Bleistift-Fassung vs. computerbasierten Durchführung an Daten des Berufsförderungswerkes LeipzigDie Rehabilitation, 2005
- Measuring Stroke Impact With the Stroke Impact ScaleMedical Care, 2005
- A 12-Item Short-Form Health SurveyMedical Care, 1996
- Measurement of patient outcome in arthritisArthritis & Rheumatism, 1980