Lack of Concordance in Interrater Scoring of the Provider's Global Assessment of Children With Juvenile Idiopathic Arthritis With Low Disease Activity
Authors:
- 6 December 2017
- journal article
- research article
- Published by Wiley in Arthritis Care & Research
- Vol. 70 (1) , 162-166
Abstract
Objective: To measure agreement among raters when scoring the physician/provider global assessment (PGA) of disease activity in patients with juvenile idiopathic arthritis (JIA) with no apparent disease activity, and to identify clinical and laboratory parameters that most strongly influence provider scoring of the PGA.Methods: Profiles of clinical and laboratory findings from 20 patients with JIA with no apparent disease activity were given to 51 providers, who were asked to score the PGA using a 21‐circle visual analog scale (range 0–10). Following initial scoring, providers discussed each profile and reasons for assigning the score given, and then were asked to rescore each profile. Providers were asked to list variables that influenced their scoring most strongly. Using a mixed‐model approach, the intraclass correlation coefficient (ICC) of the final scores served as the measure of concordance.Results: A total of 504 PGA scores were obtained. The overall ICC of the initial scores was 0.18. Thus, 18% of nonconcordance of the scores was attributable to patient differences, while 82% was due to provider variation. Variables that influenced scoring most strongly were (in order of frequency) presence of pain, questionable temporomandibular joint involvement, loss of joint motion, presence of any morning stiffness, psoriasis, and past history of uveitis.Conclusion: The low ICC suggests poor agreement among providers scoring the PGA in JIA patients with low or no disease activity. Given the ubiquitous use of the PGA in classification and response criteria for JIA and other pediatric rheumatic diseases, substantive efforts are needed to bring about greater uniformity in scoring of global disease activity by providers.Keywords
This publication has 15 references indexed in Scilit:
- Current Developments in the Use of Biomarkers for Juvenile Idiopathic ArthritisCurrent Rheumatology Reports, 2014
- Two Randomized Trials of Canakinumab in Systemic Juvenile Idiopathic ArthritisNew England Journal of Medicine, 2012
- American College of Rheumatology provisional criteria for defining clinical inactive disease in select categories of juvenile idiopathic arthritisArthritis Care & Research, 2011
- The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositisArthritis Care & Research, 2010
- Measuring process of arthritis care: A proposed set of quality measures for the process of care in juvenile idiopathic arthritisArthritis Care & Research, 2010
- Evaluation of 21-Numbered Circle and 10-Centimeter Horizontal Line Visual Analog Scales for Physician and Parent Subjective Ratings in Juvenile Idiopathic ArthritisThe Journal of Rheumatology, 2010
- The Pediatric Rheumatology International Trials Organization/American College of Rheumatology provisional criteria for the evaluation of response to therapy in juvenile systemic lupus erythematosus: Prospective validation of the definition of improvementArthritis Care & Research, 2006
- Standardization of Uveitis Nomenclature for Reporting Clinical Data. Results of the First International WorkshopAmerican Journal of Ophthalmology, 2005
- Preliminary core sets of measures for disease activity and damage assessment in juvenile systemic lupus erythematosus and juvenile dermatomyositisRheumatology, 2003
- Preliminary definition of improvement in juvenile arthritisArthritis & Rheumatism, 1997