Achieving assessor accuracy on the International Standards for Neurological Classification of Spinal Cord Injury
Authors:
- On Behalf Of The Clinical Trial CollaboratorsOCOn Behalf Of The Clinical Trial Collaborators
- L M GoodesLGL M Goodes
- L A HarveyLHL A Harvey
- S A DunlopSDS A Dunlop
- 20 June 2017
- journal article
- research article
- Published by Springer Nature in Spinal Cord
- Vol. 55 (11) , 994-1001
Abstract
A retrospective audit of assessor accuracy using the International Standards for Neurological Classification of Spinal Cord Injury (ISNCSCI) in three multicentre randomised controlled trials (SCIPA: Spinal Cord Injury and Physical Activity) spanning 2010-2014 with standards revised in 2011. To investigate assessor accuracy of neurological classification after spinal cord injury. Australia and New Zealand. ISNCSCI examinations were undertaken by trained clinicians prior to randomisation. Data were recorded manually and ISNCSCI worksheets circulated to panels, consensus reached and worksheets corrected. An audit team used a 2014 computerised ISNCSCI algorithm to check manual worksheets. A second audit team assessed whether the 2014 computerised algorithm accurately reflected pre- and post-2011 ISNCSCI standards. Of the 208 ISNCSCI worksheets, 24 were excluded. Of the remaining 184 worksheets, 47 (25.5%) were consistent with the 2014 computerised algorithm and 137 (74.5%) contained one or more errors. Errors were in motor (30.1%) or sensory (12.4%) levels, zone of partial preservation (24.0%), motor/sensory scoring (21.5%), ASIA Impairment Scale (AIS, 8.3%) and complete/incomplete classification (0.8%). Other difficulties included classification when anal contraction/sensation was omitted, incorrect neurological levels and violation of the 'motor follows sensory rule in non-testable myotomes' (7.4%). Panel errors comprised corrections that were incorrect or missed or incorrect changes to correct worksheets. Given inaccuracies in the manual ISNCSCI worksheets in this long-term clinical trial setting, continued training and a computerised algorithm are essential to ensure accurate scoring, scaling and classification of the ISNCSCI and confidence in clinical trials.Keywords
This publication has 28 references indexed in Scilit:
- Updates for the International Standards for Neurological Classification of Spinal Cord InjuryPhysical Medicine and Rehabilitation Clinics of North America, 2014
- Distribution-based estimates of clinically significant changes in the International Standards for Neurological Classification of Spinal Cord Injury motor and sensory scores.2013
- Computer Implementation of the International Standards for Neurological Classification of Spinal Cord Injury for Consistent and Efficient Derivation of Its Subscores Including Handling of Data from Not Testable SegmentsJournal of Neurotrauma, 2012
- Assessment of Impairment in Patients with Acute Traumatic Spinal Cord Injury: A Systematic Review of the LiteratureJournal of Neurotrauma, 2011
- 2009 Review and Revisions of the International Standards for the Neurological Classification of Spinal Cord InjuryThe Journal of Spinal Cord Medicine, 2010
- A web-based computer program to determine the ASIA impairment classificationSpinal Cord, 2009
- Inter-rater reliability of motor and sensory examinations performed according to American Spinal Injury Association standardsSpinal Cord, 2007
- Guidelines for the conduct of clinical trials for spinal cord injury (SCI) as developed by the ICCP panel: clinical trial outcome measuresSpinal Cord, 2006
- A test of the 1992 International Standards for Neurological and Functional Classification of Spinal Cord InjurySpinal Cord, 1998
- THE INTEROBSERVER RELIABILITY OF THE REVISED AMERICAN SPINAL INJURY ASSOCIATION STANDARDS FOR NEUROLOGICAL CLASSIFICATION OF SPINAL INJURY PATIENTSAmerican Journal of Physical Medicine & Rehabilitation, 1991