Mary Jane Mulcahey
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Mary Jane Mulcahey has a total of 61 co-authors. Here are the top co-authors by number of shared publications:
John Gaughan
4 shared publicationsRandal Betz
Shriners Hospitals for Children, Philadelphia, Pennsylvania; 2Temple University Medical School, Philadelphia, Pennsylvania; 3Shriners Hospitals for Children, Chicago, Illinois
4 shared publicationsRandal R. Betz
4 shared publicationsChristina Calhoun
3 shared publicationsRoss S. Chafetz
3 shared publicationsStephen M. Haley
Stephen M. Haley, PhD, is Professor, Health and Disability Research Institute, Boston University, Boston, MA
3 shared publications
Latest Publications
- 1 September 2012
- Published by Wolters Kluwer Health in Journal of Pediatric Orthopaedics
- Vol. 32 (Supplement) , S114-S122
Evaluation of the Box and Blocks Test, Stereognosis and Item Banks of Activity and Upper Extremity Function in Youths With Brachial Plexus Birth Palsy
One of the greatest limitations to measuring outcomes in pediatric orthopaedics is the lack of effective instruments. Computer adaptive testing, which uses large item banks, select only items that are relevant to a child’s function based on a previous response and filters items that are too easy or too hard or simply not relevant to the child. In this way, computer adaptive testing provides for a meaningful, efficient, and precise method to evaluate patient-reported outcomes. Banks of items that assess activity and upper extremity (UE) function have been developed for children with cerebral palsy and have enabled computer adaptive tests that showed strong reliability, strong validity, and broader content range when compared with traditional instruments. Because of the void in instruments for children with brachial plexus birth palsy (BPBP) and the importance of having an UE and activity scale, we were interested in how well these items worked in this population. Cross-sectional, multicenter study involving 200 children with BPBP was conducted. The box and block test (BBT) and Stereognosis tests were administered and patient reports of UE function and activity were obtained with the cerebral palsy item banks. Differential item functioning (DIF) was examined. Predictive ability of the BBT and stereognosis was evaluated with proportional odds logistic regression model. Spearman correlations coefficients (rs) were calculated to examine correlation between stereognosis and the BBT and between individual stereognosis items and the total stereognosis score. Six of the 86 items showed DIF, indicating that the activity and UE item banks may be useful for computer adaptive tests for children with BPBP. The penny and the button were strongest predictors of impairment level (odds ratio=0.34 to 0.40]. There was a good positive relationship between total stereognosis and BBT scores (rs=0.60). The BBT had a good negative (rs=−0.55) and good positive (rs=0.55) relationship with the clinical category of BPBP and Raimondi classification, respectively. There was a moderate negative (rs=−0.36) and moderate positive (rs=0.47) relationship between total stereognosis and clinical category of BPBP and Raimondi, respectively. Individual stereognosis items had moderate (rs=0.34 to 0.45) to good (rs=0.52 to 0.74) correlation with total stereognosis score. In children with BPBP, there was little to no DIF with item banks of activity and UE functioning. The BBT is a good predictor of degree of impairment. Stereognosis with 2 items may provide comparable information as 12 items. Level II.
- 1 September 2012
- Published by Wolters Kluwer Health in Journal of Pediatric Orthopaedics
- Vol. 32 (Supplement) , S114-S122
Evaluation of the Box and Blocks Test, Stereognosis and Item Banks of Activity and Upper Extremity Function in Youths With Brachial Plexus Birth Palsy
One of the greatest limitations to measuring outcomes in pediatric orthopaedics is the lack of effective instruments. Computer adaptive testing, which uses large item banks, select only items that are relevant to a child’s function based on a previous response and filters items that are too easy or too hard or simply not relevant to the child. In this way, computer adaptive testing provides for a meaningful, efficient, and precise method to evaluate patient-reported outcomes. Banks of items that assess activity and upper extremity (UE) function have been developed for children with cerebral palsy and have enabled computer adaptive tests that showed strong reliability, strong validity, and broader content range when compared with traditional instruments. Because of the void in instruments for children with brachial plexus birth palsy (BPBP) and the importance of having an UE and activity scale, we were interested in how well these items worked in this population. Cross-sectional, multicenter study involving 200 children with BPBP was conducted. The box and block test (BBT) and Stereognosis tests were administered and patient reports of UE function and activity were obtained with the cerebral palsy item banks. Differential item functioning (DIF) was examined. Predictive ability of the BBT and stereognosis was evaluated with proportional odds logistic regression model. Spearman correlations coefficients (rs) were calculated to examine correlation between stereognosis and the BBT and between individual stereognosis items and the total stereognosis score. Six of the 86 items showed DIF, indicating that the activity and UE item banks may be useful for computer adaptive tests for children with BPBP. The penny and the button were strongest predictors of impairment level (odds ratio=0.34 to 0.40]. There was a good positive relationship between total stereognosis and BBT scores (rs=0.60). The BBT had a good negative (rs=−0.55) and good positive (rs=0.55) relationship with the clinical category of BPBP and Raimondi classification, respectively. There was a moderate negative (rs=−0.36) and moderate positive (rs=0.47) relationship between total stereognosis and clinical category of BPBP and Raimondi, respectively. Individual stereognosis items had moderate (rs=0.34 to 0.45) to good (rs=0.52 to 0.74) correlation with total stereognosis score. In children with BPBP, there was little to no DIF with item banks of activity and UE functioning. The BBT is a good predictor of degree of impairment. Stereognosis with 2 items may provide comparable information as 12 items. Level II.
- 21 August 2012
- Published by Springer Nature in Spinal Cord
- Vol. 50 (12) , 915-919
Evaluation of newly developed item banks for child-reported outcomes of participation following spinal cord injury
Multi-center, prospective calibration study. To examine the psychometric properties of item banks designed for a computer adaptive test of participation. Three pediatric specialty care hospitals in North America. Newly developed item banks containing questions about participation were administered to 381 children, 8-21 years. Unidimensionality was evaluated using categorical confirmatory factor analysis and residual correlations. Pearson's correlations were calculated between simulated CATs and the full-item banks. CFI=0.905, TLI=0.951 and RMSEA=0.089 for the self-participation item bank; CFI=0.924, TLI=0.963 and RMSEA=0.083 friend-participation item bank. The 15- and 5- item simulated CATs and full-item banks were highly correlated. The newly developed self and friend-participation item banks met the required assumptions for CAT. Simulated CATs yielded scores comparable to full-item banks. The results of the study support the use of the item banks for a CAT of participation in children following spinal cord injury.
- 21 August 2012
- Published by Springer Nature in Spinal Cord
- Vol. 50 (12) , 915-919
Evaluation of newly developed item banks for child-reported outcomes of participation following spinal cord injury
Multi-center, prospective calibration study. To examine the psychometric properties of item banks designed for a computer adaptive test of participation. Three pediatric specialty care hospitals in North America. Newly developed item banks containing questions about participation were administered to 381 children, 8-21 years. Unidimensionality was evaluated using categorical confirmatory factor analysis and residual correlations. Pearson's correlations were calculated between simulated CATs and the full-item banks. CFI=0.905, TLI=0.951 and RMSEA=0.089 for the self-participation item bank; CFI=0.924, TLI=0.963 and RMSEA=0.083 friend-participation item bank. The 15- and 5- item simulated CATs and full-item banks were highly correlated. The newly developed self and friend-participation item banks met the required assumptions for CAT. Simulated CATs yielded scores comparable to full-item banks. The results of the study support the use of the item banks for a CAT of participation in children following spinal cord injury.
- 1 June 2012
- Published by Wolters Kluwer Health in Spine
- Vol. 37 (13) , E797-E803
Diffusion Tensor Imaging in Pediatric Spinal Cord Injury
The design was a nonexperimental, repeated measures design. To examine the reliability of repeated diffusion tensor imaging (DTI) values of the pediatric cord and to compare DTI values with values obtained on the clinical examination and findings from conventional magnetic resonance imaging (MRI). DTI quantifies the diffusion of water molecules in directions parallel and transverse to the plane of neuronal axons. The unique characteristic architecture of the spinal cord allows DTI to examine the white matter and potentially separate white matter from gray matter and assess structural damage of the cord. Ten youths with cervical spinal cord injury (SCI) were evaluated using the International Standards for Neurological Classification of SCI (ISNCSCI) and had 2 scans using a 3.0T Siemens Verio MR scanner. The imaging protocol consisted of conventional sagittal fast spin echo T1- and T2-weighted scans, axial fast spin echo T2-weighted scans, and axial DTI acquisition. Intraclass correlation coefficient (ICC) and 95% confidence interval were calculated for mean, axial, and radial diffusivity (MD, AD, RD, respectively) and fractional anisotropy (FA). Relationships among DTI, MRI, and ISNCSCI were evaluated using Spearman correlation coefficients (rs) and differences were tested using Cohen's method. There was moderate-to-strong reliability (ICC = 0.75–0.95) for MD, AD, and RD for all spinal levels. Reliability for FA for mid-C4 and between C5–C6 and C7–T1 was moderate (ICC = 0.75–0.80). Diffusivity values demonstrated moderate-to-good negative relationships (rs = −0.30 to −0.59), with 4 ISNCSCI values. FA values had a moderate-to-good (rs = 0.33–0.53) positive relationship, with 5 ISNCSCI values. Compared with MRI, DTI values had significantly stronger correlations (P ≤ 0.0001) with the majority of ISNCSCI values. DTI values had good-to-strong reliability on repeated scans and moderate-to-good concurrent validity with clinical scores. When compared with conventional MRI, DTI values had statistically stronger correlations with the majority of values from the clinical examination.
- 1 June 2012
- Published by Wolters Kluwer Health in Spine
- Vol. 37 (13) , E797-E803
Diffusion Tensor Imaging in Pediatric Spinal Cord Injury
The design was a nonexperimental, repeated measures design. To examine the reliability of repeated diffusion tensor imaging (DTI) values of the pediatric cord and to compare DTI values with values obtained on the clinical examination and findings from conventional magnetic resonance imaging (MRI). DTI quantifies the diffusion of water molecules in directions parallel and transverse to the plane of neuronal axons. The unique characteristic architecture of the spinal cord allows DTI to examine the white matter and potentially separate white matter from gray matter and assess structural damage of the cord. Ten youths with cervical spinal cord injury (SCI) were evaluated using the International Standards for Neurological Classification of SCI (ISNCSCI) and had 2 scans using a 3.0T Siemens Verio MR scanner. The imaging protocol consisted of conventional sagittal fast spin echo T1- and T2-weighted scans, axial fast spin echo T2-weighted scans, and axial DTI acquisition. Intraclass correlation coefficient (ICC) and 95% confidence interval were calculated for mean, axial, and radial diffusivity (MD, AD, RD, respectively) and fractional anisotropy (FA). Relationships among DTI, MRI, and ISNCSCI were evaluated using Spearman correlation coefficients (rs) and differences were tested using Cohen's method. There was moderate-to-strong reliability (ICC = 0.75–0.95) for MD, AD, and RD for all spinal levels. Reliability for FA for mid-C4 and between C5–C6 and C7–T1 was moderate (ICC = 0.75–0.80). Diffusivity values demonstrated moderate-to-good negative relationships (rs = −0.30 to −0.59), with 4 ISNCSCI values. FA values had a moderate-to-good (rs = 0.33–0.53) positive relationship, with 5 ISNCSCI values. Compared with MRI, DTI values had significantly stronger correlations (P ≤ 0.0001) with the majority of ISNCSCI values. DTI values had good-to-strong reliability on repeated scans and moderate-to-good concurrent validity with clinical scores. When compared with conventional MRI, DTI values had statistically stronger correlations with the majority of values from the clinical examination.
- 1 September 2011
- Published by Wolters Kluwer Health in Journal of Pediatric Orthopaedics
- Vol. 31 (6) , 661-667
Cognitive Testing of the Spinal Appearance Questionnaire With Typically Developing Youth and Youth With Idiopathic Scoliosis
The Spinal Appearance Questionnaire (SAQ) underwent initial psychometric studies, which suggested good reliability and discriminative ability. Although the SAQ is used as a self report of appearance, our center was concerned about its use with youth owing to complex words and vague questions. We conducted this cross-sectional study to evaluate the readability, comprehension, and interpretation of items on the SAQ. Cognitive interview methodology of 76 youths (8 to 16 y; average age 13) included 31 with scoliosis and 45 typically developing. Subjects were required to read each SAQ item and think aloud to capture cognitive processes about the items and responses. Interviews were audiotaped and transcribed verbatim. Problems were categorized and frequencies for each category were calculated. There were reading and comprehension problems and problems understanding the illustration with every written and pictorial SAQ item, respectively. The percent of subjects who encountered at least one problem ranged from 16% to 96%. Subjects had difficulty with understanding the intent of every SAQ item and with understanding the meaning of specific words such as "prominence" and "flank." The pictorial illustrations for items 2 and 3 were problematic for 58% and 49% of subjects, respectively. The illustrations of the lungs (item 4) and hips (items 4 and 5) were problematic for 42% and 27% of subjects, respectively. These results were consistent regardless of age or diagnoses. This study does not support the use of the SAQ as currently used with youth owing to use of complex medical words, vague questions, difficult illustrations, and various interpretations of the intent of many of the items. Not applicable (not an intervention study).
- 1 September 2011
- Published by Wolters Kluwer Health in Journal of Pediatric Orthopaedics
- Vol. 31 (6) , 661-667
Cognitive Testing of the Spinal Appearance Questionnaire With Typically Developing Youth and Youth With Idiopathic Scoliosis
The Spinal Appearance Questionnaire (SAQ) underwent initial psychometric studies, which suggested good reliability and discriminative ability. Although the SAQ is used as a self report of appearance, our center was concerned about its use with youth owing to complex words and vague questions. We conducted this cross-sectional study to evaluate the readability, comprehension, and interpretation of items on the SAQ. Cognitive interview methodology of 76 youths (8 to 16 y; average age 13) included 31 with scoliosis and 45 typically developing. Subjects were required to read each SAQ item and think aloud to capture cognitive processes about the items and responses. Interviews were audiotaped and transcribed verbatim. Problems were categorized and frequencies for each category were calculated. There were reading and comprehension problems and problems understanding the illustration with every written and pictorial SAQ item, respectively. The percent of subjects who encountered at least one problem ranged from 16% to 96%. Subjects had difficulty with understanding the intent of every SAQ item and with understanding the meaning of specific words such as "prominence" and "flank." The pictorial illustrations for items 2 and 3 were problematic for 58% and 49% of subjects, respectively. The illustrations of the lungs (item 4) and hips (items 4 and 5) were problematic for 42% and 27% of subjects, respectively. These results were consistent regardless of age or diagnoses. This study does not support the use of the SAQ as currently used with youth owing to use of complex medical words, vague questions, difficult illustrations, and various interpretations of the intent of many of the items. Not applicable (not an intervention study).
- 1 August 2011
- Published by Elsevier in Archives of Physical Medicine and Rehabilitation
- Vol. 92 (8) , 1264-1269
Interrater Reliability of the International Standards for Neurological Classification of Spinal Cord Injury in Youths With Chronic Spinal Cord Injury
- 1 August 2011
- Published by Elsevier in Archives of Physical Medicine and Rehabilitation
- Vol. 92 (8) , 1264-1269
Interrater Reliability of the International Standards for Neurological Classification of Spinal Cord Injury in Youths With Chronic Spinal Cord Injury
- 2 November 2010
- Published by Springer Nature in Spinal Cord
- Vol. 49 (3) , 352-356
The international standards for neurological classification of spinal cord injury: relationship between S4-5 dermatome testing and anorectal testing
Study design: Objective: Setting: Methods: Results: Conclusion:
- 2 November 2010
- Published by Springer Nature in Spinal Cord
- Vol. 49 (3) , 352-356
The international standards for neurological classification of spinal cord injury: relationship between S4-5 dermatome testing and anorectal testing
Study design: Objective: Setting: Methods: Results: Conclusion:
- 11 October 2010
- Published by SLACK, Inc. in Orthopedics
- Vol. 33 (10) , 742-747
Introduction of New Devices and Technologies into a Spine Surgery Practice: A Review of Processes and Regulations
The Cutting Edge Sigurd H. Berven, MD; Michael J. Yaszemski, MD, PhD; Peter O. Newton, MD; William Christianson; Harold M. Aberman; Jean-Charles Moreau; Mary Jane Mulcahey, PhD; Randal R. Betz, MD Dr Berven is from UC San Francisco Spinal Disorders Service, San Francisco, California; Dr Yaszemski is from Mayo Clinic, Rochester, Minnesota; Dr Newton is from Rady Children’s Hospital, San Diego, California; Mr Christianson is from DePuy Spine, Inc, Raynham, Massachusetts; Mr Aberman is from Synthes Spine, Paoli, Pennsylvania; Mr Moreau is from Medtronic Sofamor Danek, Memphis, Tennessee; and Drs Mulcahey and Betz are from Shriners Hospitals for Children, Philadelphia, Pennsylvania. Dr Berven is a consultant for Medtronic and DePuy Spine. Dr Newton receives royalties from DePuy Spine and Thieme, is a consultant for DePuy Spine and Stryker, receives stock options from NuVasive, and receives research/institutional support from DePuy Spine. Mr Christianson is employed with DePuy Spine. Mr Aberman is employed with Synthes Spine. Mr Moreau is employed with Medtronic Sofamor Danek. Dr Betz receives royalties from DePuy Spine, Medtronic, Osteotech, and Synthes Spine; is a consultant for Medtronic, SpineGuard, DePuy Spine, Osteotech, Synthes Spine, SpineMedica, Orthocon, and Orthovita; receives stock options from SpineGuard, SpineMedica, and Orthocon; and receives research/institutional support from DePuy Spine and Synthes Spine. Drs Yaszemski and Mulcahey have no relevant financial relationships to disclose. The authors thank Jon Serbousek, Richard Treharne, James Ogilvie, MD, and Jeremy Fairbank, FRCS. Correspondence should be addressed to: Randal R. Betz, MD, Shriners Hospitals for Children – Philadelphia, 3551 N Broad St, Philadelphia, PA 19140 (rbetz@shrinenet.org). The emergence of new devices and new technologies has led to significant and important changes in the practice of spine surgery over the past decade. Spine surgeons are responsible for continuously learning about new implants, instruments, bone graft substitutes, and new procedures. Making informed decisions on the adoption of new technologies in spine surgery is an important challenge for all practicing surgeons. This article provides a systematic review of the processes involved in bringing new technologies and devices to market in spine surgery. It is intended to assist surgeons in building a knowledge base to evaluate whether the new options are appropriate for their patients and/or spine practice and to critically evaluate the processes of evidence development to facilitate informed decision making about new technologies. Safety has been addressed by the US Food and Drug Administration (FDA) through classification of medical devices as Class I, II, or III.1–3 The failure of pacemakers and intrauterine devices and the lack of medical device regulation in the early 1970s led to the Medical Device Amendments of 1976. Class I devices (eg, tongue depressors) fall under general controls that apply to all devices, such as registration of manufacturers, record keeping requirements, and compliance with good manufacturing regulations. Class II devices (eg, most orthopedic implants) are those for which general controls are insufficient to ensure device safety and effectiveness, and for which ≥1 special controls may be required. These special controls may include performance standards, postmarket surveillance studies, or device registries. Class III devices (eg, pacemakers, heart valves) are those that are life supporting, life sustaining, or important in preventing impairment of human health. General and special controls may be insufficient to ensure the safety and effectiveness of a Class III device, and it would be required to go through premarket approval via an investigational device exemption clinical study. Generally, a Class I device carries minimal risk (eg, non-powered surgical instruments). A Class II device presents medium or manageable risk and usually has a predicate device (one that was marketed prior to the May 1976 medical device amendments and has an extensive history). Pedicle screws are an example of a Class II device in that they only need biomechanical testing and to follow material standards to show that they meet basic mechanical properties, without further proof of efficacy before marketing.4 Class III devices carry the potential for high risk or have no antecedent technology to permit a comparison. Class III devices require both safety and efficacy data before market release. The classification of new devices is important in determining the process of bringing a new device to the marketplace. A new technology that is substantially equivalent to existing devices that have been in use since prior to 1976 may be cleared for marketing by the FDA under the process of 510(k) clearance. The FDA 510(k) regulatory process specifically applies to devices and technologies for which there was a predicate device in existence prior to the May 1976 medical device amendment or for a device found to be substantially equivalent post-1976 that has been cleared. For 510(k) approval, the FDA typically requires a device description, citation of a predicate device, mechanical drawings, bench testing, and a package insert. Therefore, many new technologies may qualify for FDA approval without demonstration of efficacy compared with alternatives and without specific clinical trials. When the heritage of a new device is substantially equivalent to a device that existed prior to 1976, or the device has an established safety and efficacy history, it is generally classified as Class I or II and may bypass clinical trials before approval for marketing.5 Some products may be approved by a 510(k) process and then be used in a physician-directed, or off-label, application. Physician-directed application of a device or medical product is a clinical use that is not specific to the product approval. The FDA does not regulate medical practice. Some surgeons believe that the term “off-label” is an inappropriate term to refer to a decision that is part of medical practice, since labeling is an activity that occurs between the FDA and industry. We suggest adoption of the alternate term “clinician- or physician-directed application” as a more appropriate description for this activity. Class III devices and technologies, or devices without a substantially equivalent precedent, require a rigorous process of evaluation for which the FDA will require preclinical studies and clinical trials as well as manufacturing and biomechanical data. The clinical trials may include pilot studies and a level of evidence such as a randomized, controlled trial. Examples of Class III spinal devices include artificial disk replacement devices, prosthetic nuclear replacements, and recombinant bone morphogenetic proteins (BMPs). The premarket approval process is rigorous and results in a level of evidence that provides the practitioner useful data on efficacy as well as safety. The premarket approval process begins with a meeting between the sponsor of the premarket approval application (industry/manufacturer) and representatives of the Office of Device Evaluation. The purpose of this meeting is to design preclinical and clinical studies that will demonstrate product safety and ensure efficacy. Clinical data are obtained from investigational device exemption studies, which may involve multiple centers, to provide generalizability of product application and extensive datasets. The determination of primary and secondary outcome measures and definitions of study success are critical to study design and to eventual assessment of product performance. Food and Drug Administration reviewers evaluate the investigational device exemption study and determine the merit of the application. A Product Development Protocol is an alternative to the premarket approval. The Product Development Protocol pathway includes preclinical and clinical evaluations and may reduce the burden of the approval process by involving the FDA in the earliest stages of study planning.6 After approval of a new device by the FDA, postmarket analysis, including reporting adverse events and annual reports, may be required for ongoing quality assurance. Efficacy is an important consideration for physicians in choosing to adopt a new technology. Efficacy may be supported by preclinical data. The most useful preclinical data on efficacy is a matched trial of similar products in an animal model. Information on new bone graft substitutes is often limited to preclinical data, and surgeons should not make decisions based solely on preclinical data. Orthotopic sites and phylogenetics of the animal model are important in determining the level of proof in preclinical work. Clinical data, including prospective, randomized trials, are more useful for a determination of efficacy. However, this level of proof is generally only available for new products subject to the premarket approval process and investigational device exemption trials (Class III devices). While Class III devices are required to demonstrate efficacy prior to approval, physician-directed (off-label) applications may also limit the quality of evidence that supports clinical use. An example in spine surgery is the use of recombinant BMPs.7 Bone morphogenetic proteins have been shown to be safe and effective in anterior interbody devices in a 1-level anterior spinal fusion (BMP-2). Many surgeons adopted the use of BMP-2 in the posterolateral spine despite the fact that the preclinical data did not support its use without the appropriate carrier or in the dose used in the anterior interspace. Barnes et al8 show in a primate model that BMP-2 with a compressible matrix is not effective as a bone graft substitute in the posterolateral space. Despite this preclinical data, BMP-2 is used most commonly in posterolateral applications based on limited clinical data. Through ongoing postmarket analysis, the efficacy of BMP-2 with a noncompressible matrix in the posterolateral space has been demonstrated.9 This example points to the importance of ongoing postmarket analysis in industry-sponsored and independent investigations.10 It is incumbent on the surgeon to understand the level of evidence that may support or refute specific clinical applications of new technologies and to continue to study efficacy of specific applications in postmarket studies. Numerous examples exist where initial clinical trials may suggest efficacy but follow-up investigations in independent studies fail to demonstrate a significant effect. Examples in spine surgery include chemonucleolysis, injections and nerve blocks, and intradiscal electrothermal therapy.11,12 Ongoing clinical trials even after FDA approval of devices are important to demonstrate efficacy and to guide informed choices regarding care. Cost is the third element that may contribute to a physician’s choice to make a change in practice. An increase in the cost of a new technology that also results in improved outcomes most directly affects the patient and the physician. The benefit to the hospital and the payer is not as clear. The most useful measure of the value of a new technology is the incremental cost effectiveness ratio, or the ratio of cost per unit of outcome (use) gain. The threshold of incremental cost effectiveness ratio that justifies the adoption of new technologies for all stakeholders has not been well established.13 Preclinical data may serve to compel a change in practice, or more often may provide data that may support a change in practice. Clinical studies are the currency of assessment of efficacy for new devices and technologies, and the design and implementation of these studies is fundamental to approval and reimbursement for new technologies. A unique problem for surgeons, companies, and the FDA is the cost of proving an equivalent or superior outcome. When the company looks at the potential return on their investment, it may be so small that it is not worth the cost of an investigational device exemption premarket approval trial, which can be prohibitive. An excellent example of this is the growing rod. Whereas surgeons are using this as treatment for progressive curves in early onset scoliosis, there is no level I evidence to support its efficacy, nor is there explicit FDA approval for this indication. The surgeons themselves could conduct a quality-controlled study in the form of a surgeon-driven investigational device exemption, but the prohibitive costs render this option impractical. Surgeons often make practice decisions based on incomplete data and lower-level studies including case series, retrospective cohort studies, and peer opinion and recommendations.14 Generally, the surgeons can analyze retrospective cohorts for comparison, but these studies can be fraught with missing data, lost patients, selection bias, and limitations that are not present in sponsored, prospective investigational device exemption trials. A similar dilemma involves other fusionless technologies, specifically the staple for the young patient (aged 8 to 14 years) with idiopathic scoliosis. When considering the cost of a company doing an investigational device exemption premarket approval trial comparing stapling to a brace, the power analysis shows that the numbers necessary to prove superiority are so large that a study would not be financially feasible. In 1996, the FDA instituted a new classification called humanitarian device exemption, which applies to devices for which the projected use is 450 million people. Europe has a larger population than the United States, and each country has its own culture and language. The European Union continues to grow, with 2 new member states (Bulgaria and Romania) joining on January 1, 2007. European regulation is also followed by members of the European Economic Area that includes Switzerland, Norway, Iceland, and Liechtenstein. Today, the European Medical Device Directive is followed by 31 countries. The European Vigilance Program is a postmarket surveillance obligation in Europe with a medical device vigilance system. This vigilance system was set up to minimize risks to patients by reducing the likelihood of serious incidents involving a medical device. This is achieved through the evaluation of reported incidents by the member states, through the dissemination of information that could be used to prevent a recurrence of the incident or to alleviate the consequences of such incidents and, where appropriate, by the device being modified or taken off the market. The manufacturer or its representative is legally bound to report to authorities (1) any serious or potentially serious incidents involving devices they produce or sell and (2) systematic recalls of the device to prevent risk of serious injury or death presented by its use. The definition of a serious incident is “any malfunction, failure, or deterioration in the characteristics or performance of the device, or any inaccuracy in the labeling of instructions for use that might lead to or might have led to the death of the patient or user or to a serious deterioration in his state of health.” The CE mark system, with the subclasses IIa and IIb, has features that may be more pragmatic than the FDA’s approval system. For example, in the United States, prior to 2006, interbody cages labeled for use as a vertebral body replacement were in Class II and subject to approval via the 510(k) process. However, the majority are used in physician-directed applications in the interbody space. Until recently, cages labeled for use in the interbody space were in Class III and required premarket approval for marketing. Four US companies have undertaken the expense of conducting investigational device exemption studies and obtaining premarket approval, but the majority have chosen the 510(k) route. In Europe, interbody cages are classified as IIb and therefore are approved with reliance on clinical data from other interbody fusion cages. As a consequence. in Europe there is minimal physician-directed (off-label) use of devices as compared to the United States, where there is extensive use of devices for indications that are different than those approved by the FDA. Informed decision making in the development and use of new technologies requires a thorough understanding of the data that support the approval of a new technology or device. With education and information, physicians are empowered to adopt clinically directed applications rather than be restrained by strict on-label usage. Lessons from Europe include the classification of new devices with a reasonable safety profile as Class IIb, enabling a more efficient process of adoption while maintaining rigorous assessment of safety and efficacy. Many spine surgeons feel that the term “off-label use” should be abandoned because it has a negative connotation. They recommend “clinician- or physician-directed applications.” Physician-directed applications require a thorough understanding of the safety profile of devices, their preclinical data, and existing clinical study data for their responsible use. The reimbursement approval process has important implications for the adoption and dissemination of new technologies. Accountability for the outcomes of care extends long beyond the approval of new technologies by the FDA and by reimbursement authorities. A long-term registry recording outcomes measures needs to be developed in a partnership between surgeons, professional societies, and industry to assess the safety and efficacy of new devices and technologies over time. Informed decision making in the development and use of new technologies requires a thorough understanding of the data that support their approval. With education, physicians are empowered to adopt clinically directed applications rather than be restrained by strict on-label usage. Dr Berven is from UC San Francisco Spinal Disorders Service, San Francisco, California; Dr Yaszemski is from Mayo Clinic, Rochester, Minnesota; Dr Newton is from Rady Children’s Hospital, San Diego, California; Mr Christianson is from DePuy Spine, Inc, Raynham, Massachusetts; Mr Aberman is from Synthes Spine, Paoli, Pennsylvania; Mr Moreau is from Medtronic Sofamor Danek, Memphis, Tennessee; and Drs Mulcahey and Betz are from Shriners Hospitals for Children, Philadelphia, Pennsylvania. Dr Berven is a consultant for Medtronic and DePuy Spine. Dr Newton receives royalties from DePuy Spine and Thieme, is a consultant for DePuy Spine and Stryker, receives stock options from NuVasive, and receives research/institutional support from DePuy Spine. Mr Christianson is employed with DePuy Spine. Mr Aberman is employed with Synthes Spine. Mr Moreau is employed with Medtronic Sofamor Danek. Dr Betz receives royalties from DePuy Spine, Medtronic, Osteotech, and Synthes Spine; is a consultant for Medtronic, SpineGuard, DePuy Spine, Osteotech, Synthes Spine, SpineMedica, Orthocon, and Orthovita; receives stock options from SpineGuard, SpineMedica, and Orthocon; and receives research/institutional support from DePuy Spine and Synthes Spine. Drs Yaszemski and Mulcahey have no relevant financial relationships to...
- 11 October 2010
- Published by SLACK, Inc. in Orthopedics
- Vol. 33 (10) , 742-747
Introduction of New Devices and Technologies into a Spine Surgery Practice: A Review of Processes and Regulations
The Cutting Edge Sigurd H. Berven, MD; Michael J. Yaszemski, MD, PhD; Peter O. Newton, MD; William Christianson; Harold M. Aberman; Jean-Charles Moreau; Mary Jane Mulcahey, PhD; Randal R. Betz, MD Dr Berven is from UC San Francisco Spinal Disorders Service, San Francisco, California; Dr Yaszemski is from Mayo Clinic, Rochester, Minnesota; Dr Newton is from Rady Children’s Hospital, San Diego, California; Mr Christianson is from DePuy Spine, Inc, Raynham, Massachusetts; Mr Aberman is from Synthes Spine, Paoli, Pennsylvania; Mr Moreau is from Medtronic Sofamor Danek, Memphis, Tennessee; and Drs Mulcahey and Betz are from Shriners Hospitals for Children, Philadelphia, Pennsylvania. Dr Berven is a consultant for Medtronic and DePuy Spine. Dr Newton receives royalties from DePuy Spine and Thieme, is a consultant for DePuy Spine and Stryker, receives stock options from NuVasive, and receives research/institutional support from DePuy Spine. Mr Christianson is employed with DePuy Spine. Mr Aberman is employed with Synthes Spine. Mr Moreau is employed with Medtronic Sofamor Danek. Dr Betz receives royalties from DePuy Spine, Medtronic, Osteotech, and Synthes Spine; is a consultant for Medtronic, SpineGuard, DePuy Spine, Osteotech, Synthes Spine, SpineMedica, Orthocon, and Orthovita; receives stock options from SpineGuard, SpineMedica, and Orthocon; and receives research/institutional support from DePuy Spine and Synthes Spine. Drs Yaszemski and Mulcahey have no relevant financial relationships to disclose. The authors thank Jon Serbousek, Richard Treharne, James Ogilvie, MD, and Jeremy Fairbank, FRCS. Correspondence should be addressed to: Randal R. Betz, MD, Shriners Hospitals for Children – Philadelphia, 3551 N Broad St, Philadelphia, PA 19140 (rbetz@shrinenet.org). The emergence of new devices and new technologies has led to significant and important changes in the practice of spine surgery over the past decade. Spine surgeons are responsible for continuously learning about new implants, instruments, bone graft substitutes, and new procedures. Making informed decisions on the adoption of new technologies in spine surgery is an important challenge for all practicing surgeons. This article provides a systematic review of the processes involved in bringing new technologies and devices to market in spine surgery. It is intended to assist surgeons in building a knowledge base to evaluate whether the new options are appropriate for their patients and/or spine practice and to critically evaluate the processes of evidence development to facilitate informed decision making about new technologies. Safety has been addressed by the US Food and Drug Administration (FDA) through classification of medical devices as Class I, II, or III.1–3 The failure of pacemakers and intrauterine devices and the lack of medical device regulation in the early 1970s led to the Medical Device Amendments of 1976. Class I devices (eg, tongue depressors) fall under general controls that apply to all devices, such as registration of manufacturers, record keeping requirements, and compliance with good manufacturing regulations. Class II devices (eg, most orthopedic implants) are those for which general controls are insufficient to ensure device safety and effectiveness, and for which ≥1 special controls may be required. These special controls may include performance standards, postmarket surveillance studies, or device registries. Class III devices (eg, pacemakers, heart valves) are those that are life supporting, life sustaining, or important in preventing impairment of human health. General and special controls may be insufficient to ensure the safety and effectiveness of a Class III device, and it would be required to go through premarket approval via an investigational device exemption clinical study. Generally, a Class I device carries minimal risk (eg, non-powered surgical instruments). A Class II device presents medium or manageable risk and usually has a predicate device (one that was marketed prior to the May 1976 medical device amendments and has an extensive history). Pedicle screws are an example of a Class II device in that they only need biomechanical testing and to follow material standards to show that they meet basic mechanical properties, without further proof of efficacy before marketing.4 Class III devices carry the potential for high risk or have no antecedent technology to permit a comparison. Class III devices require both safety and efficacy data before market release. The classification of new devices is important in determining the process of bringing a new device to the marketplace. A new technology that is substantially equivalent to existing devices that have been in use since prior to 1976 may be cleared for marketing by the FDA under the process of 510(k) clearance. The FDA 510(k) regulatory process specifically applies to devices and technologies for which there was a predicate device in existence prior to the May 1976 medical device amendment or for a device found to be substantially equivalent post-1976 that has been cleared. For 510(k) approval, the FDA typically requires a device description, citation of a predicate device, mechanical drawings, bench testing, and a package insert. Therefore, many new technologies may qualify for FDA approval without demonstration of efficacy compared with alternatives and without specific clinical trials. When the heritage of a new device is substantially equivalent to a device that existed prior to 1976, or the device has an established safety and efficacy history, it is generally classified as Class I or II and may bypass clinical trials before approval for marketing.5 Some products may be approved by a 510(k) process and then be used in a physician-directed, or off-label, application. Physician-directed application of a device or medical product is a clinical use that is not specific to the product approval. The FDA does not regulate medical practice. Some surgeons believe that the term “off-label” is an inappropriate term to refer to a decision that is part of medical practice, since labeling is an activity that occurs between the FDA and industry. We suggest adoption of the alternate term “clinician- or physician-directed application” as a more appropriate description for this activity. Class III devices and technologies, or devices without a substantially equivalent precedent, require a rigorous process of evaluation for which the FDA will require preclinical studies and clinical trials as well as manufacturing and biomechanical data. The clinical trials may include pilot studies and a level of evidence such as a randomized, controlled trial. Examples of Class III spinal devices include artificial disk replacement devices, prosthetic nuclear replacements, and recombinant bone morphogenetic proteins (BMPs). The premarket approval process is rigorous and results in a level of evidence that provides the practitioner useful data on efficacy as well as safety. The premarket approval process begins with a meeting between the sponsor of the premarket approval application (industry/manufacturer) and representatives of the Office of Device Evaluation. The purpose of this meeting is to design preclinical and clinical studies that will demonstrate product safety and ensure efficacy. Clinical data are obtained from investigational device exemption studies, which may involve multiple centers, to provide generalizability of product application and extensive datasets. The determination of primary and secondary outcome measures and definitions of study success are critical to study design and to eventual assessment of product performance. Food and Drug Administration reviewers evaluate the investigational device exemption study and determine the merit of the application. A Product Development Protocol is an alternative to the premarket approval. The Product Development Protocol pathway includes preclinical and clinical evaluations and may reduce the burden of the approval process by involving the FDA in the earliest stages of study planning.6 After approval of a new device by the FDA, postmarket analysis, including reporting adverse events and annual reports, may be required for ongoing quality assurance. Efficacy is an important consideration for physicians in choosing to adopt a new technology. Efficacy may be supported by preclinical data. The most useful preclinical data on efficacy is a matched trial of similar products in an animal model. Information on new bone graft substitutes is often limited to preclinical data, and surgeons should not make decisions based solely on preclinical data. Orthotopic sites and phylogenetics of the animal model are important in determining the level of proof in preclinical work. Clinical data, including prospective, randomized trials, are more useful for a determination of efficacy. However, this level of proof is generally only available for new products subject to the premarket approval process and investigational device exemption trials (Class III devices). While Class III devices are required to demonstrate efficacy prior to approval, physician-directed (off-label) applications may also limit the quality of evidence that supports clinical use. An example in spine surgery is the use of recombinant BMPs.7 Bone morphogenetic proteins have been shown to be safe and effective in anterior interbody devices in a 1-level anterior spinal fusion (BMP-2). Many surgeons adopted the use of BMP-2 in the posterolateral spine despite the fact that the preclinical data did not support its use without the appropriate carrier or in the dose used in the anterior interspace. Barnes et al8 show in a primate model that BMP-2 with a compressible matrix is not effective as a bone graft substitute in the posterolateral space. Despite this preclinical data, BMP-2 is used most commonly in posterolateral applications based on limited clinical data. Through ongoing postmarket analysis, the efficacy of BMP-2 with a noncompressible matrix in the posterolateral space has been demonstrated.9 This example points to the importance of ongoing postmarket analysis in industry-sponsored and independent investigations.10 It is incumbent on the surgeon to understand the level of evidence that may support or refute specific clinical applications of new technologies and to continue to study efficacy of specific applications in postmarket studies. Numerous examples exist where initial clinical trials may suggest efficacy but follow-up investigations in independent studies fail to demonstrate a significant effect. Examples in spine surgery include chemonucleolysis, injections and nerve blocks, and intradiscal electrothermal therapy.11,12 Ongoing clinical trials even after FDA approval of devices are important to demonstrate efficacy and to guide informed choices regarding care. Cost is the third element that may contribute to a physician’s choice to make a change in practice. An increase in the cost of a new technology that also results in improved outcomes most directly affects the patient and the physician. The benefit to the hospital and the payer is not as clear. The most useful measure of the value of a new technology is the incremental cost effectiveness ratio, or the ratio of cost per unit of outcome (use) gain. The threshold of incremental cost effectiveness ratio that justifies the adoption of new technologies for all stakeholders has not been well established.13 Preclinical data may serve to compel a change in practice, or more often may provide data that may support a change in practice. Clinical studies are the currency of assessment of efficacy for new devices and technologies, and the design and implementation of these studies is fundamental to approval and reimbursement for new technologies. A unique problem for surgeons, companies, and the FDA is the cost of proving an equivalent or superior outcome. When the company looks at the potential return on their investment, it may be so small that it is not worth the cost of an investigational device exemption premarket approval trial, which can be prohibitive. An excellent example of this is the growing rod. Whereas surgeons are using this as treatment for progressive curves in early onset scoliosis, there is no level I evidence to support its efficacy, nor is there explicit FDA approval for this indication. The surgeons themselves could conduct a quality-controlled study in the form of a surgeon-driven investigational device exemption, but the prohibitive costs render this option impractical. Surgeons often make practice decisions based on incomplete data and lower-level studies including case series, retrospective cohort studies, and peer opinion and recommendations.14 Generally, the surgeons can analyze retrospective cohorts for comparison, but these studies can be fraught with missing data, lost patients, selection bias, and limitations that are not present in sponsored, prospective investigational device exemption trials. A similar dilemma involves other fusionless technologies, specifically the staple for the young patient (aged 8 to 14 years) with idiopathic scoliosis. When considering the cost of a company doing an investigational device exemption premarket approval trial comparing stapling to a brace, the power analysis shows that the numbers necessary to prove superiority are so large that a study would not be financially feasible. In 1996, the FDA instituted a new classification called humanitarian device exemption, which applies to devices for which the projected use is 450 million people. Europe has a larger population than the United States, and each country has its own culture and language. The European Union continues to grow, with 2 new member states (Bulgaria and Romania) joining on January 1, 2007. European regulation is also followed by members of the European Economic Area that includes Switzerland, Norway, Iceland, and Liechtenstein. Today, the European Medical Device Directive is followed by 31 countries. The European Vigilance Program is a postmarket surveillance obligation in Europe with a medical device vigilance system. This vigilance system was set up to minimize risks to patients by reducing the likelihood of serious incidents involving a medical device. This is achieved through the evaluation of reported incidents by the member states, through the dissemination of information that could be used to prevent a recurrence of the incident or to alleviate the consequences of such incidents and, where appropriate, by the device being modified or taken off the market. The manufacturer or its representative is legally bound to report to authorities (1) any serious or potentially serious incidents involving devices they produce or sell and (2) systematic recalls of the device to prevent risk of serious injury or death presented by its use. The definition of a serious incident is “any malfunction, failure, or deterioration in the characteristics or performance of the device, or any inaccuracy in the labeling of instructions for use that might lead to or might have led to the death of the patient or user or to a serious deterioration in his state of health.” The CE mark system, with the subclasses IIa and IIb, has features that may be more pragmatic than the FDA’s approval system. For example, in the United States, prior to 2006, interbody cages labeled for use as a vertebral body replacement were in Class II and subject to approval via the 510(k) process. However, the majority are used in physician-directed applications in the interbody space. Until recently, cages labeled for use in the interbody space were in Class III and required premarket approval for marketing. Four US companies have undertaken the expense of conducting investigational device exemption studies and obtaining premarket approval, but the majority have chosen the 510(k) route. In Europe, interbody cages are classified as IIb and therefore are approved with reliance on clinical data from other interbody fusion cages. As a consequence. in Europe there is minimal physician-directed (off-label) use of devices as compared to the United States, where there is extensive use of devices for indications that are different than those approved by the FDA. Informed decision making in the development and use of new technologies requires a thorough understanding of the data that support the approval of a new technology or device. With education and information, physicians are empowered to adopt clinically directed applications rather than be restrained by strict on-label usage. Lessons from Europe include the classification of new devices with a reasonable safety profile as Class IIb, enabling a more efficient process of adoption while maintaining rigorous assessment of safety and efficacy. Many spine surgeons feel that the term “off-label use” should be abandoned because it has a negative connotation. They recommend “clinician- or physician-directed applications.” Physician-directed applications require a thorough understanding of the safety profile of devices, their preclinical data, and existing clinical study data for their responsible use. The reimbursement approval process has important implications for the adoption and dissemination of new technologies. Accountability for the outcomes of care extends long beyond the approval of new technologies by the FDA and by reimbursement authorities. A long-term registry recording outcomes measures needs to be developed in a partnership between surgeons, professional societies, and industry to assess the safety and efficacy of new devices and technologies over time. Informed decision making in the development and use of new technologies requires a thorough understanding of the data that support their approval. With education, physicians are empowered to adopt clinically directed applications rather than be restrained by strict on-label usage. Dr Berven is from UC San Francisco Spinal Disorders Service, San Francisco, California; Dr Yaszemski is from Mayo Clinic, Rochester, Minnesota; Dr Newton is from Rady Children’s Hospital, San Diego, California; Mr Christianson is from DePuy Spine, Inc, Raynham, Massachusetts; Mr Aberman is from Synthes Spine, Paoli, Pennsylvania; Mr Moreau is from Medtronic Sofamor Danek, Memphis, Tennessee; and Drs Mulcahey and Betz are from Shriners Hospitals for Children, Philadelphia, Pennsylvania. Dr Berven is a consultant for Medtronic and DePuy Spine. Dr Newton receives royalties from DePuy Spine and Thieme, is a consultant for DePuy Spine and Stryker, receives stock options from NuVasive, and receives research/institutional support from DePuy Spine. Mr Christianson is employed with DePuy Spine. Mr Aberman is employed with Synthes Spine. Mr Moreau is employed with Medtronic Sofamor Danek. Dr Betz receives royalties from DePuy Spine, Medtronic, Osteotech, and Synthes Spine; is a consultant for Medtronic, SpineGuard, DePuy Spine, Osteotech, Synthes Spine, SpineMedica, Orthocon, and Orthovita; receives stock options from SpineGuard, SpineMedica, and Orthocon; and receives research/institutional support from DePuy Spine and Synthes Spine. Drs Yaszemski and Mulcahey have no relevant financial relationships to...
- 1 July 2010
- Published by SAGE Publications in American Journal of Occupational Therapy
- Vol. 64 (4) , 605-613
Children’s and Parents’ Perspectives About Activity Performance and Participation After Spinal Cord Injury: Initial Development of a Patient-Reported Outcome Measure
OBJECTIVE. To report on a cognitive testing study on newly constructed items designed to evaluate client-reported outcomes of activity performance and participation after spinal cord injury (SCI). METHOD. Thirty-three children with SCI and 13 caregivers participated in cognitive testing interviews. Open-ended questions were used to gain a better understanding of activity performance and participation. The interviews were transcribed verbatim. A thematic analysis was carried out independently by 2 researchers, and key sentences and phrases from both analyses were merged. RESULTS. Four themes were defined: (1) apprehension related to activity performance and participation, (2) reference point, (3) missing out, and (4) autonomy. CONCLUSION. Insight into children’s and caregivers’ perspectives provided important information that helped refine the wording of test items and response scales. The theme of autonomy provided a stronger catalyst to solidify items for both child- and parent-reported outcomes. This study further validated the complexity of the construct of participation.
- 1 July 2010
- Published by SAGE Publications in American Journal of Occupational Therapy
- Vol. 64 (4) , 605-613
Children’s and Parents’ Perspectives About Activity Performance and Participation After Spinal Cord Injury: Initial Development of a Patient-Reported Outcome Measure
OBJECTIVE. To report on a cognitive testing study on newly constructed items designed to evaluate client-reported outcomes of activity performance and participation after spinal cord injury (SCI). METHOD. Thirty-three children with SCI and 13 caregivers participated in cognitive testing interviews. Open-ended questions were used to gain a better understanding of activity performance and participation. The interviews were transcribed verbatim. A thematic analysis was carried out independently by 2 researchers, and key sentences and phrases from both analyses were merged. RESULTS. Four themes were defined: (1) apprehension related to activity performance and participation, (2) reference point, (3) missing out, and (4) autonomy. CONCLUSION. Insight into children’s and caregivers’ perspectives provided important information that helped refine the wording of test items and response scales. The theme of autonomy provided a stronger catalyst to solidify items for both child- and parent-reported outcomes. This study further validated the complexity of the construct of participation.
- 3 February 2009
- Published by Springer Nature in Spinal Cord
- Vol. 47 (9) , 687-691
Intra-rater agreement of the anorectal exam and classification of injury severity in children with spinal cord injury
Study design: Objectives: Setting: Methods: Results: Conclusion:
- 3 February 2009
- Published by Springer Nature in Spinal Cord
- Vol. 47 (9) , 687-691
Intra-rater agreement of the anorectal exam and classification of injury severity in children with spinal cord injury
Study design: Objectives: Setting: Methods: Results: Conclusion:
- 1 January 2009
- Published by Taylor & Francis in The Journal of Spinal Cord Medicine
- Vol. 32 (2) , 157-161
The International Standards for Neurological Classification of Spinal Cord Injury: Intra-Rater Agreement of Total Motor and Sensory Scores in the Pediatric Population
The International Standards for Neurological Classification of Spinal Cord Injury (ISCSCI) is the gold standard for evaluating and classifying the neurological consequence of spinal cord injury (SCI). To determine the within-rater agreement for total scores of light touch (LT), pin prick (PP), and total motor (TM) in children and youth. Part of a larger cross-sectional study to determine the intra-rater reliability of the standards when applied to children and youth. A total of 187 subjects participated in 2 repeated examinations performed by the same rater. A total of 7 raters participated in this study. Intraclass correlations coefficients (ICCs), with 95% CI were calculated to determine agreement between the 2 examinations for LT, PP, and TM. With the exception of subjects younger than 6 years, agreement on repeated total PP, LT, and TM scores were good to excellent, as shown by ICC values of 0.92 or higher. Although agreement was high for the youngest age group for LT (ICC = 0.920), PP (ICC = 0.957), and TM (ICC = 0.971), all of the lower 95% CI values fell well below 0.66, indicating poor precision. All subgroups had good to high agreement for total PP, LT, and TM scores, as indicated by ICC values of 0.87 and higher. There were lower 95% CI (LCI) values for the 6- to 11-year-old group with incomplete paraplegia due to the low number of subjects in that subgroup (N=4). The LCI values were poor for PP for the subgroups with 6- to 11-year-olds with incomplete tetraplegia (LCI = 0.675) and the 12- to 15-year-old group with incomplete paraplegia (LCI = 0.707) and for TM for 16- to 21-year-old group with complete paraplegia (LCI = 0.706). In children as young as 6 years, within-rater agreement on LT, PP, and TM exceeded recommended values for clinical measures. With the exception of 6- to 11-year-olds with incomplete injuries, type of injury and severity of injury were not factors in agreement. Although more work is needed to define the lower age limit in which the ISCSCI have utility, these data represent growing evidence supporting the use of the ISCSCI when evaluating the neurological consequence of SCI in children.
- 1 January 2009
- Published by Taylor & Francis in The Journal of Spinal Cord Medicine
- Vol. 32 (2) , 157-161
The International Standards for Neurological Classification of Spinal Cord Injury: Intra-Rater Agreement of Total Motor and Sensory Scores in the Pediatric Population
The International Standards for Neurological Classification of Spinal Cord Injury (ISCSCI) is the gold standard for evaluating and classifying the neurological consequence of spinal cord injury (SCI). To determine the within-rater agreement for total scores of light touch (LT), pin prick (PP), and total motor (TM) in children and youth. Part of a larger cross-sectional study to determine the intra-rater reliability of the standards when applied to children and youth. A total of 187 subjects participated in 2 repeated examinations performed by the same rater. A total of 7 raters participated in this study. Intraclass correlations coefficients (ICCs), with 95% CI were calculated to determine agreement between the 2 examinations for LT, PP, and TM. With the exception of subjects younger than 6 years, agreement on repeated total PP, LT, and TM scores were good to excellent, as shown by ICC values of 0.92 or higher. Although agreement was high for the youngest age group for LT (ICC = 0.920), PP (ICC = 0.957), and TM (ICC = 0.971), all of the lower 95% CI values fell well below 0.66, indicating poor precision. All subgroups had good to high agreement for total PP, LT, and TM scores, as indicated by ICC values of 0.87 and higher. There were lower 95% CI (LCI) values for the 6- to 11-year-old group with incomplete paraplegia due to the low number of subjects in that subgroup (N=4). The LCI values were poor for PP for the subgroups with 6- to 11-year-olds with incomplete tetraplegia (LCI = 0.675) and the 12- to 15-year-old group with incomplete paraplegia (LCI = 0.707) and for TM for 16- to 21-year-old group with complete paraplegia (LCI = 0.706). In children as young as 6 years, within-rater agreement on LT, PP, and TM exceeded recommended values for clinical measures. With the exception of 6- to 11-year-olds with incomplete injuries, type of injury and severity of injury were not factors in agreement. Although more work is needed to define the lower age limit in which the ISCSCI have utility, these data represent growing evidence supporting the use of the ISCSCI when evaluating the neurological consequence of SCI in children.