Rating the Raters

Authors:
  • AFAlan D. Feiger
    Alan D. Feiger
  • KCKenneth O. Cogger
    Kenneth O. Cogger
  • DSDawn Sikich
    Dawn Sikich
  • DDDavid J. DeBrota
    David J. DeBrota
  • JLJoshua D. Lipsitz
    Joshua D. Lipsitz
  • KKKenneth A. Kobak
    Kenneth A. Kobak
  • KEKenneth R. Evans
    Kenneth R. Evans
  • WPWilliam Z. Potter
    William Z. Potter

Abstract
The quality of clinical interviews conducted in industry-sponsored clinical drug trials is an important but frequently overlooked variable that may influence the outcome of a study. We evaluated the quality of Hamilton Rating Scale for Depression (HAM-D) clinical interviews performed at baseline in 2 similar multicenter, randomized, placebo-controlled depression trials sponsored by 2 pharmaceutical companies. A total of 104 audiotaped HAM-D clinical interviews were evaluated by a blinded expert reviewer for interview quality using the Rater Applied Performance Scale (RAPS). The RAPS assesses adherence to a structured interview guide, clarification of and follow-up to patient responses, neutrality, rapport, and adequacy of information obtained. HAM-D interviews were brief and cursory and the quality of interviews was below what would be expected in a clinical drug trial. Thirty-nine percent of the interviews were conducted in 10 minutes or less, and most interviews were rated fair or unsatisfactory on most RAPS dimensions. Results from our small sample illustrate that the clinical interview skills of raters who administered the HAM-D were below what many would consider acceptable. Evaluation and training of clinical interview skills should be considered as part of a rater training program.

This publication has 11 references indexed in Scilit: