Reliability and Validity Issues Related to Interactive Tailored Patient Assessments: A Case Study
Open Access
- 1 August 2007
- journal article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 9 (3) , e22
Abstract
Recently there has been a proliferation of interactive tailored patient assessment (ITPA) tools. However, evidence of the reliability and validity of these instruments is often missing, which makes their value in research studies questionable. Because several of the common methods to evaluate instrument reliability and validity are not applicable to interactive tailored patient assessments, informatics researchers may benefit from some guidance on which methods of reliability and validity assessment they can appropriately use. This paper describes the main differences between interactive tailored patient assessments and assessment instruments based on psychometric, or classical test, theory; it summarizes the measurement techniques normally used to ascertain the validity and reliability of assessment instruments based on psychometric theory; it discusses which methods are appropriate for interactive tailored patient assessments and which are not; and finally, it illustrates the application of some of the feasible techniques with a case study that describes how the reliability and validity of the tailored symptom assessment instrument called Choice were evaluated. [J Med Internet Res 2007;9(3):e22]Keywords
This publication has 21 references indexed in Scilit:
- Effects of a Computerized System to Support Shared Decision Making in Symptom Management of Cancer Patients: Preliminary ResultsJournal of the American Medical Informatics Association, 2003
- Handheld Technology to Improve Patient Care: Evaluating a Support System for Preference-based Care Planning at the BedsideJournal of the American Medical Informatics Association, 2002
- Understanding how people process health information: A comparison of tailored and nontailored weight-loss materials.Health Psychology, 1999
- Reliability and validity studies of the WHO-Composite International Diagnostic Interview (CIDI): A critical reviewJournal of Psychiatric Research, 1994
- Factor-analytic methods of scale development in personality and clinical psychology.Journal of Consulting and Clinical Psychology, 1988
- Factor-analytic methods of scale development in personality and clinical psychology.Journal of Consulting and Clinical Psychology, 1988
- What Constitutes A Publishable Report of Instrument Development?Nursing Research, 1985
- The CES-D ScaleApplied Psychological Measurement, 1977
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951