A New CAHPS Measure of Patient Experiences With Mental Health and Substance Use Care
- 3 April 2025
- journal article
- Published by Wiley in Health Services Research
- Vol. 60 (5) , e14623
Abstract
Objective: To examine the psychometric characteristics of a survey about the experiences of people seeking mental health care and substance use services, the CAHPS Outpatient Mental Health (MH) survey.Study Settings and Design: Field tests were conducted in two Northeastern states—one among a state's Medicaid enrollees and the other in family medicine practices where psychologists and social workers were collocated with primary care providers. The survey asked about psychiatric medicines and counseling services received in the last 6 months.Data Sources and Analytic Sample: In each study, questionnaires were mailed to sampled patients with an option to complete a web survey. Study 1 included 5508 Medicaid enrollees 21 years and older from four health plans. Study 2 included 3328 patients 18 years and older who visited one of four family medicine practices. Samples included patients with mental health or substance use disorders or both.Principal Findings: Response rates were 9.98% (n = 470) and 13.00% (n = 416) for the Medicaid and family medicine surveys, respectively. About 20% of respondents reported difficulty getting appointments with mental health medicine prescribers. From 10% to 30% of respondents had difficulties finding a counselor, and 15% reported problems making appointments with counselors. Many respondents reported no mental health care in the last 6 months. Composite measures for communication with counselors had excellent internal consistency, but the measure for access to counseling services was modest (0.68 and 0.52 for the two studies). Inter‐unit reliability (IUR) was modest for the survey (IUR for all measures was lower than 0.60; highest for rating of counselors).Conclusions: Both studies had uniformly good distributions of responses to specific questions, although communication and respect questions about counselors were positively skewed. The survey performs better for respondents with any mental health condition and less well for those with only substance use disorders.Keywords
Funding Information
- Agency for Healthcare Research and Quality (U18 HS016978)
This publication has 20 references indexed in Scilit:
- Measuring Access to Mental Health Services Among Primary Care PatientsMedical Care, 2024
- Expansion of Telehealth Availability for Mental Health Care After State-Level Policy Changes From 2019 to 2022JAMA Network Open, 2023
- A Systematic Review of Strategies to Enhance Response Rates and Representativeness of Patient Experience SurveysMedical Care, 2022
- A conceptual framework to develop a patient-reported experience measure of the quality of mental health care: a qualitative study of the PREMIUM project in FranceJournal of Market Access & Health Policy, 2021
- Mapping colocation: Using national provider identified data to assess primary care and behavioral health colocation.Families, Systems, & Health, 2020
- Trends in Serious Psychological Distress and Outpatient Mental Health Care of US AdultsJAMA Psychiatry, 2019
- The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): Data quality, reliability and validity in patients attending 90 Norwegian clinicsNordic Journal of Psychiatry, 2006
- Twelve-Month Use of Mental Health Services in the United StatesArchives of General Psychiatry, 2005
- Toward a national consumer survey: Evaluation of the CABHS and MHSIP instrumentsThe Journal of Behavioral Health Services & Research, 2001
- Construct validity in psychological tests.Psychological Bulletin, 1955