Development and Validation of a Revised Multidimensional Digital Health Literacy Scale: Secondary Analysis Using Cross-Sectional Data From the 2022 GetCheckedOnline Community Survey In British Columbia, Canada (Preprint)
Authors:
- Ihoghosa IyamuIIIhoghosa Iyamu
- Pierce GorunPGPierce Gorun
- Hsiu-Ju ChangHCHsiu-Ju Chang
- Rodrigo Sierra-RosalesRSRodrigo Sierra-Rosales
- Devon HaagDHDevon Haag
- Heather PedersenHPHeather Pedersen
- Sofia BartlettSBSofia Bartlett
- Nathan LachowskyNLNathan Lachowsky
- Geoffrey McKeeGMGeoffrey McKee
- Catherine WorthingtonCWCatherine Worthington
- Troy GrennanTGTroy Grennan
- Lorie DonelleLDLorie Donelle
Preprint
- 23 May 2025
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Digital technologies are reshaping health care, making digital health literacy (DHL) a critical competency for navigating online health information. Although widely conceived and measured as a unidimensional measure of DHL, the literature increasingly supports a multidimensional framing of the eHealth Literacy Scale (eHEALS). Studies propose alternative factor structures that can better inform population-level interventions, but these studies have not accounted for the ordinal nature of eHEALS response data. OBJECTIVE This study aimed to identify and validate an alternate multidimensional structure of eHEALS accounting for its ordinal response scale. METHODS Data were drawn from the 2022 GetCheckedOnline community survey of consenting English-speaking British Columbia residents aged ≥16 years who reported sexual activity in the past 12 months. Participants were recruited through geo-targeted digital advertisements, community outreach, and in-person recruitment at public events, and community locations. DHL was measured using eHEALS, with responses collected on a 5-point Likert scale. Descriptive statistics summarized eHEALS responses using means, medians, and IQRs. Exploratory and confirmatory factor analyses were used to assess the scale’s structure using polychoric correlations and standard model fit indices. Reliability and validity were evaluated using polychoric ordinal alpha, average variance extracted, and composite reliability, with missing data addressed via multiple imputation. RESULTS Overall, 1657 participants met inclusion criteria with a mean age of 33.0 (SD 11.77, 95% CI 32.4-33.6) years. Among these 47.3% (95% CI 44.9%-49.7%) identified as women, 30.4% (95% CI 28.1%-32.6%) identified as racialized minorities, 80.5% (95% CI 78.5%–82.3%) reported easy internet access, and 32.2% (95% CI 30.0%-34.5%) had a bachelor’s degree or higher. Across eHEALS items, median scores were 4.0 (IQR 1.0-2.0) with excellent internal consistency (polychoric ordinal α=.92). Exploratory factor analysis supported a 3-factor solution explaining 65.7% of the variance, demonstrated through confirmatory factor analysis (χ²17=71.7, P<.001, root-mean-square error of approximation=0.059, standardized root-mean-square residual=0.026, comparative fit index=0.969, Tucker-Lewis Index=0.948). The final model included Information Navigation (standardized loadings=0.765-0.917), Resource Appraisal (0.825-0.892), and Confidence in Use (0.803 for both items), with composite reliability (0.784-0.900), and average variance extracted (0.503-0.738) supporting construct validity. CONCLUSIONS This study confirms a multidimensional structure of eHEALS, identifying Information Navigation, Resource Appraisal, and Confidence in Use as key dimensions of DHL. This revised model enhances measurement precision, enabling more accurate identification of populations with limited DHL and informing the development of targeted, equity-oriented interventions. Future research should aim to confirm this multidimensional structure in more diverse populations and explore how distinct DHL domains influence access to digital health services in various contexts. Additionally, ongoing scale development must adapt to account for the role of emerging technologies, including artificial intelligence and social media algorithms in health care.Keywords
All Related Versions
- Published version: Journal of Medical Internet Research, 27, e78008.
This publication has 42 references indexed in Scilit:
- Sociodemographics and Digital Health Literacy in Using Wearables for Health Promotion and Disease Prevention: Cross-Sectional Nationwide Survey in GermanyJournal of Prevention, 2024
- Managing Infodemics in the 21st Century2023
- Available tools to evaluate digital health literacy and engagement with eHealth resources: A scoping reviewHeliyon, 2022
- Digital health literacy as a super determinant of health: More than simply the sum of its partsInternet Interventions, 2022
- Focusing on Digital Health EquityJAMA, 2021
- Misinformation, manipulation, and abuse on social media in the era of COVID-19Journal of Computational Social Science, 2020
- Digital Health Equity as a Necessity in the 21st Century Cures Act EraJAMA, 2020
- Higher eHealth Literacy is Associated With HIV Risk Behaviors among HIV-Infected Women Who Use the InternetJournal of the Association of Nurses in AIDS Care, 2016
- Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variablesQuality & Quantity, 2008
- A Second Generation Little JiffyPsychometrika, 1970