Web-Based Patient Educational Material on Osteosarcoma: Quantitative Assessment of Readability and Understandability
Open Access
- 24 March 2022
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Cancer
- Vol. 8 (1) , e25005
Abstract
Background: Patients often turn to web-based resources following the diagnosis of osteosarcoma. To be fully understood by average American adults, the American Medical Association (AMA) and National Institutes of Health (NIH) recommend web-based health information to be written at a 6th grade level or lower. Previous analyses of osteosarcoma resources have not measured whether text is written such that readers can process key information (understandability) or identify available actions to take (actionability). The Patient Education Materials Assessment Tool (PEMAT) is a validated measurement of understandability and actionability. Objective: The purpose of this study was to evaluate web-based osteosarcoma resources using measures of readability, understandability, and actionability. Methods: Using the search term “osteosarcoma,” two independent Google searches were performed on March 7, 2020 (by AGS), and March 11, 2020 (by TRG). The top 50 results were collected. Websites were included if they were directed at providing patient education on osteosarcoma. Readability was quantified using validated algorithms: Flesh-Kincaid Grade Ease (FKGE), Flesch-Kincaid Grade-Level (FKGL). A higher FKGE score indicates that the material is easier to read. All other readability scores represent the US school grade level. Two independent PEMAT assessments were performed with independent scores assigned for both understandability and actionability. A PEMAT score of 70% or below is considered poorly understandable or poorly actionable. Statistical significance was defined as P≤.05. Results: Two searches yielded 53 unique websites, of which 37 (70%) met the inclusion criteria. The mean FKGE and FKGL scores were 40.8 (SD 13.6) and 12.0 (SD 2.4), respectively. No website scored within the acceptable NIH or AHA recommended reading level. Only 4 (11%) and 1 (3%) website met the acceptable understandability and actionability threshold. Both understandability and actionability were positively correlated with FKGE (ρ=0.55, P<.001; ρ=0.60, P<.001), but were otherwise not significantly associated with other readability scores. There were no associations between readability (P=.15), understandability (P=.20), or actionability (P=.31) scores and Google rank. Conclusions: Overall, web-based osteosarcoma patient educational materials scored poorly with respect to readability, understandability, and actionability. None of the web-based resources scored at the recommended reading level. Only 4 achieved the appropriate score to be considered understandable by the general public. Authors of patient resources should incorporate PEMAT and readability criteria to improve web-based resources to support patient understanding.Keywords
This publication has 44 references indexed in Scilit:
- Assessment of the Quality and Content of Information on Anterior Cruciate Ligament Reconstruction on the InternetArthroscopy, 2013
- Scoliosis-Specific Information on the InternetSpine, 2012
- Low Health Literacy and Health Outcomes: An Updated Systematic ReviewAnnals of Internal Medicine, 2011
- Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrumentBMC Medicine, 2010
- Surfing for Juvenile Idiopathic Arthritis: Perspectives on Quality and Content of Information on the InternetThe Journal of Rheumatology, 2009
- Health literacy and adolescents: a framework and agenda for future researchHealth Education Research, 2007
- Development and Validation of the Rapid Estimate of Adolescent Literacy in Medicine (REALM-Teen): A Tool to Screen Adolescents for Below-Grade Reading in Health Care SettingsPediatrics, 2006
- Bladder Cancer Facts: Accuracy of Information on the InternetJournal of Urology, 2003
- Accuracy of information on apparently credible websites: survey of five common health topicsBMJ, 2002
- Health Literacy: Report of the Council on Scientific AffairsJAMA, 1999