Using Natural Language Processing Techniques to Provide Personalized Educational Materials for Chronic Disease Patients in China: Development and Assessment of a Knowledge-Based Health Recommender System (Preprint)
Preprint
- 30 December 2019
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Health education emerged as an important intervention for improving the awareness and self-management abilities of chronic disease patients. The development of information technologies has changed the form of patient educational materials from traditional paper materials to electronic materials. To date, the amount of patient educational materials on the internet is tremendous, with variable quality, which makes it hard to identify the most valuable materials by individuals lacking medical backgrounds. OBJECTIVE The aim of this study was to develop a health recommender system to provide appropriate educational materials for chronic disease patients in China and evaluate the effect of this system. METHODS A knowledge-based recommender system was implemented using ontology and several natural language processing (NLP) techniques. The development process was divided into 3 stages. In stage 1, an ontology was constructed to describe patient characteristics contained in the data. In stage 2, an algorithm was designed and implemented to generate recommendations based on the ontology. Patient data and educational materials were mapped to the ontology and converted into vectors of the same length, and then recommendations were generated according to similarity between these vectors. In stage 3, the ontology and algorithm were incorporated into an mHealth system for practical use. Keyword extraction algorithms and pretrained word embeddings were used to preprocess educational materials. Three strategies were proposed to improve the performance of keyword extraction. System evaluation was based on a manually assembled test collection for 50 patients and 100 educational documents. Recommendation performance was assessed using the macro precision of top-ranked documents and the overall mean average precision (MAP). RESULTS The constructed ontology contained 40 classes, 31 object properties, 67 data properties, and 32 individuals. A total of 80 SWRL rules were defined to implement the semantic logic of mapping patient original data to the ontology vector space. The recommender system was implemented as a separate Web service connected with patients' smartphones. According to the evaluation results, our system can achieve a macro precision up to 0.970 for the top 1 recommendation and an overall MAP score up to 0.628. CONCLUSIONS This study demonstrated that a knowledge-based health recommender system has the potential to accurately recommend educational materials to chronic disease patients. Traditional NLP techniques combined with improvement strategies for specific language and domain proved to be effective for improving system performance. One direction for future work is to explore the effect of such systems from the perspective of patients in a practical setting.Keywords
All Related Versions
- Published version: JMIR Medical Informatics, 8 (4), e17642.
This publication has 33 references indexed in Scilit:
- Health information in the digital age: an empirical study of the perceived benefits and costs of seeking and using health information from online sourcesHealth Information and Libraries Journal, 2019
- A systematic review of chronic disease management interventions in primary careBMC Family Practice, 2018
- DIETOS: A dietary recommender system for chronic diseases monitoring and managementComputer Methods and Programs in Biomedicine, 2018
- Answers to Health Questions: Internet Search Results Versus Online Health Community ResponsesJournal of Medical Internet Research, 2016
- The health information seeking and usage behavior intention of Chinese consumers through mobile phonesInformation Technology & People, 2015
- The eHealth Enhanced Chronic Care Model: A Theory Derivation ApproachJournal of Medical Internet Research, 2015
- Health Recommender Systems: Concepts, Requirements, Technical Basics and ChallengesInternational Journal of Environmental Research and Public Health, 2014
- Online Health Information SeekingJournal of Aging and Health, 2011
- Why Does Patient Activation Matter? An Examination of the Relationships Between Patient Activation and Health-Related OutcomesJournal of General Internal Medicine, 2011
- Chronic disease patient education: lessons from meta-analysesPatient Education and Counseling, 2001