Reliable Data Collection in Participatory Trials to Assess Digital Healthcare Applications
Open Access
- 2 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 79472-79490
Abstract
The number of digital healthcare mobile applications in the market is exponentially increasing owing to the development of mobile networks and widespread usage of smartphones. However, only few of these applications have been adequately validated. Like many mobile applications, in general, the use of healthcare applications is considered safe; thus, developers and end users can easily exchange them in the marketplace. However, existing platforms are unsuitable for collecting reliable data for evaluating the effectiveness of the applications. Moreover, these platforms reflect only the perspectives of developers and experts, and not of end users. For instance, typical clinical trial data collection methods are not appropriate for participant-driven assessment of healthcare applications because of their complexity and high cost. Thus, we identified the need for a participant-driven data collection platform for end users that is interpretable, systematic, and sustainable, as a first step to validate the effectiveness of the applications. To collect reliable data in the participatory trial format, we defined distinct stages for data preparation, storage, and sharing. The interpretable data preparation consists of a protocol database system and semantic feature retrieval method that allow a person without professional knowledge to create a protocol. The systematic data storage stage includes calculation of the collected data reliability weight. For sustainable data collection, we integrated a weight method and a future reward distribution function. We validated the methods through statistical tests involving 718 human participants. The results of a validation experiment demonstrate that the compared methods differ significantly and prove that the choice of an appropriate method is essential for reliable data collection, to facilitate effectiveness validation of digital healthcare applications. Furthermore, we created a Web-based system for our pilot platform to collect reliable data in an integrated pipeline. We compared the platform features using existing clinical and pragmatic trial data collection platforms.Keywords
All Related Versions
Funding Information
- Bio-Synergy Research Project of the Ministry of Science, ICT and Future Planning through the National Research Foundation of the Republic of Korea (NRF-2012M3A9C4048758)
This publication has 82 references indexed in Scilit:
- Bias in researchBiochemia Medica, 2013
- Comparison of Electronic Data Capture (EDC) with the Standard Data Capture Method for Clinical Trial DataPLOS ONE, 2011
- Selection Bias in Web SurveysInternational Statistical Review, 2010
- Identifying and Avoiding Bias in ResearchPlastic and Reconstructive Surgery, 2010
- Sharing Health Data for Better Outcomes on PatientsLikeMeJournal of Medical Internet Research, 2010
- An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trialThe Lancet, 2008
- Factors That Can Affect the External Validity of Randomised Controlled TrialsPLoS Clinical Trials, 2006
- Response Time Effort: A New Measure of Examinee Motivation in Computer-Based TestsApplied Measurement in Education, 2005
- Ascertaining the validity of individual protocols from Web-based personality inventoriesJournal of Research in Personality, 2005
- An analysis of variance test for normality (complete samples)Biometrika, 1965