Hsin-Yi Lee
Research Interests
Hsin-Yi Lee has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
- John O’ Donoghue
Department of Business Information Systems, University College Cork, College Road, Cork, T12K8AF, Ireland, 353 (021) 490 3000
7 shared publications - Tsung-Shu Joseph Wu
Research Department, Luke International, Mzuzu, Malawi
7 shared publications - Griphin Baxter Chirambo
Malawi eHealth Research Centre, Mzuzu University, Mzuzu, Malawi
6 shared publications - Isaach Ndemera
Research Department, Luke International, Mzuzu, Malawi
5 shared publications - Alanna Denny
School of Public Health Department of Medicine & Health, University College Cork, Cork, Ireland
4 shared publications - Ben Chilima
Public health institute of Malawi, Lilongwe, Malawi
4 shared publications
Latest Publications
- Open Access
- 28 October 2026
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 10, e83397
Prospective Acceptability and Usability of a WhatsApp Chatbot for Epidemic Response in Malawi: Convergent Mixed Methods Study
Background: Digital health tools were widely adopted during the COVID-19 pandemic and helped to strengthen surveillance, risk communication, and health education. The government of Malawi launched the Malawi COVID-19 WhatsApp Chatbot on May 29, 2020. It remains unclear whether tools like this are acceptable and usable enough to warrant deployment in future epidemic responses. Objective: We assessed the prospective acceptability and usability of the Malawi COVID-19 WhatsApp Chatbot for future epidemic or pandemic preparedness and response. Methods: We used a convergent mixed methods design at a national workshop held from September 9 to 10, 2024, in Dowa District, Malawi. Thirty-nine participants (18 health workers and 21 members of the public) were purposively sampled from 10 districts. Quantitative and qualitative data were collected using the technology acceptance model (TAM) and Mobile Application Rating Scale (MARS) tools. Qualitative data from facilitated group discussions were analyzed with thematic analysis, using a hybrid deductive-inductive approach. We compared TAM scores (nonnormally distributed; Wilcoxon rank-sum test) and MARS scores (approximately normally distributed; independent-samples 1-tailed t test) between health workers and the public. Quantitative and qualitative findings were integrated at the interpretation stage. Results: Thirty-nine participants completed the TAM survey, and 37 completed the MARS survey. The mean overall TAM score was 4.33 (SD 0.82) out of 5, and the mean overall MARS score was 3.84 (SD 0.74) out of 5, both above each tool’s acceptability threshold of 3. Health workers scored the chatbot significantly higher than the public in the TAM (median difference 1.50, 95% CI 1.00‐2.00; P <.001) and MARS surveys (mean 4.03, SD 0.38 vs mean 3.71, SD 0.53; P =.04); no individual MARS subdomain showed a significant between-group difference. Among the participants, 80% said that they would use the chatbot again. Four themes emerged: accessibility and availability; awareness and acceptance; usage; and areas for improvement. Integration of the 2 strands suggested that the quantitative acceptance gap between groups was driven substantially by unequal prior awareness and exposure. Conclusions: Among this purposively selected group, the chatbot was viewed as prospectively acceptable and usable for future epidemic response. These findings indicate prospective support among engaged stakeholders and suggest that future investment should prioritize multilingual design and broader public awareness of digital tools.
- 28 October 2026
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 10, e83397
Open AccessProspective Acceptability and Usability of a WhatsApp Chatbot for Epidemic Response in Malawi: Convergent Mixed Methods Study
Background: Digital health tools were widely adopted during the COVID-19 pandemic and helped to strengthen surveillance, risk communication, and health education. The government of Malawi launched the Malawi COVID-19 WhatsApp Chatbot on May 29, 2020. It remains unclear whether tools like this are acceptable and usable enough to warrant deployment in future epidemic responses. Objective: We assessed the prospective acceptability and usability of the Malawi COVID-19 WhatsApp Chatbot for future epidemic or pandemic preparedness and response. Methods: We used a convergent mixed methods design at a national workshop held from September 9 to 10, 2024, in Dowa District, Malawi. Thirty-nine participants (18 health workers and 21 members of the public) were purposively sampled from 10 districts. Quantitative and qualitative data were collected using the technology acceptance model (TAM) and Mobile Application Rating Scale (MARS) tools. Qualitative data from facilitated group discussions were analyzed with thematic analysis, using a hybrid deductive-inductive approach. We compared TAM scores (nonnormally distributed; Wilcoxon rank-sum test) and MARS scores (approximately normally distributed; independent-samples 1-tailed t test) between health workers and the public. Quantitative and qualitative findings were integrated at the interpretation stage. Results: Thirty-nine participants completed the TAM survey, and 37 completed the MARS survey. The mean overall TAM score was 4.33 (SD 0.82) out of 5, and the mean overall MARS score was 3.84 (SD 0.74) out of 5, both above each tool’s acceptability threshold of 3. Health workers scored the chatbot significantly higher than the public in the TAM (median difference 1.50, 95% CI 1.00‐2.00; P <.001) and MARS surveys (mean 4.03, SD 0.38 vs mean 3.71, SD 0.53; P =.04); no individual MARS subdomain showed a significant between-group difference. Among the participants, 80% said that they would use the chatbot again. Four themes emerged: accessibility and availability; awareness and acceptance; usage; and areas for improvement. Integration of the 2 strands suggested that the quantitative acceptance gap between groups was driven substantially by unequal prior awareness and exposure. Conclusions: Among this purposively selected group, the chatbot was viewed as prospectively acceptable and usable for future epidemic response. These findings indicate prospective support among engaged stakeholders and suggest that future investment should prioritize multilingual design and broader public awareness of digital tools.
- Open Access
- 19 July 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 28, e80960
Describing a National Chatbot Deployed by the Ministry of Health in Malawi during the COVID-19 Pandemic: A Retrospective Data Analysis (Preprint)
Malawi was a pioneer among African countries in implementing a coordinated, government-led effort to streamline COVID-19 support using digital health tools. In response to the pandemic, a COVID-19 WhatsApp chatbot was developed to support the public with information, symptom reporting, and service navigation during the pandemic. This study describes the national deployment, functionality, and use patterns of the WhatsApp chatbot during the COVID-19 pandemic in Malawi. A retrospective descriptive analysis of chatbot interaction data from May 2020 to May 2023 was conducted. User engagement with key chatbot functions was summarized using descriptive statistics, and time-series analysis was used to compare trends in reported COVID-19 cases with access patterns to the chatbot, the emergency operation call center, and Chipatala cha pa Foni (a national hotline initiative). The chatbot was accessed 347,117 times, with 70.8% (n=245,895) of validated WhatsApp accesses focused on COVID-19 statistics. Chatbot use patterns showed temporal alignment with COVID-19 case trends, particularly during the first and second pandemic waves and increases observed after lockdown events. Throughout the pandemic, chatbot downtime occurred in 38% (407/1070) of days, with the most prolonged period coinciding with the national vaccine rollout in 2021, during which vaccine-related functionalities were introduced. Following this expansion, the chatbot recorded 198 COVID-19 vaccine-related rumors and 644 accesses to vaccine frequently asked questions. Compared with call-based services, the chatbot recorded higher overall interactions, whereas symptoms were more frequently reported through call center platforms. This study provides a descriptive account of the development and use of a national COVID-19 WhatsApp chatbot in Malawi. The findings highlight patterns of information-seeking behavior, variation in feature use, and the influence of system availability on engagement. These insights may inform the design, implementation, and sustainability of digital health communication tools in similar settings.
- 19 July 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 28, e80960
Open AccessDescribing a National Chatbot Deployed by the Ministry of Health in Malawi during the COVID-19 Pandemic: A Retrospective Data Analysis (Preprint)
Malawi was a pioneer among African countries in implementing a coordinated, government-led effort to streamline COVID-19 support using digital health tools. In response to the pandemic, a COVID-19 WhatsApp chatbot was developed to support the public with information, symptom reporting, and service navigation during the pandemic. This study describes the national deployment, functionality, and use patterns of the WhatsApp chatbot during the COVID-19 pandemic in Malawi. A retrospective descriptive analysis of chatbot interaction data from May 2020 to May 2023 was conducted. User engagement with key chatbot functions was summarized using descriptive statistics, and time-series analysis was used to compare trends in reported COVID-19 cases with access patterns to the chatbot, the emergency operation call center, and Chipatala cha pa Foni (a national hotline initiative). The chatbot was accessed 347,117 times, with 70.8% (n=245,895) of validated WhatsApp accesses focused on COVID-19 statistics. Chatbot use patterns showed temporal alignment with COVID-19 case trends, particularly during the first and second pandemic waves and increases observed after lockdown events. Throughout the pandemic, chatbot downtime occurred in 38% (407/1070) of days, with the most prolonged period coinciding with the national vaccine rollout in 2021, during which vaccine-related functionalities were introduced. Following this expansion, the chatbot recorded 198 COVID-19 vaccine-related rumors and 644 accesses to vaccine frequently asked questions. Compared with call-based services, the chatbot recorded higher overall interactions, whereas symptoms were more frequently reported through call center platforms. This study provides a descriptive account of the development and use of a national COVID-19 WhatsApp chatbot in Malawi. The findings highlight patterns of information-seeking behavior, variation in feature use, and the influence of system availability on engagement. These insights may inform the design, implementation, and sustainability of digital health communication tools in similar settings.
- Open Access
- 19 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluating a National Chatbot Deployed by the Ministry of Health in Malawi during the COVID-19 Pandemic: A Retrospective Data Analysis (Preprint)
BACKGROUND Malawi, was one of the pioneering countries across Africa to implement a coordinated government-led effort to streamline COVID-19 support with digital health tools. In response to the pandemic, a COVID-19 WhatsApp chatbot was developed to enable citizens to self-register as potential cases, report symptoms, and access essential information OBJECTIVE This study evaluates the national cross-intervention use of the WhatsApp chatbot during the COVID-19 pandemic in Malawi. METHODS A retrospective analysis examined user engagement with key chatbot functions, while a time-series analysis compared trends in COVID-19 cases with access patterns to both the chatbot and the call center of the Emergency Operations Center (EOC) and Chipatala Cha Pa Foni (CCPF), offering insights into public interaction throughout the pandemic RESULTS The chatbot was accessed 818,426 times, with 70% of validated WhatsApp accesses focused on COVID-19 statistics. Chatbot usage patterns closely aligned with COVID-19 case trends, particularly during the first and second pandemic waves, and surged after social lockdown events. Throughout the pandemic, the chatbot experienced 38% downtime, the most prolonged period coinciding with the national vaccine rollout in 2021, which required the addition of vaccine-related functionalities. Following this expansion, the chatbot received 198 COVID-19 vaccine-related rumors and recorded 644 accesses to vaccine frequently asked questions. CONCLUSIONS The chatbot’s adaptability in meeting emerging needs, such as providing real-time COVID-19 statistics and vaccine information, demonstrates its value as an effective digital health tool during a rapidly evolving pandemic
- 19 July 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluating a National Chatbot Deployed by the Ministry of Health in Malawi during the COVID-19 Pandemic: A Retrospective Data Analysis (Preprint)
BACKGROUND Malawi, was one of the pioneering countries across Africa to implement a coordinated government-led effort to streamline COVID-19 support with digital health tools. In response to the pandemic, a COVID-19 WhatsApp chatbot was developed to enable citizens to self-register as potential cases, report symptoms, and access essential information OBJECTIVE This study evaluates the national cross-intervention use of the WhatsApp chatbot during the COVID-19 pandemic in Malawi. METHODS A retrospective analysis examined user engagement with key chatbot functions, while a time-series analysis compared trends in COVID-19 cases with access patterns to both the chatbot and the call center of the Emergency Operations Center (EOC) and Chipatala Cha Pa Foni (CCPF), offering insights into public interaction throughout the pandemic RESULTS The chatbot was accessed 818,426 times, with 70% of validated WhatsApp accesses focused on COVID-19 statistics. Chatbot usage patterns closely aligned with COVID-19 case trends, particularly during the first and second pandemic waves, and surged after social lockdown events. Throughout the pandemic, the chatbot experienced 38% downtime, the most prolonged period coinciding with the national vaccine rollout in 2021, which required the addition of vaccine-related functionalities. Following this expansion, the chatbot received 198 COVID-19 vaccine-related rumors and recorded 644 accesses to vaccine frequently asked questions. CONCLUSIONS The chatbot’s adaptability in meeting emerging needs, such as providing real-time COVID-19 statistics and vaccine information, demonstrates its value as an effective digital health tool during a rapidly evolving pandemic
- Open Access
- 31 December 2024
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 13 (1) , e58389
Evaluation of the Development, Implementation, Maintenance, and Impact of 3 Digital Surveillance Tools Deployed in Malawi During the COVID-19 Pandemic: Protocol for a Modified Delphi Expert Consensus Study
Background: The COVID-19 pandemic has highlighted the importance of strengthening national monitoring systems to safeguard a globally connected society, especially those in low- and middle-income countries. Africa’s rapid adoption of digital technological interventions created a new frontier of digital advancement during crises or pandemics. The use of digital tools for disease surveillance can assist with rapid outbreak identification and response, handling duties such as diagnosis, testing, contact tracing, and risk communication. Malawi was one of the first countries in the region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. Objective: The aim of this study is to seek expert consensus using the Delphi methodology to examine Malawi’s COVID-19 digital surveillance response strategy and to assess the digital tools using the World Health Organization mHealth (mobile health) Assessment and Planning for Scale (MAPS) toolkit. Methods: This protocol follows the Guidance on Conducting and REporting DElphi Studies. Participants must have first-hand experience on the design, implementation or maintenance with COVID-19 digital surveillance systems. There will be no restrictions on the level of expertise or years of experience. The panel will consist of approximately 40 participants. We will use a modified Delphi process whereby rounds 1 and 2 will be hosted online by Qualtrics and round 3 will encompass a face-to-face workshop held in Malawi. Consensus will be defined as ≥70% of participants strongly disagree, disagree, or somewhat disagree, or strongly agree, agree, or somewhat agree. During round 3, the face-to-face workshop, participants will be asked to complete, the MAPS toolkit assessment on the digital tool on which they are experts. The MAPS toolkit will enable the panel members to assess the digital tools from a sustainable perspective from six distinct, yet complementary axes: (1) groundwork, (2) partnerships, (3) financial health, (4) technology and architecture, (5) operations, and (6) monitoring and evaluation. Results: The ability of a country to collate, diagnose, monitor, and analyze data forms the cornerstone of an efficient surveillance system, allowing countries to plan and implement appropriate control actions. Malawi was one of the first countries in the African region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. Conclusions: We anticipate findings from this Delphi study will provide insights into how and why Malawi was successful in deploying digital surveillance systems. In addition, findings should produce recommendations and guidance for the rapid development, implementation, maintenance, and impact of digital surveillance tools during a health crisis. International Registered Report Identifier (IRRID): DERR1-10.2196/58389
- 31 December 2024
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 13 (1) , e58389
Open AccessEvaluation of the Development, Implementation, Maintenance, and Impact of 3 Digital Surveillance Tools Deployed in Malawi During the COVID-19 Pandemic: Protocol for a Modified Delphi Expert Consensus Study
Background: The COVID-19 pandemic has highlighted the importance of strengthening national monitoring systems to safeguard a globally connected society, especially those in low- and middle-income countries. Africa’s rapid adoption of digital technological interventions created a new frontier of digital advancement during crises or pandemics. The use of digital tools for disease surveillance can assist with rapid outbreak identification and response, handling duties such as diagnosis, testing, contact tracing, and risk communication. Malawi was one of the first countries in the region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. Objective: The aim of this study is to seek expert consensus using the Delphi methodology to examine Malawi’s COVID-19 digital surveillance response strategy and to assess the digital tools using the World Health Organization mHealth (mobile health) Assessment and Planning for Scale (MAPS) toolkit. Methods: This protocol follows the Guidance on Conducting and REporting DElphi Studies. Participants must have first-hand experience on the design, implementation or maintenance with COVID-19 digital surveillance systems. There will be no restrictions on the level of expertise or years of experience. The panel will consist of approximately 40 participants. We will use a modified Delphi process whereby rounds 1 and 2 will be hosted online by Qualtrics and round 3 will encompass a face-to-face workshop held in Malawi. Consensus will be defined as ≥70% of participants strongly disagree, disagree, or somewhat disagree, or strongly agree, agree, or somewhat agree. During round 3, the face-to-face workshop, participants will be asked to complete, the MAPS toolkit assessment on the digital tool on which they are experts. The MAPS toolkit will enable the panel members to assess the digital tools from a sustainable perspective from six distinct, yet complementary axes: (1) groundwork, (2) partnerships, (3) financial health, (4) technology and architecture, (5) operations, and (6) monitoring and evaluation. Results: The ability of a country to collate, diagnose, monitor, and analyze data forms the cornerstone of an efficient surveillance system, allowing countries to plan and implement appropriate control actions. Malawi was one of the first countries in the African region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. Conclusions: We anticipate findings from this Delphi study will provide insights into how and why Malawi was successful in deploying digital surveillance systems. In addition, findings should produce recommendations and guidance for the rapid development, implementation, maintenance, and impact of digital surveillance tools during a health crisis. International Registered Report Identifier (IRRID): DERR1-10.2196/58389
- Open Access
- 26 March 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluation of the Development, Implementation, Maintenance, and Impact of 3 Digital Surveillance Tools Deployed in Malawi During the COVID-19 Pandemic: Protocol for a Modified Delphi Expert Consensus Study (Preprint)
BACKGROUND The COVID-19 pandemic has highlighted the importance of strengthening national monitoring systems to safeguard a globally connected society, especially those in low- and middle-income countries. Africa’s rapid adoption of digital technological interventions created a new frontier of digital advancement during crises or pandemics. The use of digital tools for disease surveillance can assist with rapid outbreak identification and response, handling duties such as diagnosis, testing, contact tracing, and risk communication. Malawi was one of the first countries in the region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. OBJECTIVE The aim of this study is to seek expert consensus using the Delphi methodology to examine Malawi’s COVID-19 digital surveillance response strategy and to assess the digital tools using the World Health Organization mHealth (mobile health) Assessment and Planning for Scale (MAPS) toolkit. METHODS This protocol follows the Guidance on Conducting and REporting DElphi Studies. Participants must have first-hand experience on the design, implementation or maintenance with COVID-19 digital surveillance systems. There will be no restrictions on the level of expertise or years of experience. The panel will consist of approximately 40 participants. We will use a modified Delphi process whereby rounds 1 and 2 will be hosted online by Qualtrics and round 3 will encompass a face-to-face workshop held in Malawi. Consensus will be defined as ≥70% of participants strongly disagree, disagree, or somewhat disagree, or strongly agree, agree, or somewhat agree. During round 3, the face-to-face workshop, participants will be asked to complete, the MAPS toolkit assessment on the digital tool on which they are experts. The MAPS toolkit will enable the panel members to assess the digital tools from a sustainable perspective from six distinct, yet complementary axes: (1) groundwork, (2) partnerships, (3) financial health, (4) technology and architecture, (5) operations, and (6) monitoring and evaluation. RESULTS The ability of a country to collate, diagnose, monitor, and analyze data forms the cornerstone of an efficient surveillance system, allowing countries to plan and implement appropriate control actions. Malawi was one of the first countries in the African region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. CONCLUSIONS We anticipate findings from this Delphi study will provide insights into how and why Malawi was successful in deploying digital surveillance systems. In addition, findings should produce recommendations and guidance for the rapid development, implementation, maintenance, and impact of digital surveillance tools during a health crisis. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/58389
- 26 March 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluation of the Development, Implementation, Maintenance, and Impact of 3 Digital Surveillance Tools Deployed in Malawi During the COVID-19 Pandemic: Protocol for a Modified Delphi Expert Consensus Study (Preprint)
BACKGROUND The COVID-19 pandemic has highlighted the importance of strengthening national monitoring systems to safeguard a globally connected society, especially those in low- and middle-income countries. Africa’s rapid adoption of digital technological interventions created a new frontier of digital advancement during crises or pandemics. The use of digital tools for disease surveillance can assist with rapid outbreak identification and response, handling duties such as diagnosis, testing, contact tracing, and risk communication. Malawi was one of the first countries in the region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. OBJECTIVE The aim of this study is to seek expert consensus using the Delphi methodology to examine Malawi’s COVID-19 digital surveillance response strategy and to assess the digital tools using the World Health Organization mHealth (mobile health) Assessment and Planning for Scale (MAPS) toolkit. METHODS This protocol follows the Guidance on Conducting and REporting DElphi Studies. Participants must have first-hand experience on the design, implementation or maintenance with COVID-19 digital surveillance systems. There will be no restrictions on the level of expertise or years of experience. The panel will consist of approximately 40 participants. We will use a modified Delphi process whereby rounds 1 and 2 will be hosted online by Qualtrics and round 3 will encompass a face-to-face workshop held in Malawi. Consensus will be defined as ≥70% of participants strongly disagree, disagree, or somewhat disagree, or strongly agree, agree, or somewhat agree. During round 3, the face-to-face workshop, participants will be asked to complete, the MAPS toolkit assessment on the digital tool on which they are experts. The MAPS toolkit will enable the panel members to assess the digital tools from a sustainable perspective from six distinct, yet complementary axes: (1) groundwork, (2) partnerships, (3) financial health, (4) technology and architecture, (5) operations, and (6) monitoring and evaluation. RESULTS The ability of a country to collate, diagnose, monitor, and analyze data forms the cornerstone of an efficient surveillance system, allowing countries to plan and implement appropriate control actions. Malawi was one of the first countries in the African region to launch a government-led coordinated effort to harmonize and streamline the necessary COVID-19 digital health implementation through an integrated system architecture. CONCLUSIONS We anticipate findings from this Delphi study will provide insights into how and why Malawi was successful in deploying digital surveillance systems. In addition, findings should produce recommendations and guidance for the rapid development, implementation, maintenance, and impact of digital surveillance tools during a health crisis. INTERNATIONAL REGISTERED REPORT DERR1-10.2196/58389
- Open Access
- 20 October 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (10) , e25777
Effectiveness of Smartphone-Based Community Case Management on the Urgent Referral, Reconsultation, and Hospitalization of Children Aged Under 5 Years in Malawi: Cluster-Randomized, Stepped-Wedge Trial
Background: Integrated community case management (CCM) has led to reductions in child mortality in Malawi resulting from illnesses such as malaria, pneumonia, and diarrhea. However, adherence to CCM guidelines is often poor, potentially leading to inappropriate clinical decisions and poor outcomes. We determined the impact of an e-CCM app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. Objective: We determined the impact of an electronic version of a smartphone-based CCM (e-CCM) app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. Methods: We used a stepped-wedge, cluster-randomized trial to compare paper-based CCM (control) with and without the use of an e-CCM app on smartphones from November 2016 to February 2017. A total of 102 village clinics from 2 districts in northern Malawi were assigned to 1 of 6 clusters, which were randomized on the sequencing of the crossover from the control phase to the intervention phase as well as the duration of exposure in each phase. Children aged ≥2 months to <5 years who presented with acute illness were enrolled consecutively by health surveillance assistants. The primary outcome of urgent referrals to higher-level facilities was evaluated by using multilevel mixed effects models. A logistic regression model with the random effects of the cluster and the fixed effects for each step was fitted. The adjustment for potential confounders included baseline factors, such as patient age, sex, and the geographical location of the village clinics. Calendar time was adjusted for in the analysis. Results: A total of 6965 children were recruited—49.11% (3421/6965) in the control phase and 50.88% (3544/6965) in the intervention phase. After adjusting for calendar time, children in the intervention phase were more likely to be urgently referred to a higher-level health facility than children in the control phase (odds ratio [OR] 2.02, 95% CI 1.27-3.23; P=.003). Overall, children in the intervention arm had lower odds of attending a repeat health surveillance assistant consultation (OR 0.45, 95% CI 0.34-0.59; P<.001) or being admitted to a hospital (OR 0.75, 95% CI 0.62-0.90; P=.002), but after adjusting for time, these differences were not significant (P=.07 for consultation; P=.30 for hospital admission). Conclusions: The addition of e-CCM decision support by using smartphones led to a greater proportion of children being referred to higher-level facilities, with no apparent increase in hospital admissions or repeat consultations in village clinics. Our findings provide support for the implementation of e-CCM tools in Malawi and other low- and middle-income countries with a need for ongoing assessments of effectiveness and integration with national digital health strategies. Trial Registration: ClinicalTrials.gov NCT02763345; https://clinicaltrials.gov/ct2/show/NCT02763345
- 20 October 2021
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (10) , e25777
Open AccessEffectiveness of Smartphone-Based Community Case Management on the Urgent Referral, Reconsultation, and Hospitalization of Children Aged Under 5 Years in Malawi: Cluster-Randomized, Stepped-Wedge Trial
Background: Integrated community case management (CCM) has led to reductions in child mortality in Malawi resulting from illnesses such as malaria, pneumonia, and diarrhea. However, adherence to CCM guidelines is often poor, potentially leading to inappropriate clinical decisions and poor outcomes. We determined the impact of an e-CCM app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. Objective: We determined the impact of an electronic version of a smartphone-based CCM (e-CCM) app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. Methods: We used a stepped-wedge, cluster-randomized trial to compare paper-based CCM (control) with and without the use of an e-CCM app on smartphones from November 2016 to February 2017. A total of 102 village clinics from 2 districts in northern Malawi were assigned to 1 of 6 clusters, which were randomized on the sequencing of the crossover from the control phase to the intervention phase as well as the duration of exposure in each phase. Children aged ≥2 months to <5 years who presented with acute illness were enrolled consecutively by health surveillance assistants. The primary outcome of urgent referrals to higher-level facilities was evaluated by using multilevel mixed effects models. A logistic regression model with the random effects of the cluster and the fixed effects for each step was fitted. The adjustment for potential confounders included baseline factors, such as patient age, sex, and the geographical location of the village clinics. Calendar time was adjusted for in the analysis. Results: A total of 6965 children were recruited—49.11% (3421/6965) in the control phase and 50.88% (3544/6965) in the intervention phase. After adjusting for calendar time, children in the intervention phase were more likely to be urgently referred to a higher-level health facility than children in the control phase (odds ratio [OR] 2.02, 95% CI 1.27-3.23; P=.003). Overall, children in the intervention arm had lower odds of attending a repeat health surveillance assistant consultation (OR 0.45, 95% CI 0.34-0.59; P<.001) or being admitted to a hospital (OR 0.75, 95% CI 0.62-0.90; P=.002), but after adjusting for time, these differences were not significant (P=.07 for consultation; P=.30 for hospital admission). Conclusions: The addition of e-CCM decision support by using smartphones led to a greater proportion of children being referred to higher-level facilities, with no apparent increase in hospital admissions or repeat consultations in village clinics. Our findings provide support for the implementation of e-CCM tools in Malawi and other low- and middle-income countries with a need for ongoing assessments of effectiveness and integration with national digital health strategies. Trial Registration: ClinicalTrials.gov NCT02763345; https://clinicaltrials.gov/ct2/show/NCT02763345
- Open Access
- 15 November 2020
- Published by JMIR Publications Inc. in JMIR Preprints
Effectiveness of Smartphone-Based Community Case Management on the Urgent Referral, Reconsultation, and Hospitalization of Children Aged Under 5 Years in Malawi: Cluster-Randomized, Stepped-Wedge Trial (Preprint)
BACKGROUND Integrated community case management (CCM) has led to reductions in child mortality in Malawi resulting from illnesses such as malaria, pneumonia, and diarrhea. However, adherence to CCM guidelines is often poor, potentially leading to inappropriate clinical decisions and poor outcomes. We determined the impact of an e-CCM app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. OBJECTIVE We determined the impact of an electronic version of a smartphone-based CCM (e-CCM) app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. METHODS We used a stepped-wedge, cluster-randomized trial to compare paper-based CCM (control) with and without the use of an e-CCM app on smartphones from November 2016 to February 2017. A total of 102 village clinics from 2 districts in northern Malawi were assigned to 1 of 6 clusters, which were randomized on the sequencing of the crossover from the control phase to the intervention phase as well as the duration of exposure in each phase. Children aged ≥2 months to <5 years who presented with acute illness were enrolled consecutively by health surveillance assistants. The primary outcome of urgent referrals to higher-level facilities was evaluated by using multilevel mixed effects models. A logistic regression model with the random effects of the cluster and the fixed effects for each step was fitted. The adjustment for potential confounders included baseline factors, such as patient age, sex, and the geographical location of the village clinics. Calendar time was adjusted for in the analysis. RESULTS A total of 6965 children were recruited—49.11% (3421/6965) in the control phase and 50.88% (3544/6965) in the intervention phase. After adjusting for calendar time, children in the intervention phase were more likely to be urgently referred to a higher-level health facility than children in the control phase (odds ratio [OR] 2.02, 95% CI 1.27-3.23; P=.003). Overall, children in the intervention arm had lower odds of attending a repeat health surveillance assistant consultation (OR 0.45, 95% CI 0.34-0.59; P<.001) or being admitted to a hospital (OR 0.75, 95% CI 0.62-0.90; P=.002), but after adjusting for time, these differences were not significant (P=.07 for consultation; P=.30 for hospital admission). CONCLUSIONS The addition of e-CCM decision support by using smartphones led to a greater proportion of children being referred to higher-level facilities, with no apparent increase in hospital admissions or repeat consultations in village clinics. Our findings provide support for the implementation of e-CCM tools in Malawi and other low- and middle-income countries with a need for ongoing assessments of effectiveness and integration with national digital health strategies. CLINICALTRIAL ClinicalTrials.gov NCT02763345; https://clinicaltrials.gov/ct2/show/NCT02763345
- 15 November 2020
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEffectiveness of Smartphone-Based Community Case Management on the Urgent Referral, Reconsultation, and Hospitalization of Children Aged Under 5 Years in Malawi: Cluster-Randomized, Stepped-Wedge Trial (Preprint)
BACKGROUND Integrated community case management (CCM) has led to reductions in child mortality in Malawi resulting from illnesses such as malaria, pneumonia, and diarrhea. However, adherence to CCM guidelines is often poor, potentially leading to inappropriate clinical decisions and poor outcomes. We determined the impact of an e-CCM app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. OBJECTIVE We determined the impact of an electronic version of a smartphone-based CCM (e-CCM) app on the referral, reconsultation, and hospitalization rates of children presenting to village clinics in Malawi. METHODS We used a stepped-wedge, cluster-randomized trial to compare paper-based CCM (control) with and without the use of an e-CCM app on smartphones from November 2016 to February 2017. A total of 102 village clinics from 2 districts in northern Malawi were assigned to 1 of 6 clusters, which were randomized on the sequencing of the crossover from the control phase to the intervention phase as well as the duration of exposure in each phase. Children aged ≥2 months to <5 years who presented with acute illness were enrolled consecutively by health surveillance assistants. The primary outcome of urgent referrals to higher-level facilities was evaluated by using multilevel mixed effects models. A logistic regression model with the random effects of the cluster and the fixed effects for each step was fitted. The adjustment for potential confounders included baseline factors, such as patient age, sex, and the geographical location of the village clinics. Calendar time was adjusted for in the analysis. RESULTS A total of 6965 children were recruited—49.11% (3421/6965) in the control phase and 50.88% (3544/6965) in the intervention phase. After adjusting for calendar time, children in the intervention phase were more likely to be urgently referred to a higher-level health facility than children in the control phase (odds ratio [OR] 2.02, 95% CI 1.27-3.23; P=.003). Overall, children in the intervention arm had lower odds of attending a repeat health surveillance assistant consultation (OR 0.45, 95% CI 0.34-0.59; P<.001) or being admitted to a hospital (OR 0.75, 95% CI 0.62-0.90; P=.002), but after adjusting for time, these differences were not significant (P=.07 for consultation; P=.30 for hospital admission). CONCLUSIONS The addition of e-CCM decision support by using smartphones led to a greater proportion of children being referred to higher-level facilities, with no apparent increase in hospital admissions or repeat consultations in village clinics. Our findings provide support for the implementation of e-CCM tools in Malawi and other low- and middle-income countries with a need for ongoing assessments of effectiveness and integration with national digital health strategies. CLINICALTRIAL ClinicalTrials.gov NCT02763345; https://clinicaltrials.gov/ct2/show/NCT02763345