Shadrack Lilan
Shadrack Lilan has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Christine Wasanga
Shamiri Institute, Nairobi, Kenya
3 shared publications - Tom Lee Osborn
Shamiri Institute, Nairobi, Kenya
3 shared publications - Wendy Mmbone Musonye
Shamiri Institute, Nairobi, Kenya
3 shared publications - Benny Otieno
Shamiri Institute, Nairobi, Kenya
2 shared publications - Edmund Korley
The Agency Fund, San Francisco, CA, United States
2 shared publications Ichami Etyang
Shamiri Institute, Nairobi, Kenya
2 shared publications
Latest Publications
- Open Access
- 3 June 2026
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 13, e79107
Early Deployment of an Integrated Digital Platform (shamiriOS) for Scalable Youth Mental Health Service Delivery in Kenya: Development and Usability Study
Background: Scaling youth mental health services in low-resource settings requires digital infrastructure that supports not just clinical delivery but the full operational, supervisory, and engagement demands of community-based, task-shifted models. Existing platforms—whether commercial health systems, open-source medical records, or consumer-facing wellness apps—address fragments of this need, but none provide the integrated, offline-capable, and affordable architecture required for lay-provider delivery at scale. Objective: We introduce shamiriOS, an open-source, modular digital platform comprising 3 interlinked suites—the Shamiri Digital Hub (SDH) for operational management, Rafi for youth engagement, and the Shamiri Provider Platform (SPP) for clinical workflows—designed for scalable, stepped-care youth mental health delivery in Kenya. Our objectives were (1) to conduct an environmental scan of existing platforms and characterize their limitations, (2) to describe the user-centered design and development of shamiriOS, and (3) to report early deployment outcomes across centralized and decentralized settings between 2023 and 2024. Methods: We conducted a structured environmental scan of 6 case management platforms and 28 youth-facing mental health apps, assessing cost, usability, open-source availability, customizability, offline capability, and suitability for task-shifted delivery. Based on identified gaps, SDH was built as a browser-based operation platform, and Rafi was developed as a native mobile app (Android or iOS) with an offline-first architecture. The SPP was adapted from an existing electronic medical record system. Development followed a user-centered design process with community consultation, including cocreation workshops with 77 university-aged youths. Deployment was evaluated using use analytics, usability ratings, and Net Promoter Scores. Results: No reviewed platform met the combined requirements for stepped-care delivery. SDH was deployed across 11 sites serving 76,344 youths via 1195 lay providers and 111 clinical supervisors by Q1 2024. Staff reported high satisfaction (usability: mean 8.36/10, SD 1.49; Net Promoter Score: mean 8.63/10, SD 1.46). Rafi achieved 74.7% (n=3737) registration at Mount Kenya University, with 50.4% (508/1008) booking therapy sessions, but sustained engagement with self-guided features declined to near 0 by 9 months. Conclusions: shamiriOS demonstrates the feasibility of building modular, open-source digital infrastructure for scalable, task-shifted youth mental health delivery. Its component-based architecture is designed for adaptation to other contexts, though extension would require participatory redesign. The most significant obstacles to impact lie not in platform design but in implementation readiness, incentive alignment, and institutional integration. Future priorities include SPP deployment, artificial intelligence–assisted supervision features (shamiriAI), and strengthening sustained engagement.
- 3 June 2026
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 13, e79107
Open AccessEarly Deployment of an Integrated Digital Platform (shamiriOS) for Scalable Youth Mental Health Service Delivery in Kenya: Development and Usability Study
Background: Scaling youth mental health services in low-resource settings requires digital infrastructure that supports not just clinical delivery but the full operational, supervisory, and engagement demands of community-based, task-shifted models. Existing platforms—whether commercial health systems, open-source medical records, or consumer-facing wellness apps—address fragments of this need, but none provide the integrated, offline-capable, and affordable architecture required for lay-provider delivery at scale. Objective: We introduce shamiriOS, an open-source, modular digital platform comprising 3 interlinked suites—the Shamiri Digital Hub (SDH) for operational management, Rafi for youth engagement, and the Shamiri Provider Platform (SPP) for clinical workflows—designed for scalable, stepped-care youth mental health delivery in Kenya. Our objectives were (1) to conduct an environmental scan of existing platforms and characterize their limitations, (2) to describe the user-centered design and development of shamiriOS, and (3) to report early deployment outcomes across centralized and decentralized settings between 2023 and 2024. Methods: We conducted a structured environmental scan of 6 case management platforms and 28 youth-facing mental health apps, assessing cost, usability, open-source availability, customizability, offline capability, and suitability for task-shifted delivery. Based on identified gaps, SDH was built as a browser-based operation platform, and Rafi was developed as a native mobile app (Android or iOS) with an offline-first architecture. The SPP was adapted from an existing electronic medical record system. Development followed a user-centered design process with community consultation, including cocreation workshops with 77 university-aged youths. Deployment was evaluated using use analytics, usability ratings, and Net Promoter Scores. Results: No reviewed platform met the combined requirements for stepped-care delivery. SDH was deployed across 11 sites serving 76,344 youths via 1195 lay providers and 111 clinical supervisors by Q1 2024. Staff reported high satisfaction (usability: mean 8.36/10, SD 1.49; Net Promoter Score: mean 8.63/10, SD 1.46). Rafi achieved 74.7% (n=3737) registration at Mount Kenya University, with 50.4% (508/1008) booking therapy sessions, but sustained engagement with self-guided features declined to near 0 by 9 months. Conclusions: shamiriOS demonstrates the feasibility of building modular, open-source digital infrastructure for scalable, task-shifted youth mental health delivery. Its component-based architecture is designed for adaptation to other contexts, though extension would require participatory redesign. The most significant obstacles to impact lie not in platform design but in implementation readiness, incentive alignment, and institutional integration. Future priorities include SPP deployment, artificial intelligence–assisted supervision features (shamiriAI), and strengthening sustained engagement.
- Open Access
- 10 March 2026
- Published by JMIR Publications Inc. in JMIR AI
- Vol. 5, e95063
Automated Fidelity Monitoring of Lay-Delivered Mental Health Interventions Using Large Language Models: Development and Pilot Validation of shamiriAI (Preprint)
Background: Task-shifting can help close the mental health treatment gap in low- and middle-income countries, but its effectiveness depends on ongoing supervision, which is hard to scale. AI tools that process session recordings and generate structured fidelity feedback could offer a scalable alternative; yet, to our knowledge, none have been developed or validated for lay-delivered, multilingual, group-format interventions in low-resource settings. Objective: We developed and pilot-validated shamiriAI (ShamiriAI Institute), an automated fidelity-monitoring tool for lay-delivered mental health interventions, embedded within the Shamiri school-based program in Kenya. Methods: Across 6 secondary schools in Ngong Hub, Kajiado County, Kenya (May-September 2025), shamiriAI processed session audio from 47 lay providers through a 5-stage pipeline: ingestion, multilingual automatic speech recognition (ASR) with prosodic feature extraction, personally identifiable information scrubbing, large language model–based fidelity inference, and supervisor reports. The following two aims were assessed: (1) ASR performance on a held-out test set of manually transcribed sessions and (2) interrater reliability between shamiriAI and independent human supervisor ratings across 52 sessions (38 AI-augmented and 14 standard) on 6 domains (Required Contents, Specifics, Thoroughness, Clarity, Skill, and Purity; 1‐7 scale). Reliability used intraclass correlation coefficients, Bland-Altman analysis, adjacent-agreement rates, paired t tests with Holm-Bonferroni correction, and Gwet AC2 (ordinal weights) across 3 formulations of the human reference. Results: The ASR model achieved a character error rate of 0.19, word error rate of 0.34, and cosine semantic similarity of 0.77, indicating strong meaning preservation in code-switched speech. AI fidelity scores were systematically lower than the human composite overall (mean 5.14, SD 0.77 vs mean 5.93, SD 0.57 ); Δ=−0.79; d=−1.16; P <.001). Primary intraclass correlation coefficients ranged from −0.06 to 0.20 across the 6 domains, and AC2 sensitivity analyses (against each individual rater and the rounded composite) corroborated this dimension-level ordering. Three patterns emerged: large systematic underrating on holistic dimensions (Required Contents: d=−3.48; Clarity d=−1.56); bidirectional medium-effect bias on facilitation dimensions (Thoroughness d=−0.99; Skill d=+0.87); and substantial agreement on Specifics, Skill, and Purity (Gwet AC2 0.69‐0.76 against the rounded composite), relative to a human-human AC2 ceiling of 0.42‐0.60 estimated in the same dataset. Exploratory, underpowered subgroup and per-arm checks found no preliminary evidence of bias by lay-provider sex or age band or of arm-level differences. Conclusions: Within this 52-session pilot, shamiriAI shows technically feasible multilingual ASR and a coherent, dimension-dependent reliability profile. Specifics, Purity, and Skill already reach substantial agreement, while underperformance on holistic dimensions (Required Contents and Clarity) reflects diagnosable misalignments in rubric interpretation and prompt design, specifying a concrete agenda for shamiriAI (version 2; Shamiri Institute). Whether AI-augmented supervision improves provider skill or student mental health outcomes will be tested in a planned cluster-randomized noninferiority trial.
- 10 March 2026
- Published by JMIR Publications Inc. in JMIR AI
- Vol. 5, e95063
Open AccessAutomated Fidelity Monitoring of Lay-Delivered Mental Health Interventions Using Large Language Models: Development and Pilot Validation of shamiriAI (Preprint)
Background: Task-shifting can help close the mental health treatment gap in low- and middle-income countries, but its effectiveness depends on ongoing supervision, which is hard to scale. AI tools that process session recordings and generate structured fidelity feedback could offer a scalable alternative; yet, to our knowledge, none have been developed or validated for lay-delivered, multilingual, group-format interventions in low-resource settings. Objective: We developed and pilot-validated shamiriAI (ShamiriAI Institute), an automated fidelity-monitoring tool for lay-delivered mental health interventions, embedded within the Shamiri school-based program in Kenya. Methods: Across 6 secondary schools in Ngong Hub, Kajiado County, Kenya (May-September 2025), shamiriAI processed session audio from 47 lay providers through a 5-stage pipeline: ingestion, multilingual automatic speech recognition (ASR) with prosodic feature extraction, personally identifiable information scrubbing, large language model–based fidelity inference, and supervisor reports. The following two aims were assessed: (1) ASR performance on a held-out test set of manually transcribed sessions and (2) interrater reliability between shamiriAI and independent human supervisor ratings across 52 sessions (38 AI-augmented and 14 standard) on 6 domains (Required Contents, Specifics, Thoroughness, Clarity, Skill, and Purity; 1‐7 scale). Reliability used intraclass correlation coefficients, Bland-Altman analysis, adjacent-agreement rates, paired t tests with Holm-Bonferroni correction, and Gwet AC2 (ordinal weights) across 3 formulations of the human reference. Results: The ASR model achieved a character error rate of 0.19, word error rate of 0.34, and cosine semantic similarity of 0.77, indicating strong meaning preservation in code-switched speech. AI fidelity scores were systematically lower than the human composite overall (mean 5.14, SD 0.77 vs mean 5.93, SD 0.57 ); Δ=−0.79; d=−1.16; P <.001). Primary intraclass correlation coefficients ranged from −0.06 to 0.20 across the 6 domains, and AC2 sensitivity analyses (against each individual rater and the rounded composite) corroborated this dimension-level ordering. Three patterns emerged: large systematic underrating on holistic dimensions (Required Contents: d=−3.48; Clarity d=−1.56); bidirectional medium-effect bias on facilitation dimensions (Thoroughness d=−0.99; Skill d=+0.87); and substantial agreement on Specifics, Skill, and Purity (Gwet AC2 0.69‐0.76 against the rounded composite), relative to a human-human AC2 ceiling of 0.42‐0.60 estimated in the same dataset. Exploratory, underpowered subgroup and per-arm checks found no preliminary evidence of bias by lay-provider sex or age band or of arm-level differences. Conclusions: Within this 52-session pilot, shamiriAI shows technically feasible multilingual ASR and a coherent, dimension-dependent reliability profile. Specifics, Purity, and Skill already reach substantial agreement, while underperformance on holistic dimensions (Required Contents and Clarity) reflects diagnosable misalignments in rubric interpretation and prompt design, specifying a concrete agenda for shamiriAI (version 2; Shamiri Institute). Whether AI-augmented supervision improves provider skill or student mental health outcomes will be tested in a planned cluster-randomized noninferiority trial.
- Open Access
- 16 June 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Early Deployment of an Integrated Digital Platform (shamiriOS) for Scalable Youth Mental Health Service Delivery in Kenya: Development and Usability Study (Preprint)
BACKGROUND Scaling youth mental health services in low-resource settings requires digital infrastructure that supports not just clinical delivery but the full operational, supervisory, and engagement demands of community-based, task-shifted models. Existing platforms—whether commercial health systems, open-source medical records, or consumer-facing wellness apps—address fragments of this need, but none provide the integrated, offline-capable, and affordable architecture required for lay-provider delivery at scale. OBJECTIVE We introduce shamiriOS, an open-source, modular digital platform comprising 3 interlinked suites—the Shamiri Digital Hub (SDH) for operational management, Rafi for youth engagement, and the Shamiri Provider Platform (SPP) for clinical workflows—designed for scalable, stepped-care youth mental health delivery in Kenya. Our objectives were (1) to conduct an environmental scan of existing platforms and characterize their limitations, (2) to describe the user-centered design and development of shamiriOS, and (3) to report early deployment outcomes across centralized and decentralized settings between 2023 and 2024. METHODS We conducted a structured environmental scan of 6 case management platforms and 28 youth-facing mental health apps, assessing cost, usability, open-source availability, customizability, offline capability, and suitability for task-shifted delivery. Based on identified gaps, SDH was built as a browser-based operation platform, and Rafi was developed as a native mobile app (Android or iOS) with an offline-first architecture. The SPP was adapted from an existing electronic medical record system. Development followed a user-centered design process with community consultation, including cocreation workshops with 77 university-aged youths. Deployment was evaluated using use analytics, usability ratings, and Net Promoter Scores. RESULTS No reviewed platform met the combined requirements for stepped-care delivery. SDH was deployed across 11 sites serving 76,344 youths via 1195 lay providers and 111 clinical supervisors by Q1 2024. Staff reported high satisfaction (usability: mean 8.36/10, SD 1.49; Net Promoter Score: mean 8.63/10, SD 1.46). Rafi achieved 74.7% (n=3737) registration at Mount Kenya University, with 50.4% (508/1008) booking therapy sessions, but sustained engagement with self-guided features declined to near 0 by 9 months. CONCLUSIONS shamiriOS demonstrates the feasibility of building modular, open-source digital infrastructure for scalable, task-shifted youth mental health delivery. Its component-based architecture is designed for adaptation to other contexts, though extension would require participatory redesign. The most significant obstacles to impact lie not in platform design but in implementation readiness, incentive alignment, and institutional integration. Future priorities include SPP deployment, artificial intelligence–assisted supervision features (shamiriAI), and strengthening sustained engagement.
- 16 June 2025
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEarly Deployment of an Integrated Digital Platform (shamiriOS) for Scalable Youth Mental Health Service Delivery in Kenya: Development and Usability Study (Preprint)
BACKGROUND Scaling youth mental health services in low-resource settings requires digital infrastructure that supports not just clinical delivery but the full operational, supervisory, and engagement demands of community-based, task-shifted models. Existing platforms—whether commercial health systems, open-source medical records, or consumer-facing wellness apps—address fragments of this need, but none provide the integrated, offline-capable, and affordable architecture required for lay-provider delivery at scale. OBJECTIVE We introduce shamiriOS, an open-source, modular digital platform comprising 3 interlinked suites—the Shamiri Digital Hub (SDH) for operational management, Rafi for youth engagement, and the Shamiri Provider Platform (SPP) for clinical workflows—designed for scalable, stepped-care youth mental health delivery in Kenya. Our objectives were (1) to conduct an environmental scan of existing platforms and characterize their limitations, (2) to describe the user-centered design and development of shamiriOS, and (3) to report early deployment outcomes across centralized and decentralized settings between 2023 and 2024. METHODS We conducted a structured environmental scan of 6 case management platforms and 28 youth-facing mental health apps, assessing cost, usability, open-source availability, customizability, offline capability, and suitability for task-shifted delivery. Based on identified gaps, SDH was built as a browser-based operation platform, and Rafi was developed as a native mobile app (Android or iOS) with an offline-first architecture. The SPP was adapted from an existing electronic medical record system. Development followed a user-centered design process with community consultation, including cocreation workshops with 77 university-aged youths. Deployment was evaluated using use analytics, usability ratings, and Net Promoter Scores. RESULTS No reviewed platform met the combined requirements for stepped-care delivery. SDH was deployed across 11 sites serving 76,344 youths via 1195 lay providers and 111 clinical supervisors by Q1 2024. Staff reported high satisfaction (usability: mean 8.36/10, SD 1.49; Net Promoter Score: mean 8.63/10, SD 1.46). Rafi achieved 74.7% (n=3737) registration at Mount Kenya University, with 50.4% (508/1008) booking therapy sessions, but sustained engagement with self-guided features declined to near 0 by 9 months. CONCLUSIONS shamiriOS demonstrates the feasibility of building modular, open-source digital infrastructure for scalable, task-shifted youth mental health delivery. Its component-based architecture is designed for adaptation to other contexts, though extension would require participatory redesign. The most significant obstacles to impact lie not in platform design but in implementation readiness, incentive alignment, and institutional integration. Future priorities include SPP deployment, artificial intelligence–assisted supervision features (shamiriAI), and strengthening sustained engagement.