Digital Behavioral Risk Stratification Tool Integrated With HIV Online Self-Testing for HIV Positivity Among Men Who Have Sex With Men: Retrospective Observational Study
Open Access
- 11 November 2026
- journal article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 28, e104883
Abstract
Background: Due to concerns about privacy breaches and the fear of social stigma, some individuals engaging in high-risk behaviors—particularly men who have sex with men (MSM)—may avoid in-person HIV testing services and instead choose to purchase HIV self-test kits online. Unlike traditional e-commerce platforms that provide self-test kits directly without conducting risk assessments, the “Easy Test Know” platform integrates a structured behavioral risk assessment prior to purchasing an HIV self-test kit, allowing users to be categorized into different HIV risk groups. Objective: This study aimed to evaluate the performance of a digital HIV behavioral risk stratification tool integrated with online self-testing among MSM and to determine whether incorporating multidimensional behavioral indicators—particularly the high-risk venue diversity score—could improve the prediction of HIV positivity compared with the platform’s existing rule-based risk-scoring algorithm. Methods: This retrospective observational study used data from the “Easy Test Know” platform between November 2023 and February 2025. The analysis included 9961 MSM classified as medium or high risk who had a usable HIV test result. The continuous platform score and the deployed categorical output were evaluated, and enhanced and fully adjusted Firth logistic regression models were compared using areas under the receiver operating characteristic curves (AUCs) with stratified bootstrap 95% CIs, DeLong tests, calibration measures, and bootstrap optimism correction based on 1000 successful model refits. Results: Among 9961 participants, 9044 (90.8%) were classified as high risk, and 58 (0.58%) had an observed HIV-positive result. Positivity was 0.6% (n=54) in the high-risk group and 0.4% (4/914) in the medium-risk group, but the difference was not statistically significant ( P =.70). The deployed categorical output had an AUC of 0.512 (95% CI 0.477‐0.539), with 93.1% (54/58) sensitivity and 9.2% (913/9903) specificity, whereas the continuous platform score had an AUC of 0.646 (95% CI 0.567‐0.725). Each 1-category increase in high-risk venue diversity was associated with higher odds of observed HIV positivity (odds ratio 2.04, 95% CI 1.53‐2.74; P for trend <.001). The enhanced and fully adjusted models had apparent AUCs of 0.728 (95% CI 0.656‐0.801) and 0.752 (95% CI 0.686‐0.817) and optimism-corrected AUCs of 0.688 and 0.713, respectively. Their optimism-corrected calibration slopes were 0.940 and 0.936. Conclusions: Compared with the platform’s original rule-based scoring system, the data-driven behavioral models incorporating high-risk venue diversity showed improved predictive performance, although bootstrap optimism correction yielded more conservative estimates. These findings support further development and independent validation of data-driven approaches to optimize digital HIV risk assessment tools.This publication has 25 references indexed in Scilit:
- Empowering at‐risk Thai adolescents and young adults: an observational study of “Stand By You” – a person‐centred online service model for HIV self‐screening, text‐based counselling and linkage to careJournal of the International AIDS Society, 2025
- Investigating the effectiveness of web‐based HIV self‐test distribution and linkage to HIV treatment and PrEP among groups at elevated risk of HIV in Viet Nam provinces: a mixed‐methods analysis of implementation from pilot to scale‐upJournal of the International AIDS Society, 2024
- Deep learning of HIV field-based rapid testsNature Medicine, 2021
- ‘I will welcome this one 101%, I will so embrace it’: a qualitative exploration of the feasibility and acceptability of HIV self-testing among men who have sex with men (MSM) in Lagos, NigeriaHealth Education Research, 2020
- Egocentric sexual networks of men who have sex with men in the United States: Results from the ARTnet studyEpidemics, 2020
- Combating Stigma Through HIV Self-Testing: New York State's HIV Home Test Giveaway Program for Sexual MinoritiesJournal of Public Health Management & Practice, 2020
- Effects of a Mobile Health Intervention to Promote HIV Self-testing with MSM in China: A Randomized Controlled TrialAIDS and Behavior, 2019
- Online interventions to address HIV and other sexually transmitted and blood‐borne infections among young gay, bisexual and other men who have sex with men: a systematic reviewJournal of the International AIDS Society, 2017
- Social Media Use and HIV-Related Risk Behaviors in Young Black and Latino Gay and Bi Men and Transgender Individuals in New York City: Implications for Online InterventionsJournal of Urban Health, 2016
- Sexual Networks and HIV Risk among Black Men Who Have Sex with Men in 6 U.S. CitiesPLOS ONE, 2015