ACAkshat Choube

Akshat Choube

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Akshat Choube has a total of 26 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Generating Personalized Games with Sensing Data to Support Self-Reported Data Collection

    by Jin-Seo Kim, Ha Le, Akshat Choube, Varun Mishra, Stephen S Intille

  • Open Access

    DAIMON: Designing AI-Augmented Research Dashboards to Enable Novel Human-AI Collaborative Workflows in Longitudinal Sensing Studies

    by Akshat Choube, Shreeti Shrestha, Ha Le, Jiachen Li, Vedant Das Swain, Varun Mishra

    Researchers conduct longitudinal passive sensing studies in in-the-wild settings, often spanning months or years, to uncover naturalistic behavioral patterns. These studies are not “set-and-forget” deployments; they require continuous monitoring as technical failures and declining participant compliance can lead to substantial missing data, undermining study validity and downstream models. Thus, conducting these studies involves multiple detail-oriented, cognitively demanding, and time-consuming tasks, making it a burdensome and stressful process. Existing research dashboards, the primary tools for data monitoring, offer limited support in easing this burden. Leveraging recent advances in AI for passive sensing data, we explore the design of human-AI collaborative workflows enabled through research dashboards to improve the effectiveness and efficiency of monitoring and associated tasks. We begin with a co-design study with 13 researchers involved in longitudinal sensing studies to identify desired AI capabilities and interactions through semi-structured interviews, brainstorming, and sketching activities. We operationalize novel human-AI workflows our participants envisioned by implementing an AI-augmented dashboard prototype DAIMON , and use it as a research probe in two studies: a task-based study and a deployment within an ongoing real-world sensing study. Our findings demonstrate the promise of AI-augmented dashboards in supporting researchers' day-to-day data monitoring and decision-making tasks. It also surfaces concerns around transparency and expectations with AI systems. Consolidating insights across all three studies, we present design guidelines for AI-augmented dashboards for longitudinal passive sensing research and discuss directions for future work.


  • Open Access

    Feasibility of Using a Multi-Agent LLM System to Correct Annotations and Support Low-Effort Activity Labeling

    by Ha Le, Akshat Choube, Varun Mishra, Stephen S. Intille

    Accurate measurement of behaviors is critical for research in human-computer interaction, ubiquitous computing, and personal health informatics, because it underpins many health tracking and intervention systems. Most data collection studies, however, still rely on participants' self-reports and manual annotations, which often under- or over-estimate activity duration and type, and require substantial effort from researchers to clean and validate. An automated system that can combine passive sensing data with participants' self-reports might detect inconsistencies and suggest corrections. We introduce GLOSS4HAR, a multi-agent LLM-based system designed to mimic human sensemaking and assist researchers in cleaning and refining activity annotations. We demonstrate the potential of GLOSS4HAR in two key tasks: (1) correcting and reconciling participant self-annotations, and (2) triangulating passive sensing data with different forms of lightweight self-reports to generate accurate activity timelines. Our evaluation shows that GLOSS4HAR improves annotation quality by up to 9.9% in F1 score and can reconstruct activity timelines that align with human annotations at 75-92% F1. Based on our findings, we discuss the implications of our work for the next generation of activity annotation systems that might use human-AI collaboration.


  • Open Access

    A Context-Assisted, Semi-Automated Activity Recall Interface Allowing Uncertainty

    by Ha Le, Veronika Potter, Akshat Choube, Rithika Lakshminarayanan, Varun Mishra, Stephen Intille

    Measuring activities and postures is an important area of research in ubiquitous computing, human-computer interaction, and personal health informatics. One approach that researchers use to collect large amounts of labeled data to develop models for activity recognition and measurement is asking participants to self-report their daily activities. Although participants can typically recall their sequence of daily activities, remembering the precise start and end times of each activity is significantly more challenging. ACAI is a novel, context-assisted Activity Annotation Inttivity Annotation Interface that enables participants to efficiently label their activities by accepting or adjusting system-generated activity suggestions while explicitly expressing uncertainty about temporal boundaries. We evaluated ACAI using two complementary studies: a usability study with 11 participants and a two-week, free-living study with 14 participants. We compared our activity annotation system with the current gold-standard methods for activity recall in health sciences research: 24PAR and its computerized version, ACT24. Our system reduced annotation time and perceived effort while significantly improving data validity and fidelity compared to both standard human-supervised and unsupervised activity recall approaches. We discuss the limitations of our design and implications for developing adaptive, human-in-the-loop activity recognition systems used to collect self-report data on activity.


  • Open Access

    Imputation Matters: A Deeper Look into an Overlooked Step in Longitudinal Health and Behavior Sensing Research

    by Akshat Choube, Sohini Bhattacharya, Rahul Majethia, Jiachen Li, Vedant Das Swain, Varun Mishra

    Longitudinal passive sensing studies for health and behavior outcomes often have missing and incomplete data. Handling missing data effectively is thus a critical data processing and modeling step. Our formative interviews with researchers working in longitudinal health and behavior passive sensing revealed a recurring theme: most researchers consider imputation a low-priority step in their analysis and inference pipeline, opting to use simple and off-the-shelf imputation strategies without comprehensively evaluating its impact on study outcomes. Through this paper, we call attention to the importance of imputation. Using publicly available passive sensing datasets for depression, we show that prioritizing imputation can significantly impact the study outcomes - with our proposed imputation strategies resulting in up to 31% improvement in AUROC to predict depression over the original imputation strategy. We conclude by discussing the challenges and opportunities with effective imputation in longitudinal sensing studies.


  • Open Access

    A Multi-Agent LLM Network for Suggesting and Correcting Human Activity and Posture Annotations

    by Ha Le, Akshat Choube, Vedant Das Swain, Varun Mishra, Stephen Intille

    Accurate human activity recognition (HAR) is critical for health monitoring and behavior-aware systems. Developing reliable HAR models, however, requires large, high-quality labeled datasets that are challenging to collect in free-living settings. Although self-reports offer a practical solution for acquiring activity annotations, they are prone to recall biases, missing data, and human errors. Context-assisted recall can help participants remember their activities more accurately by providing visualizations of multiple data streams, but triangulating this information remains a burdensome and cognitively demanding task. In this work, we adapt GLOSS, a multi-agent LLM system that can triangulate self-reports and passive sensing data to assist participants in activity recall and annotation by suggesting the most likely activities. Our results show that GLOSS provides reasonable activity suggestions that align with human recall (63–75% agreement) and even effectively identifies and corrects common human annotation errors. These findings demonstrate the potential of LLM-powered, human-in-the-loop approaches to improve the quality and scalability of activity annotation in real-world HAR studies.


  • Open Access

    GLOSS: Group of LLMs for Open-ended Sensemaking of Passive Sensing Data for Health and Wellbeing

    by Akshat Choube, Ha Le, Jiachen Li, Kaixin Ji, Vedant Das Swain, Varun Mishra

    The ubiquitous presence of smartphones and wearables has enabled researchers to build prediction and detection models for various health and behavior outcomes using passive sensing data from these devices. Achieving a high-level, holistic understanding of an individual's behavior and context, however, remains a significant challenge. Due to the nature of the passive sensing data, sensemaking --- the process of interpreting and extracting insights - requires both domain knowledge and technical expertise, creating barriers for different stakeholders. Existing systems designed to support sensemaking are not open-ended or cannot perform complex data triangulation. In this paper, we present a novel sensemaking system, Group of LLMs for Open-ended Sensemaking (GLOSS), for open-ended sensemaking capable of performing complex multimodal triangulation to derive insights. We demonstrate that GLOSS significantly outperforms commonly used Retrieval-Augmented Generation (RAG) technique, achieving 87.93% accuracy and 66.19% consistency compared to RAG's 29.31% accuracy and 52.85% consistency. Furthermore, we showcase the promise of GLOSS using four use cases inspired by prior and ongoing work in UbiComp and HCI communities. Finally, we discuss the potential of GLOSS, the broader implications, and the limitations of our work.


  • Open Access

    Vital Insight: Assisting Experts' Context-Driven Sensemaking of Multi-modal Personal Tracking Data Using Visualization and Human-in-the-Loop LLM

    by Jiachen Li, Xiwen Li, Justin Steinberg, Akshat Choube, Bingsheng Yao, Xuhai Xu, Dakuo Wang, Elizabeth Mynatt, Varun Mishra

    Passive tracking methods, such as phone and wearable sensing, have become dominant in monitoring human behaviors in modern ubiquitous computing studies. While there have been significant advances in machine-learning approaches to translate periods of raw sensor data to model momentary behaviors, (e.g., physical activity recognition), there still remains a significant gap in the translation of these sensing streams into meaningful, high-level, context-aware insights that are required for various applications (e.g., summarizing an individual's daily routine). To bridge this gap, experts often need to employ a context-driven sensemaking process in real-world studies to derive insights. For instance, current approaches in the field can reliably predict "walking outdoors" by contextualizing accelerometer and GPS data. Sensemaking, however, involves being able to notice patterns of periodic "walking" and "stationary" events, and even infer "walking the dog" after realizing the alignment with regular routines reported through surveys or self-reports. This process often requires manual effort and can be challenging even for experienced researchers due to the complexity of human behaviors. We conducted three rounds of user studies with 21 experts to explore solutions to address challenges with sensemaking. We follow a human-centered design process to identify needs and design, iterate, build, and evaluate Vital Insight (VI), a novel, LLM-assisted, prototype system to enable human-in-the-loop inference (sensemaking) and visualizations of multimodal passive sensing data from smartphones and wearables. Using the prototype as a technology probe, we observe experts' interactions with it and develop an expert sensemaking model that explains how experts move between direct data representations and AI-supported inferences to explore, question, and validate insights. Through this iterative process, we also synthesize and discuss a list of design implications for the design of future AI-augmented visualization systems to better assist experts' sensemaking processes in multi-modal health sensing data.


  • Open Access

    Topics of Nicotine-Related Discussions on Twitter: Infoveillance Study

    by Jon-Patrick Allem, Allison Dormanesh, Anuja Majmundar, Jennifer B Unger, Matthew G Kirkpatrick, Akshat Choube, Aneesh Aithal, Emilio Ferrara, Tess Boley Cruz

    Background: Cultural trends in the United States, the nicotine consumer marketplace, and tobacco policies are changing. Objective: The goal of this study was to identify and describe nicotine-related topics of conversation authored by the public and social bots on Twitter, including any misinformation or misconceptions that health education campaigns could potentially correct. Methods: Twitter posts containing the term “nicotine” were obtained from September 30, 2018 to October 1, 2019. Methods were used to distinguish between posts from social bots and nonbots. Text classifiers were used to identify topics in posts (n=300,360). Results: Prevalent topics of posts included vaping, smoking, addiction, withdrawal, nicotine health risks, and quit nicotine, with mentions of going “cold turkey” and needing help in quitting. Cessation was a common topic, with mentions of quitting and stopping smoking. Social bots discussed unsubstantiated health claims including how hypnotherapy, acupuncture, magnets worn on the ears, and time spent in the sauna can help in smoking cessation. Conclusions: Health education efforts are needed to correct unsubstantiated health claims on Twitter and ultimately direct individuals who want to quit smoking to evidence-based cessation strategies. Future interventions could be designed to follow these topics of discussions on Twitter and engage with members of the public about evidence-based cessation methods in near real time when people are contemplating cessation.