Beyond Screen Time: Inferring Everyday Life Context from Diverse Smartphone Data
Open Access
- 15 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-48
Abstract
Smartphones serve as ubiquitous sensors of daily life, generating rich data streams. However, existing research often focuses narrowly on usage metrics from small or homogeneous samples, limiting our understanding of how phone data reflects broader real-world contexts. To address this gap, this paper introduces a hierarchical context inference framework designed to systematically map raw and multimodal data into two deep contextual dimensions: the Informational-Cognitive Context and the Physical-Situational Context. We empirically validated this framework through a large-scale, 14-day in-the-wild study involving a diverse cohort ( N = 539) spanning 15 occupations and 31 provincial regions in China. Applying our framework to this data reveals generalizable phenomena: the information environment frequently mixes multiple topics, shows high emotional fluctuation, and exhibits task-driven volatility rhythms. Physically, users own diverse Bluetooth peripherals but show focused usage, and our models reveal stable and cyclical phone interaction patterns across distinct operational states. Integrating these dimensions yields nuanced user personas that differ across occupational, hobby, and personality groups. This work contributes a validated framework for understanding the interplay between users' digital and physical worlds, supported by the release of a comprehensive multimodal dataset.Keywords
Funding Information
- National Natural Science Foundation of China (62472243)
- National Natural Science Foundation of China (62132010)
This publication has 48 references indexed in Scilit:
- Deconstructing screen time: The connections between digital use, dissatisfaction, and disconnectionComputers in Human Behavior Reports, 2025
- A survey on sentiment analysis methods, applications, and challengesArtificial Intelligence Review, 2022
- Smartphone Screen Time: Inaccuracy of self-reports and influence of psychological and contextual factorsComputers in Human Behavior, 2021
- Characterisation of mobile-device tasks by their associated cognitive load through EEG data processingFuture Generation Computer Systems, 2020
- An examination of the potential lingering effects of smartphone use on cognitionApplied Cognitive Psychology, 2019
- Compulsive Internet use and relations between social connectedness, and introversionComputers in Human Behavior, 2015
- Mining large-scale smartphone data for personality studiesPersonal and Ubiquitous Computing, 2011
- The development and evaluation of a survey to measure user engagementJournal of the American Society for Information Science and Technology, 2009
- Estimating the robustness of questionnaire results: lessons from a mixed-mode survey of expectations for tele-working and road-based business travelTransportation, 2008
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987