Yan Kong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yan Kong has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Xin Yi
Tsinghua University, Beijing, China
6 shared publications - Hewu Li
Tsinghua University, Beijing, China
5 shared publications - Shuning Zhang
Tsinghua University, Beijing, China
5 shared publications - Yuanchun Shi
Tsinghua University, Beijing, China
3 shared publications - Chun Yu
Department of Computer Science and Technology, Tsinghua University, Beijing, China
2 shared publications - Xueyang Wang
Institute for Network Sciences and Cyberspace, Tsinghua University, Beijing, China
2 shared publications
Latest Publications
- Open Access
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-48
Beyond Screen Time: Inferring Everyday Life Context from Diverse Smartphone Data
Smartphones serve as ubiquitous sensors of daily life, generating rich data streams. However, existing research often focuses narrowly on usage metrics from small or homogeneous samples, limiting our understanding of how phone data reflects broader real-world contexts. To address this gap, this paper introduces a hierarchical context inference framework designed to systematically map raw and multimodal data into two deep contextual dimensions: the Informational-Cognitive Context and the Physical-Situational Context. We empirically validated this framework through a large-scale, 14-day in-the-wild study involving a diverse cohort ( N = 539) spanning 15 occupations and 31 provincial regions in China. Applying our framework to this data reveals generalizable phenomena: the information environment frequently mixes multiple topics, shows high emotional fluctuation, and exhibits task-driven volatility rhythms. Physically, users own diverse Bluetooth peripherals but show focused usage, and our models reveal stable and cyclical phone interaction patterns across distinct operational states. Integrating these dimensions yields nuanced user personas that differ across occupational, hobby, and personality groups. This work contributes a validated framework for understanding the interplay between users' digital and physical worlds, supported by the release of a comprehensive multimodal dataset.
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-48
Open AccessBeyond Screen Time: Inferring Everyday Life Context from Diverse Smartphone Data
Smartphones serve as ubiquitous sensors of daily life, generating rich data streams. However, existing research often focuses narrowly on usage metrics from small or homogeneous samples, limiting our understanding of how phone data reflects broader real-world contexts. To address this gap, this paper introduces a hierarchical context inference framework designed to systematically map raw and multimodal data into two deep contextual dimensions: the Informational-Cognitive Context and the Physical-Situational Context. We empirically validated this framework through a large-scale, 14-day in-the-wild study involving a diverse cohort ( N = 539) spanning 15 occupations and 31 provincial regions in China. Applying our framework to this data reveals generalizable phenomena: the information environment frequently mixes multiple topics, shows high emotional fluctuation, and exhibits task-driven volatility rhythms. Physically, users own diverse Bluetooth peripherals but show focused usage, and our models reveal stable and cyclical phone interaction patterns across distinct operational states. Integrating these dimensions yields nuanced user personas that differ across occupational, hobby, and personality groups. This work contributes a validated framework for understanding the interplay between users' digital and physical worlds, supported by the release of a comprehensive multimodal dataset.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-22
VisGuardian: A Lightweight Group-based Visual Privacy Control Technique For Smart Glasses in Home Environments
Always-on sensing of AI applications on AR glasses makes traditional permission techniques inefficient for context-dependent private visual data within home environments. Home presents a challenging privacy context due to massive sensitive objects and the intimate nature of daily routines. We propose VisGuardian, a fine-grained content-based visual permission technique for AR glasses. VisGuardian features a group-based control mechanism that enables users to efficiently manage permissions for multiple private objects. VisGuardian detects objects using YOLO and adopts a pre-classified schema to group them. By selecting a single object, users can obscure groups of related objects based on criteria including privacy sensitivity, object category, or spatial proximity. A technical evaluation shows VisGuardian achieves mAP50 of 0.6704 with only 14.0 ms latency and a 1.7% increase in battery consumption per hour. Furthermore, a user study (N=24) comparing VisGuardian to slider-based and object-based baselines found it to be significantly faster for setting permissions and was preferred by users for its efficiency, effectiveness, and ease of use.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Open AccessVisGuardian: A Lightweight Group-based Visual Privacy Control Technique For Smart Glasses in Home Environments
Always-on sensing of AI applications on AR glasses makes traditional permission techniques inefficient for context-dependent private visual data within home environments. Home presents a challenging privacy context due to massive sensitive objects and the intimate nature of daily routines. We propose VisGuardian, a fine-grained content-based visual permission technique for AR glasses. VisGuardian features a group-based control mechanism that enables users to efficiently manage permissions for multiple private objects. VisGuardian detects objects using YOLO and adopts a pre-classified schema to group them. By selecting a single object, users can obscure groups of related objects based on criteria including privacy sensitivity, object category, or spatial proximity. A technical evaluation shows VisGuardian achieves mAP50 of 0.6704 with only 14.0 ms latency and a 1.7% increase in battery consumption per hour. Furthermore, a user study (N=24) comparing VisGuardian to slider-based and object-based baselines found it to be significantly faster for setting permissions and was preferred by users for its efficiency, effectiveness, and ease of use.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-26
"Privacy across the boundary": Examining Perceived Privacy Risk Across Data Transmission and Sharing Ranges of Smart Home Personal Assistants
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-26
Open Access"Privacy across the boundary": Examining Perceived Privacy Risk Across Data Transmission and Sharing Ranges of Smart Home Personal Assistants
- Open Access
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-33
Evaluating the Privacy Valuation of Personal Data on Smartphones
Smartphones hold a great variety of personal data during usage, which at the same time poses privacy risks. In this paper, we used the selling price to reflect users' privacy valuation of their personal data on smartphones. In a 7-day auction, they sold their data as commodities and earn money. We first designed a total of 49 commodities with 8 attributes, covering 14 common types of personal data on smartphones. Then, through a large-scale reverse second price auction (N=181), we examined students' valuation of 15 representative commodities. The average bid-price was 62.8 CNY (8.68 USD) and a regression model with 14 independent variables found the most influential factors for bid-price to be privacy risk, ethnic and gender. When validating our results on non-students (N=34), we found that despite they gave significantly higher prices (M=109.8 CNY, 15.17 USD), "privacy risk" was still one of the most influential factors among the 17 independent variables in the regression model. We recommended that stakeholders should provide 8 attributes of data when selling or managing it.
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-33
Open AccessEvaluating the Privacy Valuation of Personal Data on Smartphones
Smartphones hold a great variety of personal data during usage, which at the same time poses privacy risks. In this paper, we used the selling price to reflect users' privacy valuation of their personal data on smartphones. In a 7-day auction, they sold their data as commodities and earn money. We first designed a total of 49 commodities with 8 attributes, covering 14 common types of personal data on smartphones. Then, through a large-scale reverse second price auction (N=181), we examined students' valuation of 15 representative commodities. The average bid-price was 62.8 CNY (8.68 USD) and a regression model with 14 independent variables found the most influential factors for bid-price to be privacy risk, ethnic and gender. When validating our results on non-students (N=34), we found that despite they gave significantly higher prices (M=109.8 CNY, 15.17 USD), "privacy risk" was still one of the most influential factors among the 17 independent variables in the regression model. We recommended that stakeholders should provide 8 attributes of data when selling or managing it.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Squeez’In: Private Authentication on Smartphones based on Squeezing Gestures
In this paper, we proposed Squeez’In, a technique on smartphones that enabled private authentication by holding and squeezing the phone with a unique pattern. We first explored the design space of practical squeezing gestures for authentication by analyzing the participants’ self-designed gestures and squeezing behavior. Results showed that varying-length gestures with two levels of touch pressure and duration were the most natural and unambiguous. We then implemented Squeez’In on an off-the-shelf capacitive sensing smartphone, and employed an SVM-GBDT model for recognizing gestures and user-specific behavioral patterns, achieving 99.3% accuracy and 0.93 F1-score when tested on 21 users. A following 14-day study validated the memorability and long-term stability of Squeez’In. During usability evaluation, compared with gesture and pin code, Squeez’In achieved significantly faster authentication speed and higher user preference in terms of privacy and security.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessSqueez’In: Private Authentication on Smartphones based on Squeezing Gestures
In this paper, we proposed Squeez’In, a technique on smartphones that enabled private authentication by holding and squeezing the phone with a unique pattern. We first explored the design space of practical squeezing gestures for authentication by analyzing the participants’ self-designed gestures and squeezing behavior. Results showed that varying-length gestures with two levels of touch pressure and duration were the most natural and unambiguous. We then implemented Squeez’In on an off-the-shelf capacitive sensing smartphone, and employed an SVM-GBDT model for recognizing gestures and user-specific behavioral patterns, achieving 99.3% accuracy and 0.93 F1-score when tested on 21 users. A following 14-day study validated the memorability and long-term stability of Squeez’In. During usability evaluation, compared with gesture and pin code, Squeez’In achieved significantly faster authentication speed and higher user preference in terms of privacy and security.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images
A computer vision system using low-resolution image sensors can provide intelligent services (e.g., activity recognition) but preserve unnecessary visual privacy information from the hardware level. However, preserving visual privacy and enabling accurate machine recognition have adversarial needs on image resolution. Modeling the trade-off of privacy preservation and machine recognition performance can guide future privacy-preserving computer vision systems using low-resolution image sensors. In this paper, using the at-home activity of daily livings (ADLs) as the scenario, we first obtained the most important visual privacy features through a user survey. Then we quantified and analyzed the effects of image resolution on human and machine recognition performance in activity recognition and privacy awareness tasks. We also investigated how modern image super-resolution techniques influence these effects. Based on the results, we proposed a method for modeling the trade-off of privacy preservation and activity recognition on low-resolution images.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessModeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images
A computer vision system using low-resolution image sensors can provide intelligent services (e.g., activity recognition) but preserve unnecessary visual privacy information from the hardware level. However, preserving visual privacy and enabling accurate machine recognition have adversarial needs on image resolution. Modeling the trade-off of privacy preservation and machine recognition performance can guide future privacy-preserving computer vision systems using low-resolution image sensors. In this paper, using the at-home activity of daily livings (ADLs) as the scenario, we first obtained the most important visual privacy features through a user survey. Then we quantified and analyzed the effects of image resolution on human and machine recognition performance in activity recognition and privacy awareness tasks. We also investigated how modern image super-resolution techniques influence these effects. Based on the results, we proposed a method for modeling the trade-off of privacy preservation and activity recognition on low-resolution images.