Modeling the Trade-off of Privacy Preservation and Activity Recognition on Low-Resolution Images
Open Access
- 19 April 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Abstract
A computer vision system using low-resolution image sensors can provide intelligent services (e.g., activity recognition) but preserve unnecessary visual privacy information from the hardware level. However, preserving visual privacy and enabling accurate machine recognition have adversarial needs on image resolution. Modeling the trade-off of privacy preservation and machine recognition performance can guide future privacy-preserving computer vision systems using low-resolution image sensors. In this paper, using the at-home activity of daily livings (ADLs) as the scenario, we first obtained the most important visual privacy features through a user survey. Then we quantified and analyzed the effects of image resolution on human and machine recognition performance in activity recognition and privacy awareness tasks. We also investigated how modern image super-resolution techniques influence these effects. Based on the results, we proposed a method for modeling the trade-off of privacy preservation and activity recognition on low-resolution images.Keywords
All Related Versions
Funding Information
- Natural Science Foundation of China (NSFC) (62002198,62132010)
- Institute for Artifcial Intelligence, Tsinghua University
- Beijing Key Lab of Networked Multimedia
- Tsinghua University Initiative Scientifc Research Program
This publication has 42 references indexed in Scilit:
- Monitoring Activities of Daily Living in Smart Homes: Understanding human behaviorIEEE Signal Processing Magazine, 2016
- Estimating head pose orientation using extremely low resolution images2016
- Face/Off2015
- Towards privacy-preserving activity recognition using extremely low temporal and spatial resolution cameras2015
- Visual privacy protection methods: A surveyExpert Systems with Applications, 2015
- Exploring Privacy and Accuracy Trade-Offs in Crowdsourced Behavioral Video Coding2015
- W3-privacy: understanding what, when, and where inference channels in multi-camera surveillance videoMultimedia Tools and Applications, 2012
- Unpacking "privacy" for a networked world2003
- The effects of filtered video on awareness and privacy2000
- Masking in Visual Recognition: Effects of Two-Dimensional Filtered NoiseScience, 1973