(Un)fair Devices: Moving Beyond AI Accuracy in Personal Sensing
Open Access
- 13 April 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Journal on Responsible Computing
- Vol. 3 (2) , 1-24
Abstract
Personal devices are omnipresent in our lives, seamlessly monitoring our activities, from smart rings tracking sleep patterns to smartwatches keeping an eye on missed heartbeats. The rich data streams from such devices fuel advanced Artificial Intelligence (AI) applications. Instead of solely relying on direct sensor measurements, these applications are increasingly leveraging Machine Learning (ML) model estimates to derive insights. But are these estimates biased or not? This literature review delivers compelling evidence about the impact of hidden biases that creep into ML models deployed on personal devices. We discuss critical bias issues drawn from prior work such as racial bias in pulse oximeters, weight bias in optical heart rate sensors, and sex bias in audio-based diagnostics. In response to these challenges, we advocate for a shift from prioritizing performance-oriented evaluations of personal devices to adopting assessments grounded in a human-centered approach. To facilitate this transition, we provide guidelines for the design, development, evaluation, and use of unbiased AI in personal devices, recognizing their potential impact on improving our health, lifestyle, and productivity—more than any other technology.Keywords
All Related Versions
Funding Information
- European Union’s Horizon 2020 (813162)
This publication has 89 references indexed in Scilit:
- Environment-aware Multi-person Tracking in Indoor Environments with MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2023
- HeadarProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2023
- LifeSnaps, a 4-month multi-modal dataset capturing unobtrusive snapshots of our lives in the wildScientific Data, 2022
- Algorithmic fairness in computational medicineEBioMedicine, 2022
- A Review on Fairness in Machine LearningACM Computing Surveys, 2022
- Datasheets for datasetsCommunications of the ACM, 2021
- An Overview of Fairness in ClusteringIEEE Access, 2021
- Machine learning and algorithmic fairness in public and population healthNature Machine Intelligence, 2021
- Bias on the webCommunications of the ACM, 2018
- Some computer science issues in ubiquitous computingCommunications of the ACM, 1993