MagFace: Interference-Resistant Facial Gesture Recognition System on Cycling Glasses with Low-Power Magnetic Sensing
Open Access
- 13 April 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-22
Abstract
Facial interaction provides a safe, hands-free input method for cyclists. However, existing wearable facial gesture recognition suffers from severe interference in real-world conditions such as lighting, vibration, sweat, noise, and temperature changes. We present MagFace, an interference-resistant recognition system for cycling glasses using energy-efficient magnetic sensing. MagFace employs four pairs of magnetic silicone and magnetometers on the frame to capture subtle facial skin movements, operating at 30 Hz with a peak power of 150 mW. A tailored deep learning pipeline effectively learns magnetic signals for gesture classification. An evaluation (N=15) shows that MagFace required only one minute of training data to recognize six gestures across different cycling scenarios with high accuracy. A controlled conditions evaluation (N=8) shows MagFace’s robustness against strong lighting, wind, bumpy roads, and uphills. Finally, an in-the-wild evaluation (N=14) shows the stable performance of MagFace’s real-time system and demonstrates promising usability of MagFace.Keywords
Funding Information
- Zhejiang Provincial Natural Science Foundation of China (LR24F020001)
- Scientific Research Fund of Zhejiang Provincial Education Department (Y202454794)
This publication has 103 references indexed in Scilit:
- XpendFab: 3D printing expendable mechanisms for functional breakage, splitting, and disassemblyDesign and Artificial Intelligence, 2025
- A Review on Magnetic Smart Skin as Human–Machine InterfacesAdvanced Electronic Materials, 2024
- Assistive Magnetic Skin System for Speech Reconstruction: An Empowering Technology for Aphonic IndividualsAdvanced Intelligent Systems, 2023
- Magnetic soft robots: Design, actuation, and functionJournal of Alloys and Compounds, 2022
- An Assistive Magnetic Skin System: Enabling Technology for QuadriplegicsAdvanced Engineering Materials, 2020
- An Imperceptible Magnetic SkinAdvanced Materials Technologies, 2019
- Soft Magnetic Skin for Continuous Deformation SensingAdvanced Intelligent Systems, 2019
- Gesturing on the Handlebar: A User-Elicitation Study for On-Bike Gestural Interaction2018
- The Handlebar as an Input Field: Evaluating Finger Gestures Designed for Bicycle Riders2018
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research1988