Abstract
Electronic skin powered with artificial intelligence could enable next-generation robotic and medical devices, yet integrating multimodal sensors and analyzing heterogeneous, multifrequency time series remain challenging. Most wearable machine learning architectures are time-invariant and trained for a specific task, limiting transfer across modalities and users. We present a multimodal electronic skin that captures diverse physiological signs with an adaptive learning framework that rapidly generalizes to unseen tasks with minimal labeled data. Our streamlined end-to-end framework uses a spectral variational autoencoder to denoise and compress multifrequency biosignals into a shared, unified second-wise latent space that preserves the spectral-temporal structure, followed by a transformer to capture temporal dependencies to support diverse downstream tasks with data-efficient learning. We demonstrate robust adaptation with 94.7% accuracy in activity recognition and 90.2% precision in fatigue assessment across various users and daily activities regardless of device and user variations, highlighting a scalable route to generalized physiological time-series analytics and human performance assessments.
Funding Information
  • National Institutes of Health (R01HL155815)
  • National Institutes of Health (R01DC021461)
  • Office of Naval Research (N00014-21-1-2483)
  • Office of Naval Research (N00014-21-1-2845)
  • Office of Naval Research (N00014-25-1-2258)
  • Army Research Office (W911NF-23-1-0041)
  • Heritage Medical Research Institute
  • PIMCO Data Science Graduate Fellowship

This publication has 58 references indexed in Scilit: