Non-blocking Inference on Asynchronous Mobile Sensor Data with Affinity Control
Author:
Open Access
- 4 November 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 928-929
Abstract
The rise of sensor-rich mobile devices has led to the adoption of multi-modal deep intelligence for distributed sensing tasks. However, varying arrival times of mobile sensory data can cause delays or accuracy decline. The diversity and dynamic nature of mobile systems further exacerbate this challenge. To address this, we present an opportunistic inference approach for asynchronous distributed multi-modal data, enabling inference upon partial data arrival. AdaFlow pioneers the formulation of structured cross-modality affinity using a hierarchical analysis-based normalized matrix, accommodating the diversity and dynamics of modalities. Employing an affinity attention-based conditional GAN (ACGAN), AdaFlow facilitates flexible data imputation, adapting to various modalities and tasks without retraining. Experiments show significant reductions in inference latency and enhanced accuracy compared to status quo approaches.Keywords
Funding Information
- he National Science Fund for Distinguished Young Scholars (62025205)
- The National Natural Science Foundation of China (2032020, 6247074224, 62102317)
This publication has 1 reference indexed in Scilit:
- DeepSwarm: towards swarm deep learning with bi-directional optimization of data acquisition and processingFrontiers of Computer Science, 2024