MAGNeT: Multimodal Adaptive Gaussian Networks for Intent Inference in Moving Target Selection across Complex Scenarios
Authors:
- Xiangxian LiXLXiangxian Li
- Yawen ZhengYZYawen Zheng
- Baiqiao ZhangBZBaiqiao Zhang
- Yijia MaYMYijia Ma
- Xianhui CaoXCXianhui Cao
- Juan LiuJLJuan Liu
- Yulong BianYBYulong Bian
- Jin HuangJHJin Huang
- Chenglei YangCYChenglei Yang
Preprint
Abstract
Moving target selection in multimedia interactive systems faces unprecedented challenges as users increasingly interact across diverse and dynamic contexts-from live streaming in moving vehicles to VR gaming in varying environments. Existing approaches rely on probabilistic models that relate endpoint distribution to target properties such as size and speed. However, these methods require substantial training data for each new context and lack transferability across scenarios, limiting their practical deployment in diverse multimedia environments where rich multimodal contextual information is readily available. This paper introduces MAGNeT (Multimodal Adaptive Gaussian Networks), which addresses these problems by combining classical statistical modeling with a context-aware multimodal method. MAGNeT dynamically fuses pre-fitted Ternary-Gaussian models from various scenarios based on real-time contextual cues, enabling effective adaptation with minimal training data while preserving model interpretability. We conduct experiments on self-constructed 2D and 3D moving target selection datasets under in-vehicle vibration conditions. Extensive experiments demonstrate that MAGNeT achieves lower error rates with few-shot samples by applying context-aware fusion of Gaussian experts from multi-factor conditions.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Mixture of experts (MoE): A big data perspectiveInformation Fusion, 2025
- 3D Ternary-Gaussian model: Modeling pointing uncertainty of 3D moving target selection in virtual realityInternational Journal of Human-Computer Studies, 2025
- Variational Mixture of Stochastic Experts Auto-Encoder for Multi-Modal RecommendationIEEE Transactions on Multimedia, 2024
- Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusion2023
- Understanding user performance of acquiring targets with motion-in-depth in virtual realityInternational Journal of Human-Computer Studies, 2022
- Modeling the Endpoint Uncertainty in Crossing-based Moving Target Selection2020
- Understanding the Uncertainty in 1D Unidirectional Moving Target Selection2018
- Biodynamic Characteristics of Upper Limb Reaching Movements of the Seated Human Under Whole-Body VibrationJournal of Applied Biomechanics, 2013
- Comet and target ghost2011
- Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments2007