Shuyu Dai
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Shuyu Dai has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
- Kun Yan
Peking University, Beijing, China
2 shared publications - Ping Wang
Peking University, Beijing, China
2 shared publications - Anyang Su
Mininglamp Technology, Beijing, China
1 shared publication - Beiping Tan
Mininglamp Technology, Beijing, China
1 shared publication - Chang Xu
The University of Sydney, Sydney, Australia
1 shared publication - Chenxu Zhao
Mininglamp Technology, Beijing, China
1 shared publication
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11613-11622
Learning Explainable Video Saliency Prediction from Reasoning-Annotated Eye-Tracking Supervision
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 11613-11622
Open AccessLearning Explainable Video Saliency Prediction from Reasoning-Annotated Eye-Tracking Supervision
- 19 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (7) , 5538-5555
Low-Shot Video Object Segmentation
Prior research in video object segmentation (VOS) predominantly relies on videos with dense annotations. However, obtaining pixel-level annotations is both costly and time-intensive. In this work, we highlight the potential of effectively training a VOS model using remarkably sparse video annotations—specifically, as few as one or two labeled frames per training video, yet maintaining near equivalent performance levels. We introduce this innovative training methodology as low-shot video object segmentation, abbreviated as low-shot VOS. Central to this method is the generation of reliable pseudo labels for unlabeled frames during the training phase, which are then used in tandem with labeled frames to optimize the model. Notably, our strategy is extremely simple and can be incorporated into the vast majority of current VOS models. For the first time, we propose a universal method for training VOS models on one-shot and two-shot VOS datasets. In the two-shot configuration, utilizing just 7.3% and 2.9% of labeled data from the YouTube-VOS and DAVIS benchmarks respectively, our model delivers results on par with those trained on completely labeled datasets. It is also worth noting that in the one-shot setting, a minor performance decrement is observed in comparison to models trained on fully annotated datasets.
- 19 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (7) , 5538-5555
Low-Shot Video Object Segmentation
Prior research in video object segmentation (VOS) predominantly relies on videos with dense annotations. However, obtaining pixel-level annotations is both costly and time-intensive. In this work, we highlight the potential of effectively training a VOS model using remarkably sparse video annotations—specifically, as few as one or two labeled frames per training video, yet maintaining near equivalent performance levels. We introduce this innovative training methodology as low-shot video object segmentation, abbreviated as low-shot VOS. Central to this method is the generation of reliable pseudo labels for unlabeled frames during the training phase, which are then used in tandem with labeled frames to optimize the model. Notably, our strategy is extremely simple and can be incorporated into the vast majority of current VOS models. For the first time, we propose a universal method for training VOS models on one-shot and two-shot VOS datasets. In the two-shot configuration, utilizing just 7.3% and 2.9% of labeled data from the YouTube-VOS and DAVIS benchmarks respectively, our model delivers results on par with those trained on completely labeled datasets. It is also worth noting that in the one-shot setting, a minor performance decrement is observed in comparison to models trained on fully annotated datasets.
- 18 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (9) , 15087-15099
WiCGesture: Meta-Motion-Based Continuous Gesture Recognition With Wi-Fi
Recent advancements in Wi-Fi-based sensing technologies have enabled effective hand gesture recognition. However, most studies focus on single gesture recognition and fail to recognize naturally performed continuous gestures without pauses in transitions. The main challenges include diverse and uncertain transitions in continuous gesture recognition, making it difficult to segment and identify gestures from a stream of continuous hand movements. In this article, we introduce a new method to recognize continuously performed gestures from a set of predefined gestures (e.g., digits) without requiring a pause in transitions. Instead of segmenting gestures at the gesture-transition level, we segment the stream into basic fractions that depict exclusive moving patterns of gestures. We propose a novel feature called meta motion, which geometrically characterizes different basic hand movements. Leveraging this feature, we use a back-tracking searching-based algorithm to identify gestures from the sequence of meta motions. Based on this approach, we develop a prototype system, WiCGesture, on commodity Wi-Fi devices. WiCGesture is the first system engaging in continuous gesture recognition using Wi-Fi signals. Evaluation results show that WiCGesture effectively recognizes continuous gestures from two gesture sets, significantly outperforming state-of-the-art methods.
- 18 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (9) , 15087-15099
WiCGesture: Meta-Motion-Based Continuous Gesture Recognition With Wi-Fi
Recent advancements in Wi-Fi-based sensing technologies have enabled effective hand gesture recognition. However, most studies focus on single gesture recognition and fail to recognize naturally performed continuous gestures without pauses in transitions. The main challenges include diverse and uncertain transitions in continuous gesture recognition, making it difficult to segment and identify gestures from a stream of continuous hand movements. In this article, we introduce a new method to recognize continuously performed gestures from a set of predefined gestures (e.g., digits) without requiring a pause in transitions. Instead of segmenting gestures at the gesture-transition level, we segment the stream into basic fractions that depict exclusive moving patterns of gestures. We propose a novel feature called meta motion, which geometrically characterizes different basic hand movements. Leveraging this feature, we use a back-tracking searching-based algorithm to identify gestures from the sequence of meta motions. Based on this approach, we develop a prototype system, WiCGesture, on commodity Wi-Fi devices. WiCGesture is the first system engaging in continuous gesture recognition using Wi-Fi signals. Evaluation results show that WiCGesture effectively recognizes continuous gestures from two gesture sets, significantly outperforming state-of-the-art methods.