Yi Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yi Li has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
Anthony Kong
1 shared publication- Bingyi Chen
Center for Future Media, University of Electronic Science and Technology of China, China and School of Computer Science and Engineering, University of Electronic Science and Technology of China, China
1 shared publication - Chen Li
The Hong Kong Polytechnic University
1 shared publication - George Baciu
Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China
1 shared publication - Guan Wang
Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China, Huzhou, China
1 shared publication - Ho Ting Miffy Cheung
Department of Computing, The Hong Kong Polytechnic University, Hong Kong, Hong Kong
1 shared publication
Latest Publications
- Open Access
- 15 July 2026
- Published by Elsevier in SSRN Electronic Journal
Every Second Matters: Investigating the Effects of Conversational Response Delays and Contextualized Fillers for Digital Avatars
Emergent large language model (LLM)-based digital avatars are poised to have broad applications across domains. However, LLMs, together with auxiliary services such as text-to-speech, require processing time and can generate undesirable conversational response delays. There is still limited understanding of how such delays affect human-avatar interaction, particularly the point at which a delay changes from acceptable to unacceptable. In this paper, we first conduct a preliminary study in virtual reality (N = 30) to investigate the effects of response delays ranging from 0 to 16000 ms. The results show that delays between 0 and 2000 ms are generally acceptable, with around 1000 ms perceived as the most natural. Noticeable degradation begins by 4000 ms and becomes pronounced at 8000 ms. Based on these findings, we implemented a turn-taking scheme that uses a lightweight LLM to generate contextualized conversational fillers within 1000 ms. We then compare this approach with commonly used canned lexical and non-lexical fillers in a user study (N = 63). Canned non-lexical fillers provide no improvement and can worsen the experience, while canned lexical fillers offer only limited benefits. In contrast, contextualized fillers more effectively preserve conversational realism, social context, interactivity, anthropomorphism, and animacy, while reducing discomfort. These findings show that faster responses are not always better and that filler effectiveness depends on contextual relevance. This work provides design guidance for more natural and socially appropriate digital avatars and conversational user interfaces.
- 15 July 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessEvery Second Matters: Investigating the Effects of Conversational Response Delays and Contextualized Fillers for Digital Avatars
Emergent large language model (LLM)-based digital avatars are poised to have broad applications across domains. However, LLMs, together with auxiliary services such as text-to-speech, require processing time and can generate undesirable conversational response delays. There is still limited understanding of how such delays affect human-avatar interaction, particularly the point at which a delay changes from acceptable to unacceptable. In this paper, we first conduct a preliminary study in virtual reality (N = 30) to investigate the effects of response delays ranging from 0 to 16000 ms. The results show that delays between 0 and 2000 ms are generally acceptable, with around 1000 ms perceived as the most natural. Noticeable degradation begins by 4000 ms and becomes pronounced at 8000 ms. Based on these findings, we implemented a turn-taking scheme that uses a lightweight LLM to generate contextualized conversational fillers within 1000 ms. We then compare this approach with commonly used canned lexical and non-lexical fillers in a user study (N = 63). Canned non-lexical fillers provide no improvement and can worsen the experience, while canned lexical fillers offer only limited benefits. In contrast, contextualized fillers more effectively preserve conversational realism, social context, interactivity, anthropomorphism, and animacy, while reducing discomfort. These findings show that faster responses are not always better and that filler effectiveness depends on contextual relevance. This work provides design guidance for more natural and socially appropriate digital avatars and conversational user interfaces.
- Open Access
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Monte Carlo Denoising via Multi-scale Auxiliary Feature Fusion Guided Transformer
Deep learning-based single-frame Monte Carlo denoising techniques have demonstrated remarkable results in photo-realistic rendering research. However, the current state-of-the-art methods relying on self-attention mechanisms underutilize auxiliary features and struggle to preserve intricate high-frequency details in complex scenes. Employing a generative adversarial architecture, we present a transformer-based denoising network guided by multi-scale auxiliary feature. The proposed U-shaped denoising network extracts multi-scale texture and geometric features from auxiliaries, modulating them to guide the improved transformer module’s denoising process. The improved transformer module employs cross-channel self-attention to capture non-local relationships with near-linear computational complexity. Additionally, a gating mechanism is introduced in the transformer module’s feed-forward network, enhancing information flow. Extensive experiments on noisy images with varied per-pixel sampling rates demonstrate the method’s superiority in quantitative metrics and visual perception compared with state-of-the-art methods. Our method excels notably in intricate scenes with complex hair and texture details, which are historically challenging to denoise.
- 28 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessMonte Carlo Denoising via Multi-scale Auxiliary Feature Fusion Guided Transformer
Deep learning-based single-frame Monte Carlo denoising techniques have demonstrated remarkable results in photo-realistic rendering research. However, the current state-of-the-art methods relying on self-attention mechanisms underutilize auxiliary features and struggle to preserve intricate high-frequency details in complex scenes. Employing a generative adversarial architecture, we present a transformer-based denoising network guided by multi-scale auxiliary feature. The proposed U-shaped denoising network extracts multi-scale texture and geometric features from auxiliaries, modulating them to guide the improved transformer module’s denoising process. The improved transformer module employs cross-channel self-attention to capture non-local relationships with near-linear computational complexity. Additionally, a gating mechanism is introduced in the transformer module’s feed-forward network, enhancing information flow. Extensive experiments on noisy images with varied per-pixel sampling rates demonstrate the method’s superiority in quantitative metrics and visual perception compared with state-of-the-art methods. Our method excels notably in intricate scenes with complex hair and texture details, which are historically challenging to denoise.