Qian Zhu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Qian Zhu has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Xiaojuan Ma
The Hong Kong University of Science and Technology, Hong Kong, China
6 shared publications - Tao Lu
Georgia Institute of Technology, Atlanta, Georgia, USA
3 shared publications - Meng Xia
Texas A&M University
2 shared publications - Quan Li
School of Information Science and Technology, ShanghaiTech University, Shanghai, China
2 shared publications - Shuai Ma
Institute of Software, Chinese Academy of Sciences, Beijing, China
2 shared publications - Shunan Guo
Adobe Research, San Jose, California, USA
2 shared publications
Latest Publications
- Open Access
- 21 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-20
UPinch: Enabling Unaligned Gaze-Hand Coordination for Selection in 3D Environments
People’s natural gaze-hand coordination can vary across different tasks. However, existing gaze-hand based 3D selection techniques often require the alignment of gaze-based indication and hand-based confirmation. Therefore, we introduce UPinch, a gaze-hand based selection technique that enables unaligned gaze-hand coordination, as observed in human reach-to-grasp processes such as grasping an object to move. It registers and updates potential target candidates while extending the index finger and thumb, subsequently confirming the selection through pinching. We conducted a series of cross-reality experiments comparing UPinch to reality and gaze-hand aligned selection techniques across tasks of manual pointing, object translation, and selections with prior location knowledge. Results unveiled characteristics of their gaze-hand coordination in these tasks, indicating that UPinch performs comparably to gaze-hand aligned techniques in manual pointing tasks and selections with prior location knowledge with trade-off of increased learning effort, while surpassing them in object translation tasks without penalty on error rate.
- 21 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Open AccessUPinch: Enabling Unaligned Gaze-Hand Coordination for Selection in 3D Environments
People’s natural gaze-hand coordination can vary across different tasks. However, existing gaze-hand based 3D selection techniques often require the alignment of gaze-based indication and hand-based confirmation. Therefore, we introduce UPinch, a gaze-hand based selection technique that enables unaligned gaze-hand coordination, as observed in human reach-to-grasp processes such as grasping an object to move. It registers and updates potential target candidates while extending the index finger and thumb, subsequently confirming the selection through pinching. We conducted a series of cross-reality experiments comparing UPinch to reality and gaze-hand aligned selection techniques across tasks of manual pointing, object translation, and selections with prior location knowledge. Results unveiled characteristics of their gaze-hand coordination in these tasks, indicating that UPinch performs comparably to gaze-hand aligned techniques in manual pointing tasks and selections with prior location knowledge with trade-off of increased learning effort, while surpassing them in object translation tasks without penalty on error rate.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Signaling Human Intentions to Service Robots: Understanding the Use of Social Cues during In-Person Conversations
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Open AccessSignaling Human Intentions to Service Robots: Understanding the Use of Social Cues during In-Person Conversations
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Danmaku Avatar: Enabling Asynchronous Co-viewing Experiences in Virtual Reality via Danmaku
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessDanmaku Avatar: Enabling Asynchronous Co-viewing Experiences in Virtual Reality via Danmaku
- 9 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 591-601
CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments
Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments typically occurs asynchronously outside of the immersive space and is carried out by experienced experts. In this work, we aim to empower users to participate in the creation of composite visualization within immersive environments through embodied interactions. This could provide a flexible and fluid experience with immersive visualization and has the potential to facilitate understanding of the relationship between visualization views. We begin with developing a design space of embodied interactions to create various types of composite visualizations with the consideration of data relationships. Drawing inspiration from people's natural experience of manipulating physical objects, we design interactions based on the combination of 3D manipulations in immersive environments. Building upon the design space, we present a series of case studies showcasing the interaction to create different kinds of composite visualizations in virtual reality. Subsequently, we conduct a user study to evaluate the usability of the derived interaction techniques and user experience of creating composite visualizations through embodied interactions. We find that empowering users to participate in composite visualizations through embodied interactions enables them to flexibly leverage different visualization views for understanding and communicating the relationships between different views, which underscores the potential of several future application scenarios.
- 9 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 591-601
CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments
Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments typically occurs asynchronously outside of the immersive space and is carried out by experienced experts. In this work, we aim to empower users to participate in the creation of composite visualization within immersive environments through embodied interactions. This could provide a flexible and fluid experience with immersive visualization and has the potential to facilitate understanding of the relationship between visualization views. We begin with developing a design space of embodied interactions to create various types of composite visualizations with the consideration of data relationships. Drawing inspiration from people's natural experience of manipulating physical objects, we design interactions based on the combination of 3D manipulations in immersive environments. Building upon the design space, we present a series of case studies showcasing the interaction to create different kinds of composite visualizations in virtual reality. Subsequently, we conduct a user study to evaluate the usability of the derived interaction techniques and user experience of creating composite visualizations through embodied interactions. We find that empowering users to participate in composite visualizations through embodied interactions enables them to flexibly leverage different visualization views for understanding and communicating the relationships between different views, which underscores the potential of several future application scenarios.
- Open Access
CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments
Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments typically occurs asynchronously outside of the immersive space and is carried out by experienced experts. In this work, we aim to empower users to participate in the creation of composite visualization within immersive environments through embodied interactions. This could provide a flexible and fluid experience with immersive visualization and has the potential to facilitate understanding of the relationship between visualization views. We begin with developing a design space of embodied interactions to create various types of composite visualizations with the consideration of data relationships. Drawing inspiration from people's natural experience of manipulating physical objects, we design interactions based on the combination of 3D manipulations in immersive environments. Building upon the design space, we present a series of case studies showcasing the interaction to create different kinds of composite visualizations in virtual reality. Subsequently, we conduct a user study to evaluate the usability of the derived interaction techniques and user experience of creating composite visualizations through embodied interactions. We find that empowering users to participate in composite visualizations through embodied interactions enables them to flexibly leverage different visualization views for understanding and communicating the relationships between different views, which underscores the potential of several future application scenarios.
Open AccessCompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments
Composite visualization represents a widely embraced design that combines multiple visual representations to create an integrated view. However, the traditional approach of creating composite visualizations in immersive environments typically occurs asynchronously outside of the immersive space and is carried out by experienced experts. In this work, we aim to empower users to participate in the creation of composite visualization within immersive environments through embodied interactions. This could provide a flexible and fluid experience with immersive visualization and has the potential to facilitate understanding of the relationship between visualization views. We begin with developing a design space of embodied interactions to create various types of composite visualizations with the consideration of data relationships. Drawing inspiration from people's natural experience of manipulating physical objects, we design interactions based on the combination of 3D manipulations in immersive environments. Building upon the design space, we present a series of case studies showcasing the interaction to create different kinds of composite visualizations in virtual reality. Subsequently, we conduct a user study to evaluate the usability of the derived interaction techniques and user experience of creating composite visualizations through embodied interactions. We find that empowering users to participate in composite visualizations through embodied interactions enables them to flexibly leverage different visualization views for understanding and communicating the relationships between different views, which underscores the potential of several future application scenarios.
- Open Access
- 1 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1789-1804
Towards Feature Engineering with Human and AI’s Knowledge: Understanding Data Science Practitioners’ Perceptions in Human&AI-Assisted Feature Engineering Design
As AI technology continues to advance, the importance of human-AI collaboration becomes increasingly evident, with numerous studies exploring its potential in various fields. One vital field is data science, including feature engineering (FE), where both human ingenuity and AI capabilities play pivotal roles. Despite the existence of AI-generated recommendations for FE, there remains a limited understanding of how to effectively integrate and utilize humans’ and AI’s knowledge. To address this gap, we design a readily-usable prototype, human&AI-assisted FE in Jupyter notebooks. It harnesses the strengths of humans and AI to provide feature suggestions to users, seamlessly integrating these recommendations into practical workflows. Using the prototype as a research probe, we conducted an exploratory study to gain valuable insights into data science practitioners’ perceptions, usage patterns, and their potential needs when presented with feature suggestions from both humans and AI. Through qualitative analysis, we discovered that the “Creator” of the feature (i.e., AI or human) significantly influences users’ feature selection, and the semantic clarity of the suggested feature greatly impacts its adoption rate. Furthermore, our findings indicate that users perceive both differences and complementarity between features generated by humans and those generated by AI. Lastly, based on our study results, we derived a set of design recommendations for future human&AI FE design. Our findings show the collaborative potential between humans and AI in the field of FE.
- 1 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1789-1804
Open AccessTowards Feature Engineering with Human and AI’s Knowledge: Understanding Data Science Practitioners’ Perceptions in Human&AI-Assisted Feature Engineering Design
As AI technology continues to advance, the importance of human-AI collaboration becomes increasingly evident, with numerous studies exploring its potential in various fields. One vital field is data science, including feature engineering (FE), where both human ingenuity and AI capabilities play pivotal roles. Despite the existence of AI-generated recommendations for FE, there remains a limited understanding of how to effectively integrate and utilize humans’ and AI’s knowledge. To address this gap, we design a readily-usable prototype, human&AI-assisted FE in Jupyter notebooks. It harnesses the strengths of humans and AI to provide feature suggestions to users, seamlessly integrating these recommendations into practical workflows. Using the prototype as a research probe, we conducted an exploratory study to gain valuable insights into data science practitioners’ perceptions, usage patterns, and their potential needs when presented with feature suggestions from both humans and AI. Through qualitative analysis, we discovered that the “Creator” of the feature (i.e., AI or human) significantly influences users’ feature selection, and the semantic clarity of the suggested feature greatly impacts its adoption rate. Furthermore, our findings indicate that users perceive both differences and complementarity between features generated by humans and those generated by AI. Lastly, based on our study results, we derived a set of design recommendations for future human&AI FE design. Our findings show the collaborative potential between humans and AI in the field of FE.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Make Interaction Situated: Designing User Acceptable Interaction for Situated Visualization in Public Environments
Situated visualization blends data into the real world to fulfill individuals’ contextual information needs. However, interacting with situated visualization in public environments faces challenges posed by users’ acceptance and contextual constraints. To explore appropriate interaction design, we first conduct a formative study to identify users’ needs for data and interaction. Informed by the findings, we summarize appropriate interaction modalities with eye-based, hand-based and spatially-aware object interaction for situated visualization in public environments. Then, through an iterative design process with six users, we explore and implement interactive techniques for activating and analyzing with situated visualization. To assess the effectiveness and acceptance of these interactions, we integrate them into an AR prototype and conduct a within-subjects study in public scenarios using conventional hand-only interactions as the baseline. The results show that participants preferred our prototype over the baseline, attributing their preference to the interactions being more acceptable, flexible, and practical in public.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Open AccessMake Interaction Situated: Designing User Acceptable Interaction for Situated Visualization in Public Environments
Situated visualization blends data into the real world to fulfill individuals’ contextual information needs. However, interacting with situated visualization in public environments faces challenges posed by users’ acceptance and contextual constraints. To explore appropriate interaction design, we first conduct a formative study to identify users’ needs for data and interaction. Informed by the findings, we summarize appropriate interaction modalities with eye-based, hand-based and spatially-aware object interaction for situated visualization in public environments. Then, through an iterative design process with six users, we explore and implement interactive techniques for activating and analyzing with situated visualization. To assess the effectiveness and acceptance of these interactions, we integrate them into an AR prototype and conduct a within-subjects study in public scenarios using conventional hand-only interactions as the baseline. The results show that participants preferred our prototype over the baseline, attributing their preference to the interactions being more acceptable, flexible, and practical in public.
- Open Access
- 17 April 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW1) , 1-31
The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model
Image search is an essential and user-friendly method to explore vast galleries of digital images. However, existing image search methods heavily rely on proximity measurements like tag matching or image similarity, requiring precise user inputs for satisfactory results. To meet the growing demand for a contemporary image search engine that enables accurate comprehension of users' search intentions, we introduce an innovative user intent expansion framework. Our framework leverages visual-language models to parse and compose multi-modal user inputs to provide more accurate and satisfying results. It comprises two-stage processes: 1) a parsing stage that incorporates a language parsing module with large language models to enhance the comprehension of textual inputs, along with a visual parsing module that integrates an interactive segmentation module to swiftly identify detailed visual elements within images; and 2) a logic composition stage that combines multiple user search intents into a unified logic expression for more sophisticated operations in complex searching scenarios. Moreover, the intent expansion framework enables users to perform flexible contextualized interactions with the search results to further specify or adjust their detailed search intents iteratively. We implemented the framework into an image search system for NFT (non-fungible token) search and conducted a user study to evaluate its usability and novel properties. The results indicate that the proposed framework significantly improves users' image search experience. Particularly the parsing and contextualized interactions prove useful in allowing users to express their search intents more accurately and engage in a more enjoyable iterative search experience.
- 17 April 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 8 (CSCW1) , 1-31
Open AccessThe Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model
Image search is an essential and user-friendly method to explore vast galleries of digital images. However, existing image search methods heavily rely on proximity measurements like tag matching or image similarity, requiring precise user inputs for satisfactory results. To meet the growing demand for a contemporary image search engine that enables accurate comprehension of users' search intentions, we introduce an innovative user intent expansion framework. Our framework leverages visual-language models to parse and compose multi-modal user inputs to provide more accurate and satisfying results. It comprises two-stage processes: 1) a parsing stage that incorporates a language parsing module with large language models to enhance the comprehension of textual inputs, along with a visual parsing module that integrates an interactive segmentation module to swiftly identify detailed visual elements within images; and 2) a logic composition stage that combines multiple user search intents into a unified logic expression for more sophisticated operations in complex searching scenarios. Moreover, the intent expansion framework enables users to perform flexible contextualized interactions with the search results to further specify or adjust their detailed search intents iteratively. We implemented the framework into an image search system for NFT (non-fungible token) search and conducted a user study to evaluate its usability and novel properties. The results indicate that the proposed framework significantly improves users' image search experience. Particularly the parsing and contextualized interactions prove useful in allowing users to express their search intents more accurately and engage in a more enjoyable iterative search experience.