Haonan Yao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Haonan Yao has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Lingyun Yu
Xi'an Jiaotong-Liverpool University Suzhou China
5 shared publications - Hai-Ning Liang
Computational Media and Arts thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, Guangdong, China
4 shared publications - Kaiwen Li
Sino-German Institute of Design and Communication, Zhejiang Wanli University, Ningbo, China
3 shared publications - Lixiang Zhao
School of Advanced Technology, Xi'an Jiaotong-Liverpool University, Suzhou, China
3 shared publications - Boyuan Chen
Department of Computing, Xi’an Jiaotong-Liverpool University, Suzhou, China
2 shared publications - Yue Li
Xi'an Jiaotong-Liverpool University, Suzhou, China
2 shared publications
Latest Publications
- Open Access
Enhancing Design Creativity Through Embodied Platforms: An Exploratory Study Comparing Desktop, Mixed Reality, and Virtual Reality in Design Education
Design education places strong emphasis on fostering students’ creativity, and the rapid development of embodied immersive technologies presents new opportunities in this regard. This exploratory study recruits 34 university students with different levels of expertise (17 novices and 17 experienced learners). Each participant completes a 3D conceptual design task using three design platforms with varying levels of embodiment: desktop, Mixed Reality (MR), and Virtual Reality (VR). Data on self-reported sense of embodiment, design creativity, and behavioral patterns are collected and analyzed. The results suggest that the VR platform, which provides the highest level of embodiment, is associated with significantly higher overall creativity as well as six creativity dimensions: fluency, flexibility, elaboration, originality, aesthetics, and requirement fulfillment. In addition, students using the VR platform exhibit more frequent and interconnected transitions between design behaviors, suggesting more exploratory and flexible design processes. No significant interaction is observed between design platform and expertise level in the present sample, suggesting that the effects of platform embodiment are broadly similar for novice and experienced learners. Based on these findings, this study proposes action-based metaphor and contextual consistency as potential explanatory factors that may contribute to creativity enhancement in highly embodied design platforms. Practical implications are discussed from the perspectives of platform design, learner differences, and pedagogical strategies. Overall, this exploratory study provides preliminary empirical evidence for understanding how embodied design platforms may support creativity in immersive design education and offers a foundation for future research.
Open AccessEnhancing Design Creativity Through Embodied Platforms: An Exploratory Study Comparing Desktop, Mixed Reality, and Virtual Reality in Design Education
Design education places strong emphasis on fostering students’ creativity, and the rapid development of embodied immersive technologies presents new opportunities in this regard. This exploratory study recruits 34 university students with different levels of expertise (17 novices and 17 experienced learners). Each participant completes a 3D conceptual design task using three design platforms with varying levels of embodiment: desktop, Mixed Reality (MR), and Virtual Reality (VR). Data on self-reported sense of embodiment, design creativity, and behavioral patterns are collected and analyzed. The results suggest that the VR platform, which provides the highest level of embodiment, is associated with significantly higher overall creativity as well as six creativity dimensions: fluency, flexibility, elaboration, originality, aesthetics, and requirement fulfillment. In addition, students using the VR platform exhibit more frequent and interconnected transitions between design behaviors, suggesting more exploratory and flexible design processes. No significant interaction is observed between design platform and expertise level in the present sample, suggesting that the effects of platform embodiment are broadly similar for novice and experienced learners. Based on these findings, this study proposes action-based metaphor and contextual consistency as potential explanatory factors that may contribute to creativity enhancement in highly embodied design platforms. Practical implications are discussed from the perspectives of platform design, learner differences, and pedagogical strategies. Overall, this exploratory study provides preliminary empirical evidence for understanding how embodied design platforms may support creativity in immersive design education and offers a foundation for future research.
- 10 March 2025
- Published by Springer Nature in Journal of Visualization
- Vol. 28 (3) , 681-697
3DStoryline: immersive visual storytelling
- 10 March 2025
- Published by Springer Nature in Journal of Visualization
- Vol. 28 (3) , 681-697
3DStoryline: immersive visual storytelling
- Open Access
3DStoryline: Immersive Visual Storytelling
Storyline visualization has emerged as an innovative method for illustrating the development and changes in stories across various domains. Traditional approaches typically represent stories with one line per character, progressing from left to right. While effective for simpler narratives, this method faces significant challenges when dealing with complex stories involving multiple characters, as well as temporal and spatial dynamics. In this study, we investigate the potential of immersive environments for enhancing storyline visualizations. We begin by summarizing the key design considerations for effective storyline visualization in virtual reality (VR). Guided by these principles, we develop 3DStoryline, a system that allows users to view and interact with 3D immersive storyline visualizations. To evaluate the effectiveness of 3DStoryline, we conduct a task-based user study, revealing that the system significantly enhances users' comprehension of complex narratives.
Open Access3DStoryline: Immersive Visual Storytelling
Storyline visualization has emerged as an innovative method for illustrating the development and changes in stories across various domains. Traditional approaches typically represent stories with one line per character, progressing from left to right. While effective for simpler narratives, this method faces significant challenges when dealing with complex stories involving multiple characters, as well as temporal and spatial dynamics. In this study, we investigate the potential of immersive environments for enhancing storyline visualizations. We begin by summarizing the key design considerations for effective storyline visualization in virtual reality (VR). Guided by these principles, we develop 3DStoryline, a system that allows users to view and interact with 3D immersive storyline visualizations. To evaluate the effectiveness of 3DStoryline, we conduct a task-based user study, revealing that the system significantly enhances users' comprehension of complex narratives.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Data Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality
Tangible interfaces in mixed reality (MR) environments allow for intuitive data interactions. Tangible cubes, with their rich interaction affordances, high maneuverability, and stable structure, are particularly well-suited for exploring multi-dimensional data types. However, the design potential of these cubes is underexplored. This study introduces a design space for tangible cubes in MR, focusing on interaction space, visualization space, sizes, and multiplicity. Using spatio-temporal data, we explored the interaction affordances of these cubes in a workshop (N=24). We identified unique interactions like rotating, tapping, and stacking, which are linked to augmented reality (AR) visualization commands. Integrating user-identified interactions, we created a design space for tangible-cube interactions and visualization. A prototype visualizing global health spending with small cubes was developed and evaluated, supporting both individual and combined cube manipulation. This research enhances our grasp of tangible interaction in MR, offering insights for future design and application in diverse data contexts.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Open AccessData Cubes in Hand: A Design Space of Tangible Cubes for Visualizing 3D Spatio-Temporal Data in Mixed Reality
Tangible interfaces in mixed reality (MR) environments allow for intuitive data interactions. Tangible cubes, with their rich interaction affordances, high maneuverability, and stable structure, are particularly well-suited for exploring multi-dimensional data types. However, the design potential of these cubes is underexplored. This study introduces a design space for tangible cubes in MR, focusing on interaction space, visualization space, sizes, and multiplicity. Using spatio-temporal data, we explored the interaction affordances of these cubes in a workshop (N=24). We identified unique interactions like rotating, tapping, and stacking, which are linked to augmented reality (AR) visualization commands. Integrating user-identified interactions, we created a design space for tangible-cube interactions and visualization. A prototype visualizing global health spending with small cubes was developed and evaluated, supporting both individual and combined cube manipulation. This research enhances our grasp of tangible interaction in MR, offering insights for future design and application in diverse data contexts.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Exploring Embodied Asymmetric Two-Handed Interactions for Immersive Data Exploration
Embodied interaction plays a crucial role in facilitating effective data exploration within immersive environments, enhancing user experience, understanding, and exploring complex data presented in the virtual space. While embodied two-handed interaction has demonstrated considerable potential, there remains a gap in understanding how varying levels of embodiment impact asymmetric two-hand interactions for immersive data exploration. In this study, we systematically investigate this aspect by combining three settings (direct, indirect, and fixed) on the visualization control hand and two settings (direct, indirect) on the action hand. This combination results in six conditions that span varying levels of embodiment. We compared these conditions under two fundamental visualization tasks, focusing on curve brushing and object manipulation. Our discussion revolves around the use of techniques related to the specific requirements of the tasks, the characteristics of each condition, and users’ experience and expertise in the VR environment. Building upon these discussions, we offer suggestions for designing embodied two-handed interactions for immersive data exploration.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Open AccessExploring Embodied Asymmetric Two-Handed Interactions for Immersive Data Exploration
Embodied interaction plays a crucial role in facilitating effective data exploration within immersive environments, enhancing user experience, understanding, and exploring complex data presented in the virtual space. While embodied two-handed interaction has demonstrated considerable potential, there remains a gap in understanding how varying levels of embodiment impact asymmetric two-hand interactions for immersive data exploration. In this study, we systematically investigate this aspect by combining three settings (direct, indirect, and fixed) on the visualization control hand and two settings (direct, indirect) on the action hand. This combination results in six conditions that span varying levels of embodiment. We compared these conditions under two fundamental visualization tasks, focusing on curve brushing and object manipulation. Our discussion revolves around the use of techniques related to the specific requirements of the tasks, the characteristics of each condition, and users’ experience and expertise in the VR environment. Building upon these discussions, we offer suggestions for designing embodied two-handed interactions for immersive data exploration.