Richen Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Richen Liu has a total of 79 co-authors. Here are the top co-authors by number of shared publications:
- Xiaoru Yuan
Peking University
6 shared publications - Hanqi Guo
Ohio State University, Columbus, OH, USA
5 shared publications - Siru Chen
Nanjing Normal University, Nanjing, China
5 shared publications Genlin Ji
School of Computer and Electronic Information/School of Artificial Intelligence, Nanjing Normal University , Nanjing, 210023, China
4 shared publicationsLijun Wang
School of Computer and Electronic Information/School of Artificial Intelligence, Nanjing Normal University, Nanjing, China
4 shared publications- Siming Chen
School of Data Science Fudan University Shanghai China
4 shared publications
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Selecting Tangible Media for Immersive Exploration of Volumetric Scientific Data
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Open AccessSelecting Tangible Media for Immersive Exploration of Volumetric Scientific Data
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 6810-6819
Meta-Illustrator: Transferring Illustrations from 2D Interactive Image Space to 3D Immersive Exploration Space
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 6810-6819
Open AccessMeta-Illustrator: Transferring Illustrations from 2D Interactive Image Space to 3D Immersive Exploration Space
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 2603-2612
ScaleTraversal: Creating Multi-Scale Biomedical Animation with Limited Hardware Resources
We design ScaleTraversal, an interactive tool for creating multi-scale 3D demonstration animations with limited resources for users who are unavailable to access high performance machines such as clusters or super computers. It is difficult to create 3D demonstration animations for multi-scale data. First, it is challenging to strike a balance between flexibility and user friendliness to design the user interface in customizing demonstration animations. Second, the multi-scale biomedical data is often characterized as large-size so that it is hard for users to handle it by a desktop PC. We design an interactive bi-functional user interface to create multi-scale biomedical demonstration animations intuitively. It fully utilizes the strengths of graphical interface's user friendliness and textual interface's flexibility, which enables users to customize demonstration animations from macro-scales to meso- and micro-scales. Furthermore, we design three scale-based memory management strategies to solve the issues presented in multi-scale data, including a streaming data processing strategy, a scale-based data prefetching strategy and a GPU acceleration strategy for rendering. Finally, we conduct both quantitative evaluation and qualitative evaluation to demonstrate the efficiency, expressiveness and usability of ScaleTraversal.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 2603-2612
Open AccessScaleTraversal: Creating Multi-Scale Biomedical Animation with Limited Hardware Resources
We design ScaleTraversal, an interactive tool for creating multi-scale 3D demonstration animations with limited resources for users who are unavailable to access high performance machines such as clusters or super computers. It is difficult to create 3D demonstration animations for multi-scale data. First, it is challenging to strike a balance between flexibility and user friendliness to design the user interface in customizing demonstration animations. Second, the multi-scale biomedical data is often characterized as large-size so that it is hard for users to handle it by a desktop PC. We design an interactive bi-functional user interface to create multi-scale biomedical demonstration animations intuitively. It fully utilizes the strengths of graphical interface's user friendliness and textual interface's flexibility, which enables users to customize demonstration animations from macro-scales to meso- and micro-scales. Furthermore, we design three scale-based memory management strategies to solve the issues presented in multi-scale data, including a streaming data processing strategy, a scale-based data prefetching strategy and a GPU acceleration strategy for rendering. Finally, we conduct both quantitative evaluation and qualitative evaluation to demonstrate the efficiency, expressiveness and usability of ScaleTraversal.
- 1 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11  (21) , 34734-34748
Diminished Reality Techniques for Metaverse Applications: A Perspective From Evaluation
The extended reality (XR) is one of the most widely used approaches for accessing the metaverse world. The metaverse and XR aim to blend the virtual and real parts, offering an immersive and interactive experience. Diminished reality (DR) is a subset of XR that specifically addresses the real-time occlusion, removal, and transparency of objects in the environment. As an immersive technology, DR has been utilized in academia and industry to tackle a wide range of engineering problems. However, there is a little investigative work about DR technique evaluations. In this survey, we categorize the state-of-the-art research into two major categories and six subcategories, providing a novel perspective. We further analyze and evaluate the application effects and performance of these approaches from both quantitative and qualitative perspectives, considering the technical performance and user experience of DR techniques. Finally, we provide an overview of potential future directions for DR applications.
- 1 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11  (21) , 34734-34748
Diminished Reality Techniques for Metaverse Applications: A Perspective From Evaluation
The extended reality (XR) is one of the most widely used approaches for accessing the metaverse world. The metaverse and XR aim to blend the virtual and real parts, offering an immersive and interactive experience. Diminished reality (DR) is a subset of XR that specifically addresses the real-time occlusion, removal, and transparency of objects in the environment. As an immersive technology, DR has been utilized in academia and industry to tackle a wide range of engineering problems. However, there is a little investigative work about DR technique evaluations. In this survey, we categorize the state-of-the-art research into two major categories and six subcategories, providing a novel perspective. We further analyze and evaluate the application effects and performance of these approaches from both quantitative and qualitative perspectives, considering the technical performance and user experience of DR techniques. Finally, we provide an overview of potential future directions for DR applications.
- 25 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30  (12) , 7672-7686
DRCmpVis: Visual Comparison of Physical Targets in Mobile Diminished and Mixed Reality
Numerous physical objects in our daily lives are grouped or ranked according to a stereotyped presentation style. For example, in a library, books are typically grouped and ranked based on classification numbers. However, for better comparison, we often need to re-group or re-rank the books using additional attributes such as ratings, publishers, comments, publication years, keywords, prices, etc., or a combination of these factors. In this paper, we propose a novel mobile DR/MR-based application framework named DRCmpVis to achieve in-context multi-attribute comparisons of physical objects with text labels or textual information. The physical objects are scanned in the real world using mobile cameras. All scanned objects are then segmented and labeled by a convolutional neural network and replaced (diminished) by their virtual avatars in a DR environment. We formulate three visual comparison strategies, including filtering, re-grouping, and re-ranking, which can be intuitively, flexibly, and seamlessly performed on their avatars. This approach avoids breaking the original layouts of the physical objects. The computation resources in virtual space can be fully utilized to support efficient object searching and multi-attribute visual comparisons. We demonstrate the usability, expressiveness, and efficiency of DRCmpVis through a user study, NASA TLX assessment, quantitative evaluation, and case studies involving different scenarios.
- 25 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30  (12) , 7672-7686
DRCmpVis: Visual Comparison of Physical Targets in Mobile Diminished and Mixed Reality
Numerous physical objects in our daily lives are grouped or ranked according to a stereotyped presentation style. For example, in a library, books are typically grouped and ranked based on classification numbers. However, for better comparison, we often need to re-group or re-rank the books using additional attributes such as ratings, publishers, comments, publication years, keywords, prices, etc., or a combination of these factors. In this paper, we propose a novel mobile DR/MR-based application framework named DRCmpVis to achieve in-context multi-attribute comparisons of physical objects with text labels or textual information. The physical objects are scanned in the real world using mobile cameras. All scanned objects are then segmented and labeled by a convolutional neural network and replaced (diminished) by their virtual avatars in a DR environment. We formulate three visual comparison strategies, including filtering, re-grouping, and re-ranking, which can be intuitively, flexibly, and seamlessly performed on their avatars. This approach avoids breaking the original layouts of the physical objects. The computation resources in virtual space can be fully utilized to support efficient object searching and multi-attribute visual comparisons. We demonstrate the usability, expressiveness, and efficiency of DRCmpVis through a user study, NASA TLX assessment, quantitative evaluation, and case studies involving different scenarios.
- 13 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 9  (6) , 1726-1737
eBoF: Interactive Temporal Correlation Analysis for Ensemble Data Based on Bag-of-Features
We propose eBoF, a novel time-varying ensemble data visualization approach based on the Bag-of-Features (BoF) model. In the eBoF model, we extract a simple and monotone interval from all target variables of ensemble scalar data as a local feature patch. Each local feature of a semantically simple single interval can be defined as a feature patch within the BoF model, with the duration of each interval (i.e., feature patch) serving as its frequency. Feature clusters in ensemble runs are then identified based on the similarity of temporal correlations. eBoF generates clusters along with their probability distributions across all feature patches while preserving the geo-spatial information, which is often lost in traditional topic modeling or clustering algorithms. The probability distribution across different clusters can help to generate reasonable clustering results, evaluated by domain knowledge. We conduct case studies and performance tests to evaluate the eBoF model and gather feedback from domain experts to further refine it. Evaluation results suggest the proposed eBoF can provide insightful and comprehensive evidence on ensemble simulation data analysis.
- 13 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 9  (6) , 1726-1737
eBoF: Interactive Temporal Correlation Analysis for Ensemble Data Based on Bag-of-Features
We propose eBoF, a novel time-varying ensemble data visualization approach based on the Bag-of-Features (BoF) model. In the eBoF model, we extract a simple and monotone interval from all target variables of ensemble scalar data as a local feature patch. Each local feature of a semantically simple single interval can be defined as a feature patch within the BoF model, with the duration of each interval (i.e., feature patch) serving as its frequency. Feature clusters in ensemble runs are then identified based on the similarity of temporal correlations. eBoF generates clusters along with their probability distributions across all feature patches while preserving the geo-spatial information, which is often lost in traditional topic modeling or clustering algorithms. The probability distribution across different clusters can help to generate reasonable clustering results, evaluated by domain knowledge. We conduct case studies and performance tests to evaluate the eBoF model and gather feedback from domain experts to further refine it. Evaluation results suggest the proposed eBoF can provide insightful and comprehensive evidence on ensemble simulation data analysis.
- Open Access
- 22 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
PMM: A Smart Shopping Guider Based on Mobile AR
Augmented reality (AR) is a burgeoning interaction technology with the ability to provide users with immersive everyday experiences. Shopping is among the most common experiences. When consumers purchase products, they often encounter difficulties in obtaining detailed information relevant to their interests, such as ingredients, origin, and product comparisons, leading to frustration. This situation can be undeniably frustrating. We can use visualization technology [18] to organize it more orderly and friendly. This paper proposes a mobile augmented reality-based application framework, Product Magic Mirror (PMM), which helps to integrate basic visualization design into the application. The augmented information can be rich, e.g. they can be some visualizations and vivid data videos. In the evaluation, we simulated a goods purchase scene, and applied information to the real world by using AR. The real environment and virtual objects were superimposed on the same screen in real time, so as to achieve an experience beyond reality [24]. In our user survey, users rated our tools as a way to make better shopping choices, giving them a positive score for an immersive shopping experience. We predict that displaying information such as instructions, ingredients, and/or user review information next to products could allow consumers to make better consumption choices while reducing decision time and making shopping more immersive.
- 22 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessPMM: A Smart Shopping Guider Based on Mobile AR
Augmented reality (AR) is a burgeoning interaction technology with the ability to provide users with immersive everyday experiences. Shopping is among the most common experiences. When consumers purchase products, they often encounter difficulties in obtaining detailed information relevant to their interests, such as ingredients, origin, and product comparisons, leading to frustration. This situation can be undeniably frustrating. We can use visualization technology [18] to organize it more orderly and friendly. This paper proposes a mobile augmented reality-based application framework, Product Magic Mirror (PMM), which helps to integrate basic visualization design into the application. The augmented information can be rich, e.g. they can be some visualizations and vivid data videos. In the evaluation, we simulated a goods purchase scene, and applied information to the real world by using AR. The real environment and virtual objects were superimposed on the same screen in real time, so as to achieve an experience beyond reality [24]. In our user survey, users rated our tools as a way to make better shopping choices, giving them a positive score for an immersive shopping experience. We predict that displaying information such as instructions, ingredients, and/or user review information next to products could allow consumers to make better consumption choices while reducing decision time and making shopping more immersive.
- Open Access
- 22 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Visual Analytics for Phishing Scam Identification in Blockchain Transactions with Multiple Model Comparison
- 22 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessVisual Analytics for Phishing Scam Identification in Blockchain Transactions with Multiple Model Comparison
- Open Access
- 15 February 2023
- Published by Elsevier in Visual Informatics
- Vol. 7  (2) , 41-53
DTBVis: An interactive visual comparison system for digital twin brain and human brain
- 15 February 2023
- Published by Elsevier in Visual Informatics
- Vol. 7  (2) , 41-53
Open AccessDTBVis: An interactive visual comparison system for digital twin brain and human brain
- 21 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 52  (6) , 1338-1351
Interactive Extended Reality Techniques in Information Visualization
Immersive techniques, such as virtual reality, augmented reality, and mixed reality, take immersive displays as carriers to provide immersive experience. A large number of approaches focus on the visualization of scientific data in immersive environments while just a few methods concentrate on interactive information visualization (InfoVis) in an immersive environment, although InfoVis has been extended to the 3-D space for a long time. In the era of data explosion, the traditional 2-D space is unable to convey large amounts of abstract information in an intuitive way. Meanwhile, desktop-based 3-D InfoVis generally leads to visual conflict and confusion owing to limited display size and field of vision. In this survey, we search for the interactive techniques in immersive InfoVis and summarize their commonalities and discuss their differences and potential trends. The data types of abstract information in InfoVis can be categorized into graph/network data, high-dimensional and multivariate data, time-varying data, and text and document data. Besides, the visual presentation of information in immersive environments is also summarized, especially for charts, plots, and diagrams, which are some basic components of InfoVis techniques. We also described the immersive applications of InfoVis techniques, including the tools or frameworks on immersive analytics and infographics. The discussion about the traditional nonimmersive and the immersive methods in data visualizations show that the latter one has the potential to become an alternative to explore massive information in the future.
- 21 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 52  (6) , 1338-1351
Interactive Extended Reality Techniques in Information Visualization
Immersive techniques, such as virtual reality, augmented reality, and mixed reality, take immersive displays as carriers to provide immersive experience. A large number of approaches focus on the visualization of scientific data in immersive environments while just a few methods concentrate on interactive information visualization (InfoVis) in an immersive environment, although InfoVis has been extended to the 3-D space for a long time. In the era of data explosion, the traditional 2-D space is unable to convey large amounts of abstract information in an intuitive way. Meanwhile, desktop-based 3-D InfoVis generally leads to visual conflict and confusion owing to limited display size and field of vision. In this survey, we search for the interactive techniques in immersive InfoVis and summarize their commonalities and discuss their differences and potential trends. The data types of abstract information in InfoVis can be categorized into graph/network data, high-dimensional and multivariate data, time-varying data, and text and document data. Besides, the visual presentation of information in immersive environments is also summarized, especially for charts, plots, and diagrams, which are some basic components of InfoVis techniques. We also described the immersive applications of InfoVis techniques, including the tools or frameworks on immersive analytics and infographics. The discussion about the traditional nonimmersive and the immersive methods in data visualizations show that the latter one has the potential to become an alternative to explore massive information in the future.