Virtual Inspection System for Pumping Stations with Multimodal Feedback
Open Access
Abstract
Pumping stations have undergone significant modernization and digitalization in recent decades. However, traditional virtual inspections often prioritize the visual experience and fail to effectively represent the haptic physical properties of devices during inspections, resulting in poor immersion and interactivity. This paper presents a novel virtual inspection system for pumping stations, incorporating virtual reality interaction and haptic force feedback technology to enhance immersion and realism. The system leverages a 3D model, crafted in 3Ds Max, to provide immersive visualizations. Multimodal feedback is achieved through a combination of haptic force feedback provided by a haptic device and visual information delivered by a VR headset. The system’s data platform integrates with external databases using Unity3D to display relevant information. The system provides immersive 3D visualizations and realistic force feedback during simulated inspections. We compared this system to a traditional virtual inspection method that demonstrated statistically significant improvements in task completion rates and a reduction in failure rates when using the multimodal feedback approach. This innovative approach holds the potential to enhance inspection safety, efficiency, and effectiveness in the pumping station industry.Keywords
Funding Information
- National Natural Science Foundation of China (62103358, ECHEAP017)
- Open Project Program of Engineering Research Center of High-efficiency and Energy-saving Large Axial Flow Pumping Station, Jiangsu Province, Yangzhou University (62103358, ECHEAP017)
This publication has 18 references indexed in Scilit:
- Construction inspection & monitoring with quadruped robots in future human-robot teaming: A preliminary studyJournal of Building Engineering, 2023
- Impact of Virtual Reality-Based Design Review System on User’s Performance and Cognitive Behavior for Building Design Review TasksApplied Sciences, 2022
- The algorithm of stereo vision and shape from shading based on endoscope imagingBiomedical Signal Processing and Control, 2022
- Real-Time Teleoperation of Magnetic Force-Driven Microrobots With 3D Haptic Force Feedback for Micro-Navigation and Micro-TransportationIEEE Robotics and Automation Letters, 2021
- Biomechanical Fidelity of Simulated Pick-and-Place Tasks: Impact of Visual and Haptic RenderingsIEEE Transactions on Haptics, 2021
- Immersive Work Zone Inspection Training using Virtual RealityTransportation Research Record: Journal of the Transportation Research Board, 2020
- Virtual Reality Sickness: A Review of Causes and MeasurementsInternational Journal of Human–Computer Interaction, 2020
- Shape from Shading2020
- Using virtual reality technology for aircraft visual inspection training: presence and comparison studiesApplied Ergonomics, 2002
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002