Drone-based AI and 3D Reconstruction for Digital Twin Augmentation
Preprint
Abstract
Digital Twin is an emerging technology at the forefront of Industry 4.0, with the ultimate goal of combining the physical space and the virtual space. To date, the Digital Twin concept has been applied in many engineering fields, providing useful insights in the areas of engineering design, manufacturing, automation, and construction industry. While the nexus of various technologies opens up new opportunities with Digital Twin, the technology requires a framework to integrate the different technologies, such as the Building Information Model used in the Building and Construction industry. In this work, an Information Fusion framework is proposed to seamlessly fuse heterogeneous components in a Digital Twin framework from the variety of technologies involved. This study aims to augment Digital Twin in buildings with the use of AI and 3D reconstruction empowered by unmanned aviation vehicles. We proposed a drone-based Digital Twin augmentation framework with reusable and customisable components. A proof of concept is also developed, and extensive evaluation is conducted for 3D reconstruction and applications of AI for defect detection.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Disaster City Digital Twin: A vision for integrating artificial and human intelligence for disaster managementInternational Journal of Information Management, 2021
- Large wood (LW) 3D accumulation mapping and assessment using structure from Motion photogrammetry in the laboratoryJournal of Hydrology, 2020
- The Convergence of Digital Twin, IoT, and Machine Learning: Transforming Data into Action2019
- SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networksData in Brief, 2018
- RTAB‐Map as an open‐source lidar and visual simultaneous localization and mapping library for large‐scale and long‐term online operationJournal of Field Robotics, 2018
- Digital twin-driven product design, manufacturing and service with big dataThe International Journal of Advanced Manufacturing Technology, 2017
- Large-scale, real-time 3D scene reconstruction on a mobile deviceAutonomous Robots, 2017
- Building Information Modeling (BIM) and Safety: Automatic Safety Checking of Construction Models and SchedulesAutomation in Construction, 2013
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography1987