Toward Communication-Efficient Digital Twin via AI-Powered Transmission and Reconstruction
- 6 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Selected Areas in Communications
- Vol. 41 (11) , 3624-3635
Abstract
Digital twin technology has recently gathered pace in engineering communities as it allows for the convergence of the real structure and its digital counterpart. 3D point cloud data is a more effective way to describe the real world and to reconstruct the digital counterpart than the conventional 2D images or 360-degree images. Large-scale, e.g., city-scale digital twins, typically collect point cloud data via internet-of-things (IoT) devices and transmit it over wireless networks. However, the existing wireless transmission technology can not carry real-time point cloud transmission for digital twin reconstruction due to mass data volume, high processing overheads, and low delay-tolerance. We propose a novel artificial intelligence (AI) powered end-to-end framework, termed AIRec, for efficient digital twin communication from point cloud compression, wireless channel coding, and digital twin reconstruction. AIRec adopts the encoder-decoder architecture. In the encoder, a novel importance-aware pooling scheme is designed to adaptively select important points with learnable thresholds to reduce the transmission volume. We also design a novel noise-aware joint source and channel coding is proposed to adaptively adjust the transmission strategy based on SNR and map the features to error-resilient channel symbols for wireless transmission to achieve a good tradeoff between the transmission rate and reconstruction quality. The decoder can accurately reconstruct the digital twins from the received symbols. Extensive experiments of typical datasets and comparison with baselines show that we achieve a good reconstruction quality under 24× compression ratio.Keywords
Funding Information
- Cultivation of Shenzhen Excellent Technological and Innovative Talents (RCBS20200714114943014)
- Basic Research of Shenzhen Science and Technology Plan (JCYJ20210324123802006)
- Fundamental Research Funds for the Central Universities (x2wjD2230230)
This publication has 38 references indexed in Scilit:
- Automatic generation of structural geometric digital twins from point cloudsScientific Reports, 2022
- Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Control2022
- From LiDAR point cloud towards digital twin city: Clustering city objects based on Gestalt principlesISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Towards simulation-based verification of autonomous navigation systemsSafety Science, 2020
- Cognition Digital Twins for Personalized Information Systems of Smart Cities: Proof of ConceptJournal of Management in Engineering, 2020
- Photogrammetric Point Cloud Segmentation and Object Information Extraction for Creating Virtual Environments and SimulationsJournal of Management in Engineering, 2020
- The Digital Twin of the City of Zurich for Urban PlanningPFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 2020
- Frustum PointNets for 3D Object Detection from RGB-D Data2018
- A Point Set Generation Network for 3D Object Reconstruction from a Single Image2017
- The internet of things: a surveyInformation Systems Frontiers, 2014