A Revised Approach to Orthodontic Treatment Monitoring From Oralscan Video
- 26 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 27 (12) , 5827-5836
Abstract
Research on orthodontic treatment monitoring from oralscan video is a new direction in dental digitalization. We designed an approach to reconstruct, segment, and estimate the pose of individual teeth to measure orthodontic treatment. To handle the semantic gap in heterogeneous data on the condition that they are combined linearly, we present a multimedia interaction network (MIN) to combine heterogeneous information in point cloud segmentation by extending the graph attention mechanism. Moreover, a structure-aware quadruple loss is designed to explore the relation between multiple and diverse unmatched points in point cloud registration. The performance of our approach is evaluated on multiple tooth registration datasets, and extensive experiments show that our approach improves the accuracy by a margin of 1.4% in the inlier ratio on the Aoralscan3 dataset when it is compared with prevailing approaches.Keywords
Funding Information
- National Natural Science Foundation of China (61972351)
- National Natural Science Foundation of China (62111530300)
- Zhejiang Province R&D Key Project (2022C03149)
- Special Project for Basic Business Expenses of Zhejiang Provincial Colleges and Universities (JRK22003)
- General Project Funds from the Health Department of Zhejiang Province (2021KY480)
- Opening Foundation of State Key Laboratory of Virtual Reality Technology and System of Beihang University (VRLAB2023B02)
This publication has 45 references indexed in Scilit:
- Joint temporal context exploitation and active learning for video segmentationPattern Recognition, 2020
- Monitoring Biochemical and Structural Changes in Human Periodontal Ligaments during Orthodontic Treatment by Means of Micro-Raman SpectroscopySensors, 2020
- KPConv: Flexible and Deformable Convolution for Point Clouds2019
- Accuracy of a smartphone-based orthodontic treatment–monitoring application: A pilot studyThe Angle Orthodontist, 2019
- Extreme Relative Pose Estimation for RGB-D Scans via Scene Completion2019
- GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud2019
- Traffic Sign Detection Using a Multi-Scale Recurrent Attention NetworkIEEE Transactions on Intelligent Transportation Systems, 2019
- Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models2017
- A scalable active framework for region annotation in 3D shape collectionsACM Transactions on Graphics, 2016
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation2016