3d freehand ultrasound reconstruction by reference-based point cloud registration
- 7 January 2025
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 20 (3) , 475-484
Abstract
Purpose This study aims to address the challenging estimation of trajectories from freehand ultrasound examinations by means of registration of automatically generated surface points. Current approaches to inter-sweep point cloud registration can be improved by incorporating heatmap predictions, but practical challenges such as label-sparsity or only partially overlapping coverage of target structures arise when applying realistic examination conditions. Methods We propose a pipeline comprising three stages: (1) Utilizing a Free Point Transformer for coarse pre-registration, (2) Introducing HeatReg for further refinement using support point clouds, and (3) Employing instance optimization to enhance predicted displacements. Key techniques include expanding point sets with support points derived from prior knowledge and leverage of gradient keypoints. We evaluate our method on a large set of 42 forearm ultrasound sweeps with optical ground-truth tracking and investigate multiple ablations. Results The proposed pipeline effectively registers free-hand intra-patient ultrasound sweeps. Combining Free Point Transformer with support-point enhanced HeatReg outperforms the FPT baseline by a mean directed surface distance of 0.96 mm (40%). Subsequent refinement using Adam instance optimization and DiVRoC further improves registration accuracy and trajectory estimation. Conclusion The proposed techniques enable and improve the application of point cloud registration as a basis for freehand ultrasound reconstruction. Our results demonstrate significant theoretical and practical advantages of heatmap incorporation and multi-stage model predictions.Keywords
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (13GW0578C)
- Wirtschaftsförderung und Technologietransfer Schleswig-Holstein (22023016)
This publication has 16 references indexed in Scilit:
- Multi-IMU with Online Self-consistency for Freehand 3D Ultrasound Reconstruction2023
- Voxelmorph++2022
- Real-time multimodal image registration with partial intraoperative point-set dataMedical Image Analysis, 2021
- Deep Learning Based Geometric Registration for Medical Images: How Accurate Can We Get Without Visual Features?2021
- nnU-Net: a self-configuring method for deep learning-based biomedical image segmentationNature Methods, 2020
- PointPWC-Net: Cost Volume on Point Clouds for (Self-)Supervised Scene Flow Estimation2020
- Integral Human Pose Regression2018
- 3D freehand ultrasound without external tracking using deep learningMedical Image Analysis, 2018
- Ultrasound registration: A reviewMethods, 2017
- Determination of scan-plane motion using speckle decorrelation: Theoretical considerations and initial testInternational Journal of Imaging Systems and Technology, 1997