Shuo Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Shuo Wang has a total of 31 co-authors. Here are the top co-authors by number of shared publications:
- Li Zhang
Tsinghua University
8 shared publications - Tong Ren
Department of Adult Cardiac Surgery, Senior Department of Cardiology, The Six Medical Center of PLA General Hospital, Fucheng Road, Haidian District, Beijing 100048, China
6 shared publications - Nan Cheng
Department of Adult Cardiac Surgery, Senior Department of Cardiology, The Six Medical Center of PLA General Hospital, Fucheng Road, Haidian District, Beijing 100048, China
5 shared publications - Rong Wang
Department of Adult Cardiac Surgery, Senior Department of Cardiology, The Six Medical Center of PLA General Hospital, Fucheng Road, Haidian District, Beijing 100048, China
5 shared publications - Jiahao Cui
Beihang University
3 shared publications - Shuai Yang
Department of Sports Medicine Institute of Sports Medicine Peking University Third Hospital Peking University Beijing
3 shared publications
Latest Publications
- Open Access
Validation of the Transformer-Based Monocular System (Capture4D): A Real-Time Kinematic Analysis in Coaching/Teaching Tennis
Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focused on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE, and MAE. The results demonstrated that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5 mm to 88.3 mm, within the acceptable range (70–130 mm) for coaching purposes. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered an approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.
Open AccessValidation of the Transformer-Based Monocular System (Capture4D): A Real-Time Kinematic Analysis in Coaching/Teaching Tennis
Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focused on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE, and MAE. The results demonstrated that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5 mm to 88.3 mm, within the acceptable range (70–130 mm) for coaching purposes. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered an approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.
- Open Access
- 19 December 2025
- Published by MDPI AG in Preprints.org
Validation of the Transformer-Based Monocular System (Capture4D): A Real-time Kinematic Analysis in Coaching/Teaching Tennis
Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focuses on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE and MAE. The results showed that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5mm to 88.3mm, within the acceptable range (70-130mm) for coaching purpose. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.
- 19 December 2025
- Published by MDPI AG in Preprints.org
Open AccessValidation of the Transformer-Based Monocular System (Capture4D): A Real-time Kinematic Analysis in Coaching/Teaching Tennis
Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focuses on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE and MAE. The results showed that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5mm to 88.3mm, within the acceptable range (70-130mm) for coaching purpose. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.
- 19 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 30 (6) , 5064-5074
Personalized Lumbar Vertebrae Modeling for Dynamic Assessment of Idiopathic Scoliosis
Clinical assessment of idiopathic scoliosis (IS) patients primarily relies on static imaging techniques. Dynamic digital human (DDH) can provide comprehensive spatio-temporal information for dynamic assessment of the deformed spine in IS patients comparing with static imaging techniques, such as X-ray for general assessment and computed tomography (CT) for surgical planning. The lumbar vertebrae exhibit greater morphological variability than the thoracic region when subjected to different postures and mechanical loads, making them particularly important for dynamic assessment. Therefore, a personalized lumbar vertebrae model (PLVM) is proposed in this work to simulate lumbar vertebrae motion for IS patients; furthermore, an individualized DDH (i-DDH) is proposed by embedding PLVM into DDH to capture the spatio-temporal information. First, we use a bone primitive generation method to construct the DDH by incorporating Neural Radiance Fields (NeRF) and three-dimensional (3D) Gaussian splatting methods. Next, we develop the PLVM generation method to simulate lumbar vertebrae motion under different loads and postures. Finally, the bone primitives and PLVM are merged to generate the i-DDH for dynamic assessment. We validated i-DDH using multi-posture radiographs from eight IS patients awaiting surgery. The results demonstrate high accuracy compared to state-of-the-art (SOTA) models, with a mean angular error of $0.96^\circ$ and a maximum error of $3.6^\circ$ relative to radiographs. The proposed i-DDH framework is able to capture the spinal posture and conduct the dynamic assessment of IS patients rather than fixed positions. It overcomes the soft tissue artifact (STA) problem from motion capture systems and the failure to generate 3D spinal deformity of IS patients by training healthy subjects from computer vision methods. It also shows great clinical significance for preoperative planning and clinical assessment by providing dynamic spinal posture that cannot be achieved with static imaging.
- 19 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 30 (6) , 5064-5074
Personalized Lumbar Vertebrae Modeling for Dynamic Assessment of Idiopathic Scoliosis
Clinical assessment of idiopathic scoliosis (IS) patients primarily relies on static imaging techniques. Dynamic digital human (DDH) can provide comprehensive spatio-temporal information for dynamic assessment of the deformed spine in IS patients comparing with static imaging techniques, such as X-ray for general assessment and computed tomography (CT) for surgical planning. The lumbar vertebrae exhibit greater morphological variability than the thoracic region when subjected to different postures and mechanical loads, making them particularly important for dynamic assessment. Therefore, a personalized lumbar vertebrae model (PLVM) is proposed in this work to simulate lumbar vertebrae motion for IS patients; furthermore, an individualized DDH (i-DDH) is proposed by embedding PLVM into DDH to capture the spatio-temporal information. First, we use a bone primitive generation method to construct the DDH by incorporating Neural Radiance Fields (NeRF) and three-dimensional (3D) Gaussian splatting methods. Next, we develop the PLVM generation method to simulate lumbar vertebrae motion under different loads and postures. Finally, the bone primitives and PLVM are merged to generate the i-DDH for dynamic assessment. We validated i-DDH using multi-posture radiographs from eight IS patients awaiting surgery. The results demonstrate high accuracy compared to state-of-the-art (SOTA) models, with a mean angular error of $0.96^\circ$ and a maximum error of $3.6^\circ$ relative to radiographs. The proposed i-DDH framework is able to capture the spinal posture and conduct the dynamic assessment of IS patients rather than fixed positions. It overcomes the soft tissue artifact (STA) problem from motion capture systems and the failure to generate 3D spinal deformity of IS patients by training healthy subjects from computer vision methods. It also shows great clinical significance for preoperative planning and clinical assessment by providing dynamic spinal posture that cannot be achieved with static imaging.
- 17 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 46 (1) , 52-65
Adaptive Cardiac Dynamics in Surgical Simulation: A Human–AI Interaction Framework for Robotic Internal Mammary Artery Harvesting
Virtual surgical simulation offers promising training for complex procedures like robotic internal mammary artery (IMA) harvesting. Building upon previous work on dynamic virtual simulation with haptic feedback, we present an adaptive human-AI interaction (HAI) framework that dynamically adjusts cardiac pulsation parameters based on surgeon behavior analysis. Our system captures surgical tool movements and performance metrics to create personalized training through dynamic difficulty adjustment, context-aware parameter selection, personalized learning paths, and real-time feedback. In a study with three cardiac surgeons across 24 sessions, our adaptive approach showed significant improvements over static simulations: 18% reduction in spatial asymmetry, 22% faster completion, and 48% fewer tissue trauma events. The system demonstrated consistent benefits across different skill levels and sustained learning progression, preventing performance plateaus seen in fixed-difficulty conditions.
- 17 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 46 (1) , 52-65
Adaptive Cardiac Dynamics in Surgical Simulation: A Human–AI Interaction Framework for Robotic Internal Mammary Artery Harvesting
Virtual surgical simulation offers promising training for complex procedures like robotic internal mammary artery (IMA) harvesting. Building upon previous work on dynamic virtual simulation with haptic feedback, we present an adaptive human-AI interaction (HAI) framework that dynamically adjusts cardiac pulsation parameters based on surgeon behavior analysis. Our system captures surgical tool movements and performance metrics to create personalized training through dynamic difficulty adjustment, context-aware parameter selection, personalized learning paths, and real-time feedback. In a study with three cardiac surgeons across 24 sessions, our adaptive approach showed significant improvements over static simulations: 18% reduction in spatial asymmetry, 22% faster completion, and 48% fewer tissue trauma events. The system demonstrated consistent benefits across different skill levels and sustained learning progression, preventing performance plateaus seen in fixed-difficulty conditions.
- Open Access
- 24 September 2025
- Published by MDPI AG in Journal of Imaging
- Vol. 11 (10) , 330
Dynamic Fractional Flow Reserve from 4D-CTA: A Novel Framework for Non-Invasive Coronary Assessment
Current fractional flow reserve computed tomography (FFRCT) methods use static imaging, potentially missing critical hemodynamic changes during the cardiac cycle. We developed a novel dynamic FFRCT framework using 4D-CTA data to capture temporal coronary dynamics throughout the complete cardiac cycle. Our automated pipeline integrates 4D-CTA processing, temporally weighted geometric modeling, and patient-specific boundary conditions derived from actual flow measurements. Preliminary validation in three patients (four vessels) showed that dynamic FFRCT values (0.720, 0.797, 0.811, and 0.952) closely matched invasive FFR measurements (0.70, 0.78, 0.78, and 0.94) with improved accuracy compared to conventional static methods. The dynamic approach successfully captured physiologically relevant hemodynamic variations, addressing inter-patient variability limitations of standardized approaches. This study establishes the clinical feasibility of dynamic FFRCT computation, potentially improving non-invasive coronary stenosis assessment for clinical decision-making and treatment planning.
- 24 September 2025
- Published by MDPI AG in Journal of Imaging
- Vol. 11 (10) , 330
Open AccessDynamic Fractional Flow Reserve from 4D-CTA: A Novel Framework for Non-Invasive Coronary Assessment
Current fractional flow reserve computed tomography (FFRCT) methods use static imaging, potentially missing critical hemodynamic changes during the cardiac cycle. We developed a novel dynamic FFRCT framework using 4D-CTA data to capture temporal coronary dynamics throughout the complete cardiac cycle. Our automated pipeline integrates 4D-CTA processing, temporally weighted geometric modeling, and patient-specific boundary conditions derived from actual flow measurements. Preliminary validation in three patients (four vessels) showed that dynamic FFRCT values (0.720, 0.797, 0.811, and 0.952) closely matched invasive FFR measurements (0.70, 0.78, 0.78, and 0.94) with improved accuracy compared to conventional static methods. The dynamic approach successfully captured physiologically relevant hemodynamic variations, addressing inter-patient variability limitations of standardized approaches. This study establishes the clinical feasibility of dynamic FFRCT computation, potentially improving non-invasive coronary stenosis assessment for clinical decision-making and treatment planning.
- Open Access
- 5 August 2025
- Published by MDPI AG in Preprints.org
Fractional Flow Reserve Computation Using 4D-CTA: A Computational Framework for Temporal Hemodynamic Assessment
Current fractional flow reserve computed tomography (FFRCT) methods rely on static imaging and standardized boundary conditions, potentially missing critical hemodynamic variations during the cardiac cycle. This study aimed to develop and validate a computational framework for dynamic FFRCT calculation using 4D-CTA data. We implemented an automated pipeline integrating 4D-CTA image processing, patient-specific geometric modeling, and computational fluid dynamics. Dynamic boundary conditions were derived from temporal flow measurements extracted from 4D-CTA data throughout the cardiac cycle. The methodology was validated through proof-of-concept studies on clinical datasets. Results demonstrated successful implementation of the automated 4D-CTA to CFD workflow with computational efficiency suitable for clinical applications. The framework effectively captured temporal hemodynamic variations and successfully computed dynamic FFR values throughout the cardiac cycle. Patient-specific boundary conditions based on actual flow measurements were successfully integrated, potentially addressing inter-patient variability limitations of standardized approaches. This study establishes the technical feasibility of dynamic FFRCT computation using 4D-CTA data. The developed framework may contribute to more physiologically relevant non-invasive coronary stenosis assessment, though further validation studies are needed to evaluate clinical utility and diagnostic accuracy.
- 5 August 2025
- Published by MDPI AG in Preprints.org
Open AccessFractional Flow Reserve Computation Using 4D-CTA: A Computational Framework for Temporal Hemodynamic Assessment
Current fractional flow reserve computed tomography (FFRCT) methods rely on static imaging and standardized boundary conditions, potentially missing critical hemodynamic variations during the cardiac cycle. This study aimed to develop and validate a computational framework for dynamic FFRCT calculation using 4D-CTA data. We implemented an automated pipeline integrating 4D-CTA image processing, patient-specific geometric modeling, and computational fluid dynamics. Dynamic boundary conditions were derived from temporal flow measurements extracted from 4D-CTA data throughout the cardiac cycle. The methodology was validated through proof-of-concept studies on clinical datasets. Results demonstrated successful implementation of the automated 4D-CTA to CFD workflow with computational efficiency suitable for clinical applications. The framework effectively captured temporal hemodynamic variations and successfully computed dynamic FFR values throughout the cardiac cycle. Patient-specific boundary conditions based on actual flow measurements were successfully integrated, potentially addressing inter-patient variability limitations of standardized approaches. This study establishes the technical feasibility of dynamic FFRCT computation using 4D-CTA data. The developed framework may contribute to more physiologically relevant non-invasive coronary stenosis assessment, though further validation studies are needed to evaluate clinical utility and diagnostic accuracy.
- Open Access
- 10 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Patient-Specific Coronary Intervention Simulation Using Tubular Structure Networks and Hybrid Distance Fields
Percutaneous coronary intervention represents one of the most critical procedures in interventional cardiology. Traditional training methods face limitations including ethical concerns, variable case availability, and radiation exposure risks. This study develops a high-fidelity coronary intervention simulation system based on digital twin technology to balance anatomical accuracy, physical realism, and computational efficiency. Methods: Building upon our previous patient-specific digital-physical twin framework, we introduce three key innovations: (1) a Tubular Structure Network (TSN) representation that models vessels as interconnected geometric primitives with spheres connected by truncated cones, preserving topological and geometric characteristics of vascular structures; (2) a hybrid distance field algorithm combining precomputed signed distance fields with precise geometric calculations for sub-millimeter real-time collision detection; and (3) integration of Cosserat rod theory within a position-based dynamics framework applied to the TSN model for realistic guidewire-vessel interactions. Results: Experimental validation demonstrates sub-millimeter accuracy throughout the cardiac cycle while maintaining real-time performance. The TSN representation effectively constructs complete branching vessel representations from centerline data, accurately capturing radius variations and branching relationships. The hybrid distance field algorithm optimizes computational resources by focusing precision where needed. The Cosserat rod-based simulation accurately captures guidewire mechanical behavior. Conclusion: This integrated approach advances coronary intervention simulation by providing a comprehensive platform balancing anatomical accuracy, physical realism, and computational efficiency. The system has potential to significantly enhance training effectiveness for interventional cardiologists while improving procedural outcomes and patient safety.
- 10 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessPatient-Specific Coronary Intervention Simulation Using Tubular Structure Networks and Hybrid Distance Fields
Percutaneous coronary intervention represents one of the most critical procedures in interventional cardiology. Traditional training methods face limitations including ethical concerns, variable case availability, and radiation exposure risks. This study develops a high-fidelity coronary intervention simulation system based on digital twin technology to balance anatomical accuracy, physical realism, and computational efficiency. Methods: Building upon our previous patient-specific digital-physical twin framework, we introduce three key innovations: (1) a Tubular Structure Network (TSN) representation that models vessels as interconnected geometric primitives with spheres connected by truncated cones, preserving topological and geometric characteristics of vascular structures; (2) a hybrid distance field algorithm combining precomputed signed distance fields with precise geometric calculations for sub-millimeter real-time collision detection; and (3) integration of Cosserat rod theory within a position-based dynamics framework applied to the TSN model for realistic guidewire-vessel interactions. Results: Experimental validation demonstrates sub-millimeter accuracy throughout the cardiac cycle while maintaining real-time performance. The TSN representation effectively constructs complete branching vessel representations from centerline data, accurately capturing radius variations and branching relationships. The hybrid distance field algorithm optimizes computational resources by focusing precision where needed. The Cosserat rod-based simulation accurately captures guidewire mechanical behavior. Conclusion: This integrated approach advances coronary intervention simulation by providing a comprehensive platform balancing anatomical accuracy, physical realism, and computational efficiency. The system has potential to significantly enhance training effectiveness for interventional cardiologists while improving procedural outcomes and patient safety.
- Open Access
Patient-Specific Dynamic Digital-Physical Twin for Coronary Intervention Training: An Integrated Mixed Reality Approach
Background and Objective: Precise preoperative planning and effective physician training for coronary interventions are increasingly important. Despite advances in medical imaging technologies, transforming static or limited dynamic imaging data into comprehensive dynamic cardiac models remains challenging. Existing training systems lack accurate simulation of cardiac physiological dynamics. This study develops a comprehensive dynamic cardiac model research framework based on 4D-CTA, integrating digital twin technology, computer vision, and physical model manufacturing to provide precise, personalized tools for interventional cardiology. Methods: Using 4D-CTA data from a 60-year-old female with three-vessel coronary stenosis, we segmented cardiac chambers and coronary arteries, constructed dynamic models, and implemented skeletal skinning weight computation to simulate vessel deformation across 20 cardiac phases. Transparent vascular physical models were manufactured using medical-grade silicone. We developed cardiac output analysis and virtual angiography systems, implemented guidewire 3D reconstruction using binocular stereo vision, and evaluated the system through angiography validation and CABG training applications. Results: Morphological consistency between virtual and real angiography reached 80.9%. Dice similarity coefficients for guidewire motion ranged from 0.741-0.812, with mean trajectory errors below 1.1 mm. The transparent model demonstrated advantages in CABG training, allowing direct visualization while simulating beating heart challenges. Conclusion: Our patient-specific digital-physical twin approach effectively reproduces both anatomical structures and dynamic characteristics of coronary vasculature, offering a dynamic environment with visual and tactile feedback valuable for education and clinical planning.
Open AccessPatient-Specific Dynamic Digital-Physical Twin for Coronary Intervention Training: An Integrated Mixed Reality Approach
Background and Objective: Precise preoperative planning and effective physician training for coronary interventions are increasingly important. Despite advances in medical imaging technologies, transforming static or limited dynamic imaging data into comprehensive dynamic cardiac models remains challenging. Existing training systems lack accurate simulation of cardiac physiological dynamics. This study develops a comprehensive dynamic cardiac model research framework based on 4D-CTA, integrating digital twin technology, computer vision, and physical model manufacturing to provide precise, personalized tools for interventional cardiology. Methods: Using 4D-CTA data from a 60-year-old female with three-vessel coronary stenosis, we segmented cardiac chambers and coronary arteries, constructed dynamic models, and implemented skeletal skinning weight computation to simulate vessel deformation across 20 cardiac phases. Transparent vascular physical models were manufactured using medical-grade silicone. We developed cardiac output analysis and virtual angiography systems, implemented guidewire 3D reconstruction using binocular stereo vision, and evaluated the system through angiography validation and CABG training applications. Results: Morphological consistency between virtual and real angiography reached 80.9%. Dice similarity coefficients for guidewire motion ranged from 0.741-0.812, with mean trajectory errors below 1.1 mm. The transparent model demonstrated advantages in CABG training, allowing direct visualization while simulating beating heart challenges. Conclusion: Our patient-specific digital-physical twin approach effectively reproduces both anatomical structures and dynamic characteristics of coronary vasculature, offering a dynamic environment with visual and tactile feedback valuable for education and clinical planning.
- Open Access
Dynamic Arthroscopic Navigation System for Anterior Cruciate Ligament Reconstruction Based on Multi-level Memory Architecture
This paper presents a dynamic arthroscopic navigation system based on multi-level memory architecture for anterior cruciate ligament (ACL) reconstruction surgery. The system extends our previously proposed markerless navigation method from static image matching to dynamic video sequence tracking. By integrating the Atkinson-Shiffrin memory model's three-level architecture (sensory memory, working memory, and long-term memory), our system maintains continuous tracking of the femoral condyle throughout the surgical procedure, providing stable navigation support even in complex situations involving viewpoint changes, instrument occlusion, and tissue deformation. Unlike existing methods, our system operates in real-time on standard arthroscopic equipment without requiring additional tracking hardware, achieving 25.3 FPS with a latency of only 39.5 ms, representing a 3.5-fold improvement over our previous static system. For extended sequences (1000 frames), the dynamic system maintained an error of 5.3 plus-minus 1.5 pixels, compared to the static system's 12.6 plus-minus 3.7 pixels - an improvement of approximately 45 percent. For medium-length sequences (500 frames) and short sequences (100 frames), the system achieved approximately 35 percent and 19 percent accuracy improvements, respectively. Experimental results demonstrate the system overcomes limitations of traditional static matching methods, providing new technical support for improving surgical precision in ACL reconstruction.
Open AccessDynamic Arthroscopic Navigation System for Anterior Cruciate Ligament Reconstruction Based on Multi-level Memory Architecture
This paper presents a dynamic arthroscopic navigation system based on multi-level memory architecture for anterior cruciate ligament (ACL) reconstruction surgery. The system extends our previously proposed markerless navigation method from static image matching to dynamic video sequence tracking. By integrating the Atkinson-Shiffrin memory model's three-level architecture (sensory memory, working memory, and long-term memory), our system maintains continuous tracking of the femoral condyle throughout the surgical procedure, providing stable navigation support even in complex situations involving viewpoint changes, instrument occlusion, and tissue deformation. Unlike existing methods, our system operates in real-time on standard arthroscopic equipment without requiring additional tracking hardware, achieving 25.3 FPS with a latency of only 39.5 ms, representing a 3.5-fold improvement over our previous static system. For extended sequences (1000 frames), the dynamic system maintained an error of 5.3 plus-minus 1.5 pixels, compared to the static system's 12.6 plus-minus 3.7 pixels - an improvement of approximately 45 percent. For medium-length sequences (500 frames) and short sequences (100 frames), the system achieved approximately 35 percent and 19 percent accuracy improvements, respectively. Experimental results demonstrate the system overcomes limitations of traditional static matching methods, providing new technical support for improving surgical precision in ACL reconstruction.
- Open Access
- 27 April 2025
- Published by MDPI AG in Bioengineering
- Vol. 12 (5) , 464
Marker-Less Navigation System for Anterior Cruciate Ligament Reconstruction with 3D Femoral Analysis and Arthroscopic Guidance
Accurate femoral tunnel positioning is crucial for successful anterior cruciate ligament reconstruction (ACLR), yet traditional arthroscopic techniques face significant challenges in spatial orientation and precise anatomical localization. This study presents a novel marker-less computer-assisted navigation system that integrates three-dimensional femoral modeling with real-time arthroscopic guidance. The system employs advanced image processing techniques for accurate condyle segmentation and implements the Bernard and Hertel (BH) grid system for standardized positioning. A curvature-based feature extraction approach precisely identifies the capsular line reference (CLR) on the lateral condyle surface, forming the foundation for establishing the BH reference grid. The system’s two-stage registration framework, combining SIFT-ICP algorithms, achieves accurate alignment between preoperative models and arthroscopic views. Validation results from expert surgeons demonstrated high precision, with 71.5% of test groups achieving acceptable or excellent performance standards (mean deviation distances: 1.12–1.86 mm). Unlike existing navigation solutions, our system maintains standard surgical workflow without requiring additional surgical instruments or markers, offering an efficient and minimally invasive approach to enhance ACLR precision. This innovation bridges the gap between preoperative planning and intraoperative execution, potentially improving surgical outcomes through standardized tunnel positioning.
- 27 April 2025
- Published by MDPI AG in Bioengineering
- Vol. 12 (5) , 464
Open AccessMarker-Less Navigation System for Anterior Cruciate Ligament Reconstruction with 3D Femoral Analysis and Arthroscopic Guidance
Accurate femoral tunnel positioning is crucial for successful anterior cruciate ligament reconstruction (ACLR), yet traditional arthroscopic techniques face significant challenges in spatial orientation and precise anatomical localization. This study presents a novel marker-less computer-assisted navigation system that integrates three-dimensional femoral modeling with real-time arthroscopic guidance. The system employs advanced image processing techniques for accurate condyle segmentation and implements the Bernard and Hertel (BH) grid system for standardized positioning. A curvature-based feature extraction approach precisely identifies the capsular line reference (CLR) on the lateral condyle surface, forming the foundation for establishing the BH reference grid. The system’s two-stage registration framework, combining SIFT-ICP algorithms, achieves accurate alignment between preoperative models and arthroscopic views. Validation results from expert surgeons demonstrated high precision, with 71.5% of test groups achieving acceptable or excellent performance standards (mean deviation distances: 1.12–1.86 mm). Unlike existing navigation solutions, our system maintains standard surgical workflow without requiring additional surgical instruments or markers, offering an efficient and minimally invasive approach to enhance ACLR precision. This innovation bridges the gap between preoperative planning and intraoperative execution, potentially improving surgical outcomes through standardized tunnel positioning.