Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Shuo Wang has a total of 31 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Validation of the Transformer-Based Monocular System (Capture4D): A Real-Time Kinematic Analysis in Coaching/Teaching Tennis

    by Yue Zhao, Shuo Wang, Zan Gao, Haijun Wu, Yixiong Cui, Yuanlong Liu

    Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focused on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE, and MAE. The results demonstrated that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5 mm to 88.3 mm, within the acceptable range (70–130 mm) for coaching purposes. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered an approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.

  • Open Access

    Validation of the Transformer-Based Monocular System (Capture4D): A Real-time Kinematic Analysis in Coaching/Teaching Tennis

    by Yue Zhao, Shuo Wang, Zan Gao, Haijun Wu, Yixiong Cui, Yuanlong Liu

    Human motion capture is crucial for various fields, but traditional optical systems (OMC) are costly and restrictive. Monocular video-based methods offer accessibility, yet face accuracy challenges, especially in dynamic sports like tennis. This study validates Capture4D, a novel Transformer-based monocular system, for capturing a wide range of tennis strokes. We developed a universal biomechanical analysis framework (K0-K5) applicable to twelve fundamental stroke types. To demonstrate the system’s capabilities, this paper focuses on a detailed validation using the tennis serve as a representative example. We conducted experiments with 9 high-level tennis players, and motion data were simultaneously captured using Capture4D (single RGB camera) and OMC Qualisys (gold standard). Accuracy was evaluated by comparing 3D joint coordinates and joint angles using Normalized Mean Per Joint Position Error (NMPJPE), RMSE and MAE. The results showed that Capture4D effectively captured the tennis player’s motion, with average NMPJPE for tennis serves ranging from 69.5mm to 88.3mm, within the acceptable range (70-130mm) for coaching purpose. Compared to OMC, Capture4D demonstrated comparable joint angle trajectories, with advantages in operational convenience, cost-effectiveness, and wider applicability. It offered approximately 50% reduction in setup time and 80% cost savings. Capture4D presents a valid and practical monocular motion capture solution for coaching tennis and other broader applications in sports. While slightly less precise than OMC, its accuracy is acceptable for many use cases in coaching and teaching. It offers significant advantages in convenience and cost, paving the way for accessible motion analysis in diverse environments like outdoor settings and multi-person scenarios, in which OMC is not possible to be used. This technology holds promise for democratizing motion capture in sports training and coaching/teaching.

  • Personalized Lumbar Vertebrae Modeling for Dynamic Assessment of Idiopathic Scoliosis

    by Chengyin Wang, Jianfeng Li, Shuo Wang, Yuxuan Wang, Jianguo Zhang, Mingjie Dong, Bin Fang, Qianyu Zhuang

    Clinical assessment of idiopathic scoliosis (IS) patients primarily relies on static imaging techniques. Dynamic digital human (DDH) can provide comprehensive spatio-temporal information for dynamic assessment of the deformed spine in IS patients comparing with static imaging techniques, such as X-ray for general assessment and computed tomography (CT) for surgical planning. The lumbar vertebrae exhibit greater morphological variability than the thoracic region when subjected to different postures and mechanical loads, making them particularly important for dynamic assessment. Therefore, a personalized lumbar vertebrae model (PLVM) is proposed in this work to simulate lumbar vertebrae motion for IS patients; furthermore, an individualized DDH (i-DDH) is proposed by embedding PLVM into DDH to capture the spatio-temporal information. First, we use a bone primitive generation method to construct the DDH by incorporating Neural Radiance Fields (NeRF) and three-dimensional (3D) Gaussian splatting methods. Next, we develop the PLVM generation method to simulate lumbar vertebrae motion under different loads and postures. Finally, the bone primitives and PLVM are merged to generate the i-DDH for dynamic assessment. We validated i-DDH using multi-posture radiographs from eight IS patients awaiting surgery. The results demonstrate high accuracy compared to state-of-the-art (SOTA) models, with a mean angular error of $0.96^\circ$ and a maximum error of $3.6^\circ$ relative to radiographs. The proposed i-DDH framework is able to capture the spinal posture and conduct the dynamic assessment of IS patients rather than fixed positions. It overcomes the soft tissue artifact (STA) problem from motion capture systems and the failure to generate 3D spinal deformity of IS patients by training healthy subjects from computer vision methods. It also shows great clinical significance for preoperative planning and clinical assessment by providing dynamic spinal posture that cannot be achieved with static imaging.

  • Adaptive Cardiac Dynamics in Surgical Simulation: A Human–AI Interaction Framework for Robotic Internal Mammary Artery Harvesting

    by Shuo Wang, Tong Ren, Nan Cheng, Rong Wang, Li Zhang

    Virtual surgical simulation offers promising training for complex procedures like robotic internal mammary artery (IMA) harvesting. Building upon previous work on dynamic virtual simulation with haptic feedback, we present an adaptive human-AI interaction (HAI) framework that dynamically adjusts cardiac pulsation parameters based on surgeon behavior analysis. Our system captures surgical tool movements and performance metrics to create personalized training through dynamic difficulty adjustment, context-aware parameter selection, personalized learning paths, and real-time feedback. In a study with three cardiac surgeons across 24 sessions, our adaptive approach showed significant improvements over static simulations: 18% reduction in spatial asymmetry, 22% faster completion, and 48% fewer tissue trauma events. The system demonstrated consistent benefits across different skill levels and sustained learning progression, preventing performance plateaus seen in fixed-difficulty conditions.

  • Open Access

    Dynamic Fractional Flow Reserve from 4D-CTA: A Novel Framework for Non-Invasive Coronary Assessment

    by Shuo Wang, Rong Liu, Li Zhang

    Current fractional flow reserve computed tomography (FFRCT) methods use static imaging, potentially missing critical hemodynamic changes during the cardiac cycle. We developed a novel dynamic FFRCT framework using 4D-CTA data to capture temporal coronary dynamics throughout the complete cardiac cycle. Our automated pipeline integrates 4D-CTA processing, temporally weighted geometric modeling, and patient-specific boundary conditions derived from actual flow measurements. Preliminary validation in three patients (four vessels) showed that dynamic FFRCT values (0.720, 0.797, 0.811, and 0.952) closely matched invasive FFR measurements (0.70, 0.78, 0.78, and 0.94) with improved accuracy compared to conventional static methods. The dynamic approach successfully captured physiologically relevant hemodynamic variations, addressing inter-patient variability limitations of standardized approaches. This study establishes the clinical feasibility of dynamic FFRCT computation, potentially improving non-invasive coronary stenosis assessment for clinical decision-making and treatment planning.

  • Open Access

    Fractional Flow Reserve Computation Using 4D-CTA: A Computational Framework for Temporal Hemodynamic Assessment

    by Shuo Wang, Rong Liu, Li Zhang

    Current fractional flow reserve computed tomography (FFRCT) methods rely on static imaging and standardized boundary conditions, potentially missing critical hemodynamic variations during the cardiac cycle. This study aimed to develop and validate a computational framework for dynamic FFRCT calculation using 4D-CTA data. We implemented an automated pipeline integrating 4D-CTA image processing, patient-specific geometric modeling, and computational fluid dynamics. Dynamic boundary conditions were derived from temporal flow measurements extracted from 4D-CTA data throughout the cardiac cycle. The methodology was validated through proof-of-concept studies on clinical datasets. Results demonstrated successful implementation of the automated 4D-CTA to CFD workflow with computational efficiency suitable for clinical applications. The framework effectively captured temporal hemodynamic variations and successfully computed dynamic FFR values throughout the cardiac cycle. Patient-specific boundary conditions based on actual flow measurements were successfully integrated, potentially addressing inter-patient variability limitations of standardized approaches. This study establishes the technical feasibility of dynamic FFRCT computation using 4D-CTA data. The developed framework may contribute to more physiologically relevant non-invasive coronary stenosis assessment, though further validation studies are needed to evaluate clinical utility and diagnostic accuracy.

  • Open Access

    Patient-Specific Coronary Intervention Simulation Using Tubular Structure Networks and Hybrid Distance Fields

    by Shuo Wang, Tong Ren, Nan Cheng, Rong Wang, Li Zhang

    Percutaneous coronary intervention represents one of the most critical procedures in interventional cardiology. Traditional training methods face limitations including ethical concerns, variable case availability, and radiation exposure risks. This study develops a high-fidelity coronary intervention simulation system based on digital twin technology to balance anatomical accuracy, physical realism, and computational efficiency. Methods: Building upon our previous patient-specific digital-physical twin framework, we introduce three key innovations: (1) a Tubular Structure Network (TSN) representation that models vessels as interconnected geometric primitives with spheres connected by truncated cones, preserving topological and geometric characteristics of vascular structures; (2) a hybrid distance field algorithm combining precomputed signed distance fields with precise geometric calculations for sub-millimeter real-time collision detection; and (3) integration of Cosserat rod theory within a position-based dynamics framework applied to the TSN model for realistic guidewire-vessel interactions. Results: Experimental validation demonstrates sub-millimeter accuracy throughout the cardiac cycle while maintaining real-time performance. The TSN representation effectively constructs complete branching vessel representations from centerline data, accurately capturing radius variations and branching relationships. The hybrid distance field algorithm optimizes computational resources by focusing precision where needed. The Cosserat rod-based simulation accurately captures guidewire mechanical behavior. Conclusion: This integrated approach advances coronary intervention simulation by providing a comprehensive platform balancing anatomical accuracy, physical realism, and computational efficiency. The system has potential to significantly enhance training effectiveness for interventional cardiologists while improving procedural outcomes and patient safety.

  • Open Access

    Patient-Specific Dynamic Digital-Physical Twin for Coronary Intervention Training: An Integrated Mixed Reality Approach

    by Shuo Wang, Tong Ren, Nan Cheng, Rong Wang, Li Zhang

    Background and Objective: Precise preoperative planning and effective physician training for coronary interventions are increasingly important. Despite advances in medical imaging technologies, transforming static or limited dynamic imaging data into comprehensive dynamic cardiac models remains challenging. Existing training systems lack accurate simulation of cardiac physiological dynamics. This study develops a comprehensive dynamic cardiac model research framework based on 4D-CTA, integrating digital twin technology, computer vision, and physical model manufacturing to provide precise, personalized tools for interventional cardiology. Methods: Using 4D-CTA data from a 60-year-old female with three-vessel coronary stenosis, we segmented cardiac chambers and coronary arteries, constructed dynamic models, and implemented skeletal skinning weight computation to simulate vessel deformation across 20 cardiac phases. Transparent vascular physical models were manufactured using medical-grade silicone. We developed cardiac output analysis and virtual angiography systems, implemented guidewire 3D reconstruction using binocular stereo vision, and evaluated the system through angiography validation and CABG training applications. Results: Morphological consistency between virtual and real angiography reached 80.9%. Dice similarity coefficients for guidewire motion ranged from 0.741-0.812, with mean trajectory errors below 1.1 mm. The transparent model demonstrated advantages in CABG training, allowing direct visualization while simulating beating heart challenges. Conclusion: Our patient-specific digital-physical twin approach effectively reproduces both anatomical structures and dynamic characteristics of coronary vasculature, offering a dynamic environment with visual and tactile feedback valuable for education and clinical planning.


  • Open Access

    Dynamic Arthroscopic Navigation System for Anterior Cruciate Ligament Reconstruction Based on Multi-level Memory Architecture

    by Shuo Wang, Weili Shi, Shuai Yang, Jiahao Cui, Qinwei Guo

    This paper presents a dynamic arthroscopic navigation system based on multi-level memory architecture for anterior cruciate ligament (ACL) reconstruction surgery. The system extends our previously proposed markerless navigation method from static image matching to dynamic video sequence tracking. By integrating the Atkinson-Shiffrin memory model's three-level architecture (sensory memory, working memory, and long-term memory), our system maintains continuous tracking of the femoral condyle throughout the surgical procedure, providing stable navigation support even in complex situations involving viewpoint changes, instrument occlusion, and tissue deformation. Unlike existing methods, our system operates in real-time on standard arthroscopic equipment without requiring additional tracking hardware, achieving 25.3 FPS with a latency of only 39.5 ms, representing a 3.5-fold improvement over our previous static system. For extended sequences (1000 frames), the dynamic system maintained an error of 5.3 plus-minus 1.5 pixels, compared to the static system's 12.6 plus-minus 3.7 pixels - an improvement of approximately 45 percent. For medium-length sequences (500 frames) and short sequences (100 frames), the system achieved approximately 35 percent and 19 percent accuracy improvements, respectively. Experimental results demonstrate the system overcomes limitations of traditional static matching methods, providing new technical support for improving surgical precision in ACL reconstruction.

  • Open Access

    Marker-Less Navigation System for Anterior Cruciate Ligament Reconstruction with 3D Femoral Analysis and Arthroscopic Guidance

    by Shuo Wang, Weili Shi, Shuai Yang, Jiahao Cui, Qinwei Guo

    Accurate femoral tunnel positioning is crucial for successful anterior cruciate ligament reconstruction (ACLR), yet traditional arthroscopic techniques face significant challenges in spatial orientation and precise anatomical localization. This study presents a novel marker-less computer-assisted navigation system that integrates three-dimensional femoral modeling with real-time arthroscopic guidance. The system employs advanced image processing techniques for accurate condyle segmentation and implements the Bernard and Hertel (BH) grid system for standardized positioning. A curvature-based feature extraction approach precisely identifies the capsular line reference (CLR) on the lateral condyle surface, forming the foundation for establishing the BH reference grid. The system’s two-stage registration framework, combining SIFT-ICP algorithms, achieves accurate alignment between preoperative models and arthroscopic views. Validation results from expert surgeons demonstrated high precision, with 71.5% of test groups achieving acceptable or excellent performance standards (mean deviation distances: 1.12–1.86 mm). Unlike existing navigation solutions, our system maintains standard surgical workflow without requiring additional surgical instruments or markers, offering an efficient and minimally invasive approach to enhance ACLR precision. This innovation bridges the gap between preoperative planning and intraoperative execution, potentially improving surgical outcomes through standardized tunnel positioning.