JZJingyuan Zhao

Jingyuan Zhao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Jingyuan Zhao has a total of 9 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Safe Learning by Constraint-Aware Policy Optimization for Robotic Ultrasound Imaging

    by Anqing Duan, Chenguang Yang, Jingyuan Zhao, Shengzeng Huo, Peng Zhou, Wanyu Ma, Yongping Zheng, David Navarro-Alarcon

    Ultrasound-based medical examination usually requires establishing proper contact between an ultrasound probe and a human body that ensures the quality of ultrasound images. The scanning skills are quite challenging for a robot to learn primarily due to the complex coupling between the applied force profile and the resulting ultrasound image quality. While reinforcement learning appears as a powerful tool for learning complex robot skills, the deployment of these algorithms in medical robots demands special attention due to the evident safety concerns that arise from physical probe-tissue interactions. In this paper, we explicitly consider external constraints on the force magnitude when searching for the optimal policy parameters to enhance safety during ultrasound-guided robotic interventions. In particular, we study policy optimization under the framework of a constrained Markov decision process. The resulting gradient-based policy update is then subject to the involved constraints, which can be readily addressed by the primal-dual interior-point technique. In addition, upon the observation that policy update requires consecutive policies to be close to each other to have stable and robust performance with reinforcement learning algorithms, we design the learning rate of policy gradient from an imitation perspective. The performance of the proposed constraint-aware policy optimization method is validated with experiments of robotic ultrasound imaging for spinal diagnosis Note to Practitioners —This paper was motivated by the problem of safely learning the optimal interaction force strategy to facilitate robotic ultrasound imaging. Existing approaches to robotic ultrasound imaging usually empirically set a constant value for the scanning force, despite the fact the force strategy plays an important role in the quality of the ultrasound images. This paper suggests the usage of reinforcement learning to identify the optimal interaction force due to the complex acoustic coupling between the force and the ultrasound image quality. Specifically, we propose constraint-aware reinforcement learning in view of the safety-critical issues as a result of physical human-probe interaction. We then conduct a theoretical analysis of the proposed safe reinforcement learning, including monotonic improvement and policy value bound under mild assumptions. Preliminary real experiments on ultrasound imaging of the spine of a phantom for scoliosis assessment suggest that the proposed approach can safely learn the optimal scanning force without violating the prescribed force threshold. In the future, we would like to apply our approach to learning the optimal scanning force on different organs of interest of human subjects.


  • Ultrasound-Guided Assistive Robots for Scoliosis Assessment With Optimization-Based Control and Variable Impedance

    by Anqing Duan, Maria Victorova, Jingyuan Zhao, Yuxiang Sun, Yongping Zheng, David Navarro-Alarcon

    Assistive robots for healthcare have witnessed a growing demand over the past decades. In this letter, we investigate the development of an optimization-based control framework with variable impedance for an assistive robot to perform ultrasound-guided scoliosis assessment. The conventional procedure for scoliosis assessment using ultrasound imaging typically requires a medical practitioner to slide an ultrasound probe along a patient’s back while maintaining a certain magnitude of the contact force. To automate such a procedure, we need to consider multiple objectives, such as contact force, position, orientation, energy, posture, etc. To coordinate different objectives, we propose to formulate the control framework as a quadratic programming problem with each objective weighted by a tunable task priority, subject to a set of equality and inequality constraints. As the procedure requires the robot to establish a constant contact force with the patient during scanning, we incorporate variable impedance regulation of the end-effector to enhance safety and stability during the physical human-robot interaction; The variable impedance gains are then retrieved by learning from medical expert’s demonstrations. The proposed methodology is evaluated with a robotic system performing autonomous scoliosis assessment with multiple human subjects involved. The effectiveness of our approach is verified by the coronal spinal images obtained with the robot.