Kazuaki Hara
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Kazuaki Hara has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Etsuko Kobayashi
The University of Tokyo
8 shared publications - Ichiro Sakuma
Graduate School of Engineering, The University of Tokyo, Tokyo, Japan
6 shared publications - Qingchuan Ma
Beihang University
4 shared publications - Ken Masamune
Faculty of Advanced Techno-Surgery, Advanced Biomedical Engineering and Science, Tokyo Women’s Medical University, Tokyo, Japan
3 shared publications Hideyuki Suenaga
Department of Oral-Maxillofacial Surgery and Orthodontics, The University of Tokyo Hospital, Tokyo, Japan
2 shared publications- Hideyuki Suenaga
Department of Oral‐Maxillofacial Surgery and Orthodontics The University of Tokyo Hospital Tokyo Japan
2 shared publications
Latest Publications
- 2 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 20624-20635
Surgeon Supervised Autonomous Surgical System for Oral and Maxillofacial Surgery
Oral and maxillofacial surgery (OMS) imposes an increasing workload on even the most experienced surgeons due to long operation time, high skill requirements, limited observation field, constrained workspace, and fast-growing patient population. Robot-assisted OMS is particularly challenging, requiring technological advancements to replicate complex surgical workflows executed by human surgeons and novel working concepts to properly address human-machine relationships. We introduced a Surgeon Supervised Autonomous Surgical System (SSASS) aiming to solve emerging bottlenecks in OMS. SSASS custom develops a deep-learning-assisted virtual planning module, a teeth-based monocular camera navigation module, and a six-degree-of-freedom compact robot module to function as surgeons’ auxiliary brain, eye, and hand, respectively. These three modules are further seamlessly integrated to autonomously complete most labor-intensive procedures, while prioritizing surgeons to supervise and be responsible for the overall procedure. Le Fort I experiments on five human head models demonstrated that the surgical results of SSASS closely matched the preoperative plan, with high drilling accuracy and acceptable cutting accuracy under a fundamentally new and significantly simplified surgical workflow. Compared to its existing OMS counterparts, SSASS integrates the latest technologies such as deep learning, medical 3D printing, markerless navigation, virtual reality, and collaborative robotics, providing a comprehensive surgical solution for encompassing the entire OMS loop. Note to Practitioners—This study was motivated by the increasing needs of automating the surgical procedure of oral and maxillofacial surgery (OMS) to reduce the mismatch between the inadequate number of professional surgeons and the fast-growing patient population. Although more and more surgical hardware and software were introduced into the operating room to assist the surgeon, their workloads are only partially alleviated as surgeons still have to perform many vital procedures manually. This study proposed a Surgeon Supervised Autonomous Surgical System (SSASS) with a significantly simplified workflow for achieving predictable, controllable, and repeatable OMS outcomes. SSASS could avoid many previously necessary analyzing procedures and surgical tools, freeing surgeons from the need to conduct time-consuming manual cephalometric analysis, prefabricate physical surgical models, primary robot programming knowledge or repeatedly program robot trajectory in every surgery, and use physical tracking markers and frequently measure the separated skeleton parts. SSASS introduced a systematical surgical solution aiming to finish most high-workload, tedious, repetitive work while giving the highest priority to surgeons for surveillance. We disclosed key software and hardware information of this system in the manuscript and supplementary materials so that the practitioners could rebuild or improve our current prototype without major difficulties. The experiment results show the high application potential of this system in OMS.
- 2 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 20624-20635
Surgeon Supervised Autonomous Surgical System for Oral and Maxillofacial Surgery
Oral and maxillofacial surgery (OMS) imposes an increasing workload on even the most experienced surgeons due to long operation time, high skill requirements, limited observation field, constrained workspace, and fast-growing patient population. Robot-assisted OMS is particularly challenging, requiring technological advancements to replicate complex surgical workflows executed by human surgeons and novel working concepts to properly address human-machine relationships. We introduced a Surgeon Supervised Autonomous Surgical System (SSASS) aiming to solve emerging bottlenecks in OMS. SSASS custom develops a deep-learning-assisted virtual planning module, a teeth-based monocular camera navigation module, and a six-degree-of-freedom compact robot module to function as surgeons’ auxiliary brain, eye, and hand, respectively. These three modules are further seamlessly integrated to autonomously complete most labor-intensive procedures, while prioritizing surgeons to supervise and be responsible for the overall procedure. Le Fort I experiments on five human head models demonstrated that the surgical results of SSASS closely matched the preoperative plan, with high drilling accuracy and acceptable cutting accuracy under a fundamentally new and significantly simplified surgical workflow. Compared to its existing OMS counterparts, SSASS integrates the latest technologies such as deep learning, medical 3D printing, markerless navigation, virtual reality, and collaborative robotics, providing a comprehensive surgical solution for encompassing the entire OMS loop. Note to Practitioners—This study was motivated by the increasing needs of automating the surgical procedure of oral and maxillofacial surgery (OMS) to reduce the mismatch between the inadequate number of professional surgeons and the fast-growing patient population. Although more and more surgical hardware and software were introduced into the operating room to assist the surgeon, their workloads are only partially alleviated as surgeons still have to perform many vital procedures manually. This study proposed a Surgeon Supervised Autonomous Surgical System (SSASS) with a significantly simplified workflow for achieving predictable, controllable, and repeatable OMS outcomes. SSASS could avoid many previously necessary analyzing procedures and surgical tools, freeing surgeons from the need to conduct time-consuming manual cephalometric analysis, prefabricate physical surgical models, primary robot programming knowledge or repeatedly program robot trajectory in every surgery, and use physical tracking markers and frequently measure the separated skeleton parts. SSASS introduced a systematical surgical solution aiming to finish most high-workload, tedious, repetitive work while giving the highest priority to surgeons for surveillance. We disclosed key software and hardware information of this system in the manuscript and supplementary materials so that the practitioners could rebuild or improve our current prototype without major difficulties. The experiment results show the high application potential of this system in OMS.
- Open Access
- 18 January 2024
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 19 (8) , 1545-1554
Design consideration on integration of mechanical intravascular ultrasound and electromagnetic tracking sensor for intravascular reconstruction
Purpose: Considering vessel deformation, endovascular navigation requires intraoperative geometric information. Mechanical intravascular ultrasound (IVUS) with an electromagnetic (EM) sensor can be used to reconstruct blood vessels with thin diameter. However, the integration design should be evaluated based on the factors affecting the reconstruction error. Methods: The interference between the mechanical IVUS and EM sensor was measured in different relative positions. Two designs of the integrated catheter were evaluated by measuring the reconstruction errors using a rigid vascular phantom. Results: When the distance from the EM sensor to the field generator was 75 mm, the interference from mechanical IVUS to an EM sensor was negligible, with position and rotation errors less than 0.1 mm and 0.6°, respectively. The reconstructed vessel model for proximal IVUS transducer had a smooth surface but an inaccurate shape at large curvature of the vascular phantom. When the distance to the field generator was 175 mm, the error increased significantly. Conclusion: Placing the IVUS transducer on the proximal side of the EM sensor is superior in terms of interference reduction but inferior in terms of mechanical stability compared to a distal transducer. The distal side is preferred due to better mechanical stability during catheter manipulation at larger curvature. With this configuration, surface reconstruction errors less than 1.7 mm (with RMS 0.57 mm) were achieved when the distance to the field generator was less than 175 mm.
- 18 January 2024
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 19 (8) , 1545-1554
Open AccessDesign consideration on integration of mechanical intravascular ultrasound and electromagnetic tracking sensor for intravascular reconstruction
Purpose: Considering vessel deformation, endovascular navigation requires intraoperative geometric information. Mechanical intravascular ultrasound (IVUS) with an electromagnetic (EM) sensor can be used to reconstruct blood vessels with thin diameter. However, the integration design should be evaluated based on the factors affecting the reconstruction error. Methods: The interference between the mechanical IVUS and EM sensor was measured in different relative positions. Two designs of the integrated catheter were evaluated by measuring the reconstruction errors using a rigid vascular phantom. Results: When the distance from the EM sensor to the field generator was 75 mm, the interference from mechanical IVUS to an EM sensor was negligible, with position and rotation errors less than 0.1 mm and 0.6°, respectively. The reconstructed vessel model for proximal IVUS transducer had a smooth surface but an inaccurate shape at large curvature of the vascular phantom. When the distance to the field generator was 175 mm, the error increased significantly. Conclusion: Placing the IVUS transducer on the proximal side of the EM sensor is superior in terms of interference reduction but inferior in terms of mechanical stability compared to a distal transducer. The distal side is preferred due to better mechanical stability during catheter manipulation at larger curvature. With this configuration, surface reconstruction errors less than 1.7 mm (with RMS 0.57 mm) were achieved when the distance to the field generator was less than 175 mm.
- Open Access
- 19 October 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 19 (3) , 571-579
Tissue histology on the correlation between fracture energy and elasticity
Purpose: Preemptively estimating tissue damage is crucial for a safe surgical procedure. We previously investigated the possibility of estimating the fracture energies of biological tissues based on their elasticities. However, the reason behind the presence of these correlations is poorly understood. In this study, we investigate the effect of a tissue’s histology on the correlation between the fracture energy and elasticity. We hypothesize that two tissues with similar fibrous structure will show a similar correlation between the fracture energy and elasticity. Methods: Porcine duodenum were used for this study. Two tensile tests were performed for each porcine duodenum specimen to determine its elasticity and tearing energy. The correlation between fracture energy and elasticity was then investigated using the results from the mechanical tests. Furthermore, duodenum specimens were fixed in 10% formalin while under tension. Microscopic images were then taken to visualize the fibrous structure within the duodenum tissues under tension. Results: The results from the tensile test showed that the fracture energy had an isotropic positive and linear correlation with the elasticity to the negative 0.5th power (R2 = 0.89), which was also previously reported in small intestinal (jejunum) specimens. Furthermore, the tearing patterns of the duodenum were identical to the ones reported in the jejunum. Hematoxylin and eosin staining on tissues fixed under tension showed that the endomysium fibers are involved in providing resistance toward traction. Conclusion: Through mechanical tests, we showed that porcine duodenum tissues also have a correlation between its fracture energy and elasticity. We also discussed that the histological structure of a tissue is an important factor that dictates how the tearing energy of a tissue will correlate to the elasticity. We understood that since the tearing mechanism between the duodenum and jejunum was similar, the correlations between their fracture energies and elasticities were also similar.
- 19 October 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 19 (3) , 571-579
Open AccessTissue histology on the correlation between fracture energy and elasticity
Purpose: Preemptively estimating tissue damage is crucial for a safe surgical procedure. We previously investigated the possibility of estimating the fracture energies of biological tissues based on their elasticities. However, the reason behind the presence of these correlations is poorly understood. In this study, we investigate the effect of a tissue’s histology on the correlation between the fracture energy and elasticity. We hypothesize that two tissues with similar fibrous structure will show a similar correlation between the fracture energy and elasticity. Methods: Porcine duodenum were used for this study. Two tensile tests were performed for each porcine duodenum specimen to determine its elasticity and tearing energy. The correlation between fracture energy and elasticity was then investigated using the results from the mechanical tests. Furthermore, duodenum specimens were fixed in 10% formalin while under tension. Microscopic images were then taken to visualize the fibrous structure within the duodenum tissues under tension. Results: The results from the tensile test showed that the fracture energy had an isotropic positive and linear correlation with the elasticity to the negative 0.5th power (R2 = 0.89), which was also previously reported in small intestinal (jejunum) specimens. Furthermore, the tearing patterns of the duodenum were identical to the ones reported in the jejunum. Hematoxylin and eosin staining on tissues fixed under tension showed that the endomysium fibers are involved in providing resistance toward traction. Conclusion: Through mechanical tests, we showed that porcine duodenum tissues also have a correlation between its fracture energy and elasticity. We also discussed that the histological structure of a tissue is an important factor that dictates how the tearing energy of a tissue will correlate to the elasticity. We understood that since the tearing mechanism between the duodenum and jejunum was similar, the correlations between their fracture energies and elasticities were also similar.
- Open Access
- 17 April 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (6) , 1043-1051
Occlusion-robust scene flow-based tissue deformation recovery incorporating a mesh optimization model
Purpose: Tissue deformation recovery is to reconstruct the change in shape and surface strain caused by tool-tissue interaction or respiration, which is essential for providing motion and shape information that benefits the improvement of the safety of minimally invasive surgery. The binocular vision-based approach is a practical candidate for deformation recovery as no extra devices are required. However, previous methods suffer from limitations such as the reliance on biomechanical priors and the vulnerability to the occlusion caused by surgical instruments. To address the issues, we propose a deformation recovery method incorporating mesh structures and scene flow. Methods: The method can be divided into three modules. The first one is the implementation of the two-step scene flow generation module to extract the 3D motion from the binocular sequence. Second, we propose a strain-based filtering method to denoise the original scene flow. Third, a mesh optimization model is proposed that strengthens the robustness to occlusion by employing contextual connectivity. Results: In a phantom and an in vivo experiment, the feasibility of the method in recovering surface deformation in the presence of tool-induced occlusion was demonstrated. Surface reconstruction accuracy was quantitatively evaluated by comparing the recovered mesh surface with the 3D scanned model in the phantom experiment. Results show that the overall error is 0.70 ± 0.55 mm. Conclusion: The method has been demonstrated to be capable of continuously recovering surface deformation using mesh representation with robustness to the occlusion caused by surgical forceps and promises to be suitable for the application in actual surgery.
- 17 April 2023
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (6) , 1043-1051
Open AccessOcclusion-robust scene flow-based tissue deformation recovery incorporating a mesh optimization model
Purpose: Tissue deformation recovery is to reconstruct the change in shape and surface strain caused by tool-tissue interaction or respiration, which is essential for providing motion and shape information that benefits the improvement of the safety of minimally invasive surgery. The binocular vision-based approach is a practical candidate for deformation recovery as no extra devices are required. However, previous methods suffer from limitations such as the reliance on biomechanical priors and the vulnerability to the occlusion caused by surgical instruments. To address the issues, we propose a deformation recovery method incorporating mesh structures and scene flow. Methods: The method can be divided into three modules. The first one is the implementation of the two-step scene flow generation module to extract the 3D motion from the binocular sequence. Second, we propose a strain-based filtering method to denoise the original scene flow. Third, a mesh optimization model is proposed that strengthens the robustness to occlusion by employing contextual connectivity. Results: In a phantom and an in vivo experiment, the feasibility of the method in recovering surface deformation in the presence of tool-induced occlusion was demonstrated. Surface reconstruction accuracy was quantitatively evaluated by comparing the recovered mesh surface with the 3D scanned model in the phantom experiment. Results show that the overall error is 0.70 ± 0.55 mm. Conclusion: The method has been demonstrated to be capable of continuously recovering surface deformation using mesh representation with robustness to the occlusion caused by surgical forceps and promises to be suitable for the application in actual surgery.
- 1 December 2022
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (3) , 1-8
Tissue damage force estimation in porcine small intestine from its elasticity
- 1 December 2022
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 18 (3) , 1-8
Tissue damage force estimation in porcine small intestine from its elasticity
- 7 February 2022
- Published by Wiley in The International Journal of Medical Robotics and Computer Assisted Surgery
- Vol. 18 (3) , e2379
Machine‐learning‐based approach for predicting postoperative skeletal changes for orthognathic surgical planning
Background: Manually surgical planning becomes an increasing workload of surgeons because of the fast‐growing patient population. This study introduced a machine‐learning‐based approach to assist surgical planning in orthognathic surgery.Methods: Both preoperative and one‐year‐later postoperative computerised tomography images of 56 patients were collected. A 12‐layers cascaded deep neural network structure with two successive models was proposed to yield an end‐to‐end solution, where the first model extracts landmarks from 2D patches of 3D volume and the second model predicts postoperative skeletal changes.Results: The experimental results showed that the model obtained a prediction accuracy of 5.4 mm at the landmark level in 42.9 s. It also represented 74.4% of 3D regions at volume level when compared with the ground truth of human surgeons.Conclusions: This study demonstrated the feasibility of predicting postoperative skeletal changes for orthognathic surgical planning by using machine learning, showing great potential for reducing the workload of surgeons.
- 7 February 2022
- Published by Wiley in The International Journal of Medical Robotics and Computer Assisted Surgery
- Vol. 18 (3) , e2379
Machine‐learning‐based approach for predicting postoperative skeletal changes for orthognathic surgical planning
Background: Manually surgical planning becomes an increasing workload of surgeons because of the fast‐growing patient population. This study introduced a machine‐learning‐based approach to assist surgical planning in orthognathic surgery.Methods: Both preoperative and one‐year‐later postoperative computerised tomography images of 56 patients were collected. A 12‐layers cascaded deep neural network structure with two successive models was proposed to yield an end‐to‐end solution, where the first model extracts landmarks from 2D patches of 3D volume and the second model predicts postoperative skeletal changes.Results: The experimental results showed that the model obtained a prediction accuracy of 5.4 mm at the landmark level in 42.9 s. It also represented 74.4% of 3D regions at volume level when compared with the ground truth of human surgeons.Conclusions: This study demonstrated the feasibility of predicting postoperative skeletal changes for orthognathic surgical planning by using machine learning, showing great potential for reducing the workload of surgeons.
- 6 February 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 25 (2) , 1084-1094
Autonomous Surgical Robot With Camera-Based Markerless Navigation for Oral and Maxillofacial Surgery
- 6 February 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 25 (2) , 1084-1094
Autonomous Surgical Robot With Camera-Based Markerless Navigation for Oral and Maxillofacial Surgery
- 4 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 24 (6) , 2652-2660
Orthognathic Surgical Robot With a Workspace Limitation Mechanism
Impracticable workspaces and cumbersome hardware limit the practical application of the currently available orthognathic surgical robots in a clinical environment. In this study, a compact and lightweight six degree of freedom (DOF) robot with a workspace limitation mechanism (WLM) was developed, and this paper reports on the technical specifications of the robot, as well as the details of the three experiments performed to validate it. This robot can be easily installed by a single individual and is able to mechanically protect important organs from unintended injury. The results show that this robot functionally limits the workspace travel of the osteotomy device by an average overshoot of 0.8 mm, with a drilling and cutting accuracy of 1 mm and 0.5 mm, respectively. This operational accuracy has the potential to be further improved, making this novel robot a potentially precise and safe medical equipment for orthognathic surgery.
- 4 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 24 (6) , 2652-2660
Orthognathic Surgical Robot With a Workspace Limitation Mechanism
Impracticable workspaces and cumbersome hardware limit the practical application of the currently available orthognathic surgical robots in a clinical environment. In this study, a compact and lightweight six degree of freedom (DOF) robot with a workspace limitation mechanism (WLM) was developed, and this paper reports on the technical specifications of the robot, as well as the details of the three experiments performed to validate it. This robot can be easily installed by a single individual and is able to mechanically protect important organs from unintended injury. The results show that this robot functionally limits the workspace travel of the osteotomy device by an average overshoot of 0.8 mm, with a drilling and cutting accuracy of 1 mm and 0.5 mm, respectively. This operational accuracy has the potential to be further improved, making this novel robot a potentially precise and safe medical equipment for orthognathic surgery.