Kohei Shimasaki
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Kohei Shimasaki has a total of 67 co-authors. Here are the top co-authors by number of shared publications:
- Idaku Ishii
Hiroshima University
39 shared publications - Feiyue Wang
Hiroshima University
18 shared publications - Shaopeng Hu
Hiroshima University
18 shared publications - Taku Senoo
Graduate School of Information Science and Technology, Hokkaido University, Kita 14, Nishi 9, Kita-ku, Sapporo, Hokkaido 060-0814, Japan
7 shared publications - Mingjun Jiang
Hiroshima University
6 shared publications - Hongyu Dong
Smart Robotics Lab., Graduate School of Advanced Science and Engineering, Hiroshima University, 1-4-1 Kagamiyama, Higashi-hiroshima, Hiroshima 739-8527, Japan
3 shared publications
Latest Publications
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (10) , 11625-11632
A High-Speed Variable-Focus Imaging System Based on Ultrafast Angular Modulation of Mirrors
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (10) , 11625-11632
A High-Speed Variable-Focus Imaging System Based on Ultrafast Angular Modulation of Mirrors
- Open Access
Multi-Frame Temporal Integration for 3-D Shape Measurement of Freely Falling Small Objects Using a High-Speed Camera Array
Dynamic three-dimensional (3-D) reconstruction of small objects moving at high speed is fundamentally limited by the number of viewpoints that a fixed camera array can provide at any single time instant. When the camera count is insufficient, single-frame multi-view stereo produces incomplete or inaccurate geometry. This paper proposes a multi-frame temporal integration approach that overcomes this limitation by exploiting the rigid-body assumption: because a falling object maintains its shape across consecutive frames, images captured at different time instants can be combined into a single, viewpoint-enriched reconstruction. A three-layer circular array of 32 synchronized RGB cameras captures 1440 × 1080 images at 160 fps, and a free-fall-oriented algorithm automatically detects active frames, selects informative temporal windows, and feeds the accumulated multi-frame images into a structure-from-motion and multi-view stereo (SfM-MVS) pipeline, effectively multiplying the number of viewpoints without additional hardware. The algorithm simultaneously recovers the 6-DOF pose trajectory of each object from the SfM-estimated camera parameters. Progressive accumulation experiments on freely falling soybeans (approximately 9–10 mm diameter) show that a single 32-camera frame already achieves an F-score exceeding 0.97 at a 0.5 mm threshold against an industrial structured-light scanner reference, and that accumulating additional temporal frames reaches a stable convergence plateau with both objects reaching a plateau F-score of 0.984. Beyond approximately one to two accumulated frames, additional frames yield diminishing returns, confirming that a small number of temporal frames is sufficient for convergent sub-millimeter accuracy. Across 30 independent free-fall trials with three objects, the system achieves an overall mean error of mm and an overall F-score of —a mean relative error of approximately 1.6% on 8–10 mm targets—and fine surface features such as structural cracks are resolved at a fidelity sufficient for visual defect identification. These results establish rigid-body multi-frame temporal integration as an effective strategy for high-throughput, non-contact 3-D inspection of small objects in motion.Open AccessMulti-Frame Temporal Integration for 3-D Shape Measurement of Freely Falling Small Objects Using a High-Speed Camera Array
Dynamic three-dimensional (3-D) reconstruction of small objects moving at high speed is fundamentally limited by the number of viewpoints that a fixed camera array can provide at any single time instant. When the camera count is insufficient, single-frame multi-view stereo produces incomplete or inaccurate geometry. This paper proposes a multi-frame temporal integration approach that overcomes this limitation by exploiting the rigid-body assumption: because a falling object maintains its shape across consecutive frames, images captured at different time instants can be combined into a single, viewpoint-enriched reconstruction. A three-layer circular array of 32 synchronized RGB cameras captures 1440 × 1080 images at 160 fps, and a free-fall-oriented algorithm automatically detects active frames, selects informative temporal windows, and feeds the accumulated multi-frame images into a structure-from-motion and multi-view stereo (SfM-MVS) pipeline, effectively multiplying the number of viewpoints without additional hardware. The algorithm simultaneously recovers the 6-DOF pose trajectory of each object from the SfM-estimated camera parameters. Progressive accumulation experiments on freely falling soybeans (approximately 9–10 mm diameter) show that a single 32-camera frame already achieves an F-score exceeding 0.97 at a 0.5 mm threshold against an industrial structured-light scanner reference, and that accumulating additional temporal frames reaches a stable convergence plateau with both objects reaching a plateau F-score of 0.984. Beyond approximately one to two accumulated frames, additional frames yield diminishing returns, confirming that a small number of temporal frames is sufficient for convergent sub-millimeter accuracy. Across 30 independent free-fall trials with three objects, the system achieves an overall mean error of mm and an overall F-score of —a mean relative error of approximately 1.6% on 8–10 mm targets—and fine surface features such as structural cracks are resolved at a fidelity sufficient for visual defect identification. These results establish rigid-body multi-frame temporal integration as an effective strategy for high-throughput, non-contact 3-D inspection of small objects in motion. - Open Access
- 2 December 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (23) , 12771
High-Frame-Rate Camera-Based Vibration Analysis for Health Monitoring of Industrial Robots Across Multiple Postures
Accurate vibration measurement is crucial for maintaining the performance, reliability, and safety of automated manufacturing environments. Abnormal vibrations caused by faults in gears or bearings can degrade positional accuracy, reduce productivity, and, over time, significantly impair production efficiency and product quality. Such vibrations may also disrupt supply chains, cause financial losses, and pose safety risks to workers through collisions, falling objects, or other operational hazards. Conventional vibration measurement techniques, such as wired accelerometers and strain gauges, are typically limited to a few discrete measurement points. Achieving multi-point measurements requires numerous sensors, which increases installation complexity, wiring constraints, and setup time, making the process both time-consuming and costly. The integration of high-frame-rate (HFR) cameras with Digital Image Correlation (DIC) enables non-contact, multi-point, full-field vibration measurement of robot manipulators, effectively addressing these limitations. In this study, HFR cameras were employed to perform non-contact, full-field vibration measurements of industrial robots. The HFR camera recorded the robot’s vibrations at 1000 frames per second (fps), and the resulting video was decomposed into individual frames according to the frame rate. Each frame, with a resolution of 1920 × 1080 pixels, was divided into 128 × 128 pixel blocks with a 64-pixel stride, yielding 435 sub-images. This setup effectively simulates the operation of 435 virtual vibration sensors. By applying mask processing to these sub-images, eight key points representing critical robot components were selected for multi-point DIC displacement measurements, enabling effective assessment of vibration distribution and real-time vibration visualization across the entire manipulator. This approach allows simultaneous capture of displacements across all robot components without the need for physical sensors. The transfer function is defined in the frequency domain as the ratio between the output displacement of each robot component and the input excitation applied by the shaker mounted on the end-effector. The frequency–domain transfer functions were computed for multiple robot components, enabling accurate and full-field vibration analysis during operation.
- 2 December 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (23) , 12771
Open AccessHigh-Frame-Rate Camera-Based Vibration Analysis for Health Monitoring of Industrial Robots Across Multiple Postures
Accurate vibration measurement is crucial for maintaining the performance, reliability, and safety of automated manufacturing environments. Abnormal vibrations caused by faults in gears or bearings can degrade positional accuracy, reduce productivity, and, over time, significantly impair production efficiency and product quality. Such vibrations may also disrupt supply chains, cause financial losses, and pose safety risks to workers through collisions, falling objects, or other operational hazards. Conventional vibration measurement techniques, such as wired accelerometers and strain gauges, are typically limited to a few discrete measurement points. Achieving multi-point measurements requires numerous sensors, which increases installation complexity, wiring constraints, and setup time, making the process both time-consuming and costly. The integration of high-frame-rate (HFR) cameras with Digital Image Correlation (DIC) enables non-contact, multi-point, full-field vibration measurement of robot manipulators, effectively addressing these limitations. In this study, HFR cameras were employed to perform non-contact, full-field vibration measurements of industrial robots. The HFR camera recorded the robot’s vibrations at 1000 frames per second (fps), and the resulting video was decomposed into individual frames according to the frame rate. Each frame, with a resolution of 1920 × 1080 pixels, was divided into 128 × 128 pixel blocks with a 64-pixel stride, yielding 435 sub-images. This setup effectively simulates the operation of 435 virtual vibration sensors. By applying mask processing to these sub-images, eight key points representing critical robot components were selected for multi-point DIC displacement measurements, enabling effective assessment of vibration distribution and real-time vibration visualization across the entire manipulator. This approach allows simultaneous capture of displacements across all robot components without the need for physical sensors. The transfer function is defined in the frequency domain as the ratio between the output displacement of each robot component and the input excitation applied by the shaker mounted on the end-effector. The frequency–domain transfer functions were computed for multiple robot components, enabling accurate and full-field vibration analysis during operation.
- Open Access
- 20 October 2025
- Published by Fuji Technology Press Ltd. in Journal of Robotics and Mechatronics
- Vol. 37 (5) , 1205-1218
HFR-Video-Based Vibration Analysis of a Multi-Jointed Robot Manipulator
As the demand for industrial robots continues to increase, monitoring robot manipulators in factory environments has become essential to ensure proper and precise operation. Unexpected vibrations can reduce the production efficiency and quality, causing financial losses, and safety risks to workers. Evaluating a robot’s vibration resistance solely through arm movements makes it challenging to accurately capture fine vibration-frequency responses using conventional methods. Traditional analyses rely on contact sensors, which are limited by the number of measurable points, and often involve high costs. In this study, we employed high-frame-rate (HFR) cameras for non-contact vibration analysis, enabling a detailed evaluation of the vibration characteristics during robot operation. By processing the 500 fps HFR video using digital image correlation, we analyzed the frequency responses of sub-pixel displacements at multiple locations and quantified changes in the vibration amplitude and phase across different parts of the robot. This approach provides a more precise understanding of fine vibration distributions and their impacts. The proposed method is accurate and can simultaneously measure multiple points.
- 20 October 2025
- Published by Fuji Technology Press Ltd. in Journal of Robotics and Mechatronics
- Vol. 37 (5) , 1205-1218
Open AccessHFR-Video-Based Vibration Analysis of a Multi-Jointed Robot Manipulator
As the demand for industrial robots continues to increase, monitoring robot manipulators in factory environments has become essential to ensure proper and precise operation. Unexpected vibrations can reduce the production efficiency and quality, causing financial losses, and safety risks to workers. Evaluating a robot’s vibration resistance solely through arm movements makes it challenging to accurately capture fine vibration-frequency responses using conventional methods. Traditional analyses rely on contact sensors, which are limited by the number of measurable points, and often involve high costs. In this study, we employed high-frame-rate (HFR) cameras for non-contact vibration analysis, enabling a detailed evaluation of the vibration characteristics during robot operation. By processing the 500 fps HFR video using digital image correlation, we analyzed the frequency responses of sub-pixel displacements at multiple locations and quantified changes in the vibration amplitude and phase across different parts of the robot. This approach provides a more precise understanding of fine vibration distributions and their impacts. The proposed method is accurate and can simultaneously measure multiple points.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Distant Mid-Air Interaction via Accurate Gaze and Hand Posture Estimation with an Ultrafast Pan-Tilt Camera
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessDistant Mid-Air Interaction via Accurate Gaze and Hand Posture Estimation with an Ultrafast Pan-Tilt Camera
- Open Access
Multi-Camera 3D Digital Image Correlation with Pointwise-Optimized Model-Based Stereo Pairing
Dynamic deformation measurement (DDM) is critical across infrastructure and industrial applications. Among various advanced techniques, multi-camera digital image correlation (MC-DIC) stands out due to its ability to achieve wide-range, full-field, and non-contact 3D DDM by pairing camera subsystems. However, existing MC-DIC methods typically rely on inefficient manual pairing or a simplistic strategy that aggregates all visible cameras for measuring specific object regions, leading to camera over-grouping. These limitations often result in cumbersome system setup and ill-measured deformations. To overcome these challenges, we propose a novel MC-DIC method with pointwise-optimized model-based stereo pairing (MPMC-DIC). By automatically evaluating and selecting camera pairs based on five evaluation factors derived from 3D model and calibrated cameras, the proposed method overcomes the over-grouping problem and achieves high-precision DDM of semi-rigid objects. A Ø5 × 5 cm cylinder experiment demonstrated an accuracy of 0.03 mm for both horizontal and depth displacements in the 0.0–5.0 mm range, and validated strong robustness against cluttered backgrounds using a 2 × 4 camera array. Vibration measurement of a 9 × 15 × 16 cm PC speaker operating at 50 Hz, using eight surrounding cameras capturing 1920 × 1080 images at 400 fps, confirmed the proposed method’s capability to perform wide-range dynamic deformation analysis and its robustness against complex object geometries.
Open AccessMulti-Camera 3D Digital Image Correlation with Pointwise-Optimized Model-Based Stereo Pairing
Dynamic deformation measurement (DDM) is critical across infrastructure and industrial applications. Among various advanced techniques, multi-camera digital image correlation (MC-DIC) stands out due to its ability to achieve wide-range, full-field, and non-contact 3D DDM by pairing camera subsystems. However, existing MC-DIC methods typically rely on inefficient manual pairing or a simplistic strategy that aggregates all visible cameras for measuring specific object regions, leading to camera over-grouping. These limitations often result in cumbersome system setup and ill-measured deformations. To overcome these challenges, we propose a novel MC-DIC method with pointwise-optimized model-based stereo pairing (MPMC-DIC). By automatically evaluating and selecting camera pairs based on five evaluation factors derived from 3D model and calibrated cameras, the proposed method overcomes the over-grouping problem and achieves high-precision DDM of semi-rigid objects. A Ø5 × 5 cm cylinder experiment demonstrated an accuracy of 0.03 mm for both horizontal and depth displacements in the 0.0–5.0 mm range, and validated strong robustness against cluttered backgrounds using a 2 × 4 camera array. Vibration measurement of a 9 × 15 × 16 cm PC speaker operating at 50 Hz, using eight surrounding cameras capturing 1920 × 1080 images at 400 fps, confirmed the proposed method’s capability to perform wide-range dynamic deformation analysis and its robustness against complex object geometries.
- 10 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 9 (10) , 1-4
Cattle Trembling Detection Using HFR-Video-Based DIC Analysis
This study proposes a high-frame-rate (HFR) video analysis method that functions as a software-based vibration sensor to estimate when, where, and which body parts of cattle exhibit trembling by detecting tens-of-Hertz frequency components. The proposed sensor estimates velocities at multiple points on the cattle with subpixel precision using HFR-video-based digital image correlation, which is combined with a convolutional neural network-based object detection method to update segmented regions in each frame, even when multiple cattle are moving. We validated our proposed method using 1920 × 1080 video captured at 125 fps for multiple juvenile cattle in an indoor barn, demonstrating that the software-based vibration sensor can detect and visualize short-term trembling behavior with frequencies of 10–14 Hz.
- 10 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 9 (10) , 1-4
Cattle Trembling Detection Using HFR-Video-Based DIC Analysis
This study proposes a high-frame-rate (HFR) video analysis method that functions as a software-based vibration sensor to estimate when, where, and which body parts of cattle exhibit trembling by detecting tens-of-Hertz frequency components. The proposed sensor estimates velocities at multiple points on the cattle with subpixel precision using HFR-video-based digital image correlation, which is combined with a convolutional neural network-based object detection method to update segmented regions in each frame, even when multiple cattle are moving. We validated our proposed method using 1920 × 1080 video captured at 125 fps for multiple juvenile cattle in an indoor barn, demonstrating that the software-based vibration sensor can detect and visualize short-term trembling behavior with frequencies of 10–14 Hz.
- Open Access
- 10 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 159028-159036
Model-Tracking-Based 3D Vibration Distribution Measurement of a Hovering Multicopter Using Stereo HFR Cameras
A comprehensive understanding of structural vibration distributions during multicopter flight, along with their correlation with flight trajectory and operational status, which are influenced by load conditions, battery levels, and weather variations, is crucial for ensuring flight safety. However, discrete sensors such as accelerometers and strain gauges face limitations in observing vibration distributions in multicopters due to restricted attachment points and their potential impact on flight performance. To address these challenges, we propose a model-tracking-based 3D vibration measurement method for flying multicopters using ground-installed stereo high-frame-rate (HFR) cameras, avoiding the need for onboard sensor installation. Our method utilizes digital image correlation (DIC) on stereo HFR images to achieve precise 3D vibration displacement measurements in the audio frequency range, leveraging thousands of tracked measurement points on a 3D multicopter model for whole-body vibration analysis. To validate our model-tracking method, we analyze stereo $1920\times 1080$ images at 500 fps in the frequency domain, capturing a hovering multicopter with four rotors rotating at hundreds of rps. Along with estimating its 6-DoF trajectory and rotor rotation speeds as operational status indicators, the 3D vibration distribution at 3518 tracked points was visualized by referencing a pre-measured 3D model of the multicopter, including 3D frequency component images at peak frequencies ranging from 0 to 250 Hz, which correspond to structural properties, control errors, and rotor-induced forced vibrations.
- 10 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 159028-159036
Open AccessModel-Tracking-Based 3D Vibration Distribution Measurement of a Hovering Multicopter Using Stereo HFR Cameras
A comprehensive understanding of structural vibration distributions during multicopter flight, along with their correlation with flight trajectory and operational status, which are influenced by load conditions, battery levels, and weather variations, is crucial for ensuring flight safety. However, discrete sensors such as accelerometers and strain gauges face limitations in observing vibration distributions in multicopters due to restricted attachment points and their potential impact on flight performance. To address these challenges, we propose a model-tracking-based 3D vibration measurement method for flying multicopters using ground-installed stereo high-frame-rate (HFR) cameras, avoiding the need for onboard sensor installation. Our method utilizes digital image correlation (DIC) on stereo HFR images to achieve precise 3D vibration displacement measurements in the audio frequency range, leveraging thousands of tracked measurement points on a 3D multicopter model for whole-body vibration analysis. To validate our model-tracking method, we analyze stereo $1920\times 1080$ images at 500 fps in the frequency domain, capturing a hovering multicopter with four rotors rotating at hundreds of rps. Along with estimating its 6-DoF trajectory and rotor rotation speeds as operational status indicators, the 3D vibration distribution at 3518 tracked points was visualized by referencing a pre-measured 3D model of the multicopter, including 3D frequency component images at peak frequencies ranging from 0 to 250 Hz, which correspond to structural properties, control errors, and rotor-induced forced vibrations.
- Open Access
- 1 September 2025
- Published by Iron and Steel Institute of Japan in Tetsu-to-Hagane
- Vol. 111 (13) , 825-835
Panoramic Thermal Imaging Using a Mirror-drive Infrared Active Camera
Fire and explosion accidents with equipment troubles directly lead to long-term shutdowns and labor accidents related to human lives in ironworks. Panoramic thermal monitoring that can synthesize multiple thermal images at different viewpoints is strongly demanded for wide-area infrastructures such as material yards. In this study, we develop a mirror-drive pan-tilt telephoto infrared camera that enables quick viewpoint switching to different directions without moving its heavy camera body and realize to capture a panoramic thermal image of 8320×4320 pixels in the view angle of 93×46 degrees by stitching 117 thermal images at intervals of 24 s in the fastest case. We demonstrate its effectiveness by verifying panoramic thermal images for material yards in ironworks and superimpose the panoramic thermal images on their 3D point cloud data toward digital-twin-based thermal monitoring.
- 1 September 2025
- Published by Iron and Steel Institute of Japan in Tetsu-to-Hagane
- Vol. 111 (13) , 825-835
Open AccessPanoramic Thermal Imaging Using a Mirror-drive Infrared Active Camera
Fire and explosion accidents with equipment troubles directly lead to long-term shutdowns and labor accidents related to human lives in ironworks. Panoramic thermal monitoring that can synthesize multiple thermal images at different viewpoints is strongly demanded for wide-area infrastructures such as material yards. In this study, we develop a mirror-drive pan-tilt telephoto infrared camera that enables quick viewpoint switching to different directions without moving its heavy camera body and realize to capture a panoramic thermal image of 8320×4320 pixels in the view angle of 93×46 degrees by stitching 117 thermal images at intervals of 24 s in the fastest case. We demonstrate its effectiveness by verifying panoramic thermal images for material yards in ironworks and superimpose the panoramic thermal images on their 3D point cloud data toward digital-twin-based thermal monitoring.
- Open Access
- 20 August 2025
- Published by Fuji Technology Press Ltd. in Journal of Robotics and Mechatronics
- Vol. 37 (4) , 852-863
Real-Time Multi-Viewpoint Object Detection for High-Speed Omnidirectional Scanning Shooting System
Obtaining object-detection results through multi-viewpoint systems is a promising approach for gathering the surrounding information for mobile robots. In this study, we realized a low delay real-time multi-viewpoint object detection for an omnidirectional scanning shooting system by proposing a dual-stage detection approach with intermediate frames. This approach can synchronously search for valid viewpoints containing the desired objects, and perform low-update-delay real-time object detection on selected viewpoints with intermediate frames. We generated panoramic detection frames as real-time system output by projecting the individual viewpoint detection results. In an outdoor experimental scenario with 10 fps omnidirectional scanning shooting accommodating up to 40 viewpoints, our approach generated 20 fps real-time panoramic detection frames presenting the movement of the observed targets.
- 20 August 2025
- Published by Fuji Technology Press Ltd. in Journal of Robotics and Mechatronics
- Vol. 37 (4) , 852-863
Open AccessReal-Time Multi-Viewpoint Object Detection for High-Speed Omnidirectional Scanning Shooting System
Obtaining object-detection results through multi-viewpoint systems is a promising approach for gathering the surrounding information for mobile robots. In this study, we realized a low delay real-time multi-viewpoint object detection for an omnidirectional scanning shooting system by proposing a dual-stage detection approach with intermediate frames. This approach can synchronously search for valid viewpoints containing the desired objects, and perform low-update-delay real-time object detection on selected viewpoints with intermediate frames. We generated panoramic detection frames as real-time system output by projecting the individual viewpoint detection results. In an outdoor experimental scenario with 10 fps omnidirectional scanning shooting accommodating up to 40 viewpoints, our approach generated 20 fps real-time panoramic detection frames presenting the movement of the observed targets.