Kentaro Takemura
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Kentaro Takemura has a total of 70 co-authors. Here are the top co-authors by number of shared publications:
Tsukasa Ogasawara
Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan
33 shared publicationsJun Takamatsu
Graduate School of Information Science, Nara Institute of Science and Technology, Japan
27 shared publicationsTsuyoshi Suenaga
7 shared publicationsYoshio Matsumoto
7 shared publicationsJunichi Ido
6 shared publicationsYutaka Kondo
6 shared publications
Latest Publications
- Open Access
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Implicit User Calibration Based on Binocular Corneal Imaging
- 2 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessImplicit User Calibration Based on Binocular Corneal Imaging
- Open Access
- 31 May 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Corneal Center Estimation Using Incident Planes Calculated by Polarization
- 31 May 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessCorneal Center Estimation Using Incident Planes Calculated by Polarization
- Open Access
- 25 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Homography normalization enhanced to enable one-point user calibration for gaze estimation
- 25 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessHomography normalization enhanced to enable one-point user calibration for gaze estimation
- Open Access
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 33-36
Extracting Corneal Reflection of Screen by High-Speed Control of Polarization
Polarization has been considered to be a reference instead of near-infrared light sources in eye tracking because the light emitted from a liquid-crystal display is typically polarized. However, the degree of polarization depends on the display content. Thus, devising a novel method is crucial for stably extracting the display reflection from the corneal surface. Therefore, we propose an eye-tracking method that inserts a white background between the display contents using a high-speed display to extract the screen reflection on the cornea. A high-speed camera and polarization modulator are integrated to extract the polarized light emitted from a high-speed display, and then the point-of-gaze is estimated. We evaluated the accuracy of the estimated point-of-gaze under several conditions to compare the proposed method with conventional approaches. The results revealed that the proposed method improved eye gaze estimation.
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 33-36
Open AccessExtracting Corneal Reflection of Screen by High-Speed Control of Polarization
Polarization has been considered to be a reference instead of near-infrared light sources in eye tracking because the light emitted from a liquid-crystal display is typically polarized. However, the degree of polarization depends on the display content. Thus, devising a novel method is crucial for stably extracting the display reflection from the corneal surface. Therefore, we propose an eye-tracking method that inserts a white background between the display contents using a high-speed display to extract the screen reflection on the cornea. A high-speed camera and polarization modulator are integrated to extract the polarized light emitted from a high-speed display, and then the point-of-gaze is estimated. We evaluated the accuracy of the estimated point-of-gaze under several conditions to compare the proposed method with conventional approaches. The results revealed that the proposed method improved eye gaze estimation.
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-10
RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal Reflection
Frustrated total internal reflection (FTIR) imaging is widely applied in various touch-sensing systems. However, vision-based touch sensing has structural constraints, and the system size tends to increase. Although a sensing system with reduced thickness has been developed recently using repropagated FTIR (RFTIR), it lacks the property of instant installation anywhere because observation from the side of a transparent medium is required. Therefore, this study proposes an "RFTIRTouch" sensing device to capture RFTIR images from the contact surface. RFTIRTouch detects the touch position on a dual-sided plane using a physics-based estimation and can be retrofitted to existing transparent media with simple calibration. Our evaluation experiments confirm that the touch position can be estimated within an error of approximately 2.1 mm under optimal conditions. Furthermore, several application examples are implemented to demonstrate the advantages of RFTIRTouch, such as its ability to measure dual sides with a single sensor and waterproof the contact surface.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Open AccessRFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal Reflection
Frustrated total internal reflection (FTIR) imaging is widely applied in various touch-sensing systems. However, vision-based touch sensing has structural constraints, and the system size tends to increase. Although a sensing system with reduced thickness has been developed recently using repropagated FTIR (RFTIR), it lacks the property of instant installation anywhere because observation from the side of a transparent medium is required. Therefore, this study proposes an "RFTIRTouch" sensing device to capture RFTIR images from the contact surface. RFTIRTouch detects the touch position on a dual-sided plane using a physics-based estimation and can be retrofitted to existing transparent media with simple calibration. Our evaluation experiments confirm that the touch position can be estimated within an error of approximately 2.1 mm under optimal conditions. Furthermore, several application examples are implemented to demonstrate the advantages of RFTIRTouch, such as its ability to measure dual sides with a single sensor and waterproof the contact surface.
- Open Access
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Event-Based Pupil Tracking Using Bright and Dark Pupil Effect
Real-time high-speed gaze estimation can enable next-generation gaze-based interaction. The event camera, which captures intensity variations at high frequency, has been employed to this end. However, pupil tracking based only on events is difficult because events are sparse and limited. We propose high-speed pupil tracking using an event camera based on the bright and dark pupil effect. Two illumination sources generate events in the pupil area, and the pupil center is determined in real time at over 2000 Hz without requiring complete image from the events. We implemented gaze target estimation using smooth-pursuit eye movements and confirmed high-speed pupil tracking that may reduce the delay in gaze-based interaction.
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessEvent-Based Pupil Tracking Using Bright and Dark Pupil Effect
Real-time high-speed gaze estimation can enable next-generation gaze-based interaction. The event camera, which captures intensity variations at high frequency, has been employed to this end. However, pupil tracking based only on events is difficult because events are sparse and limited. We propose high-speed pupil tracking using an event camera based on the bright and dark pupil effect. Two illumination sources generate events in the pupil area, and the pupil center is determined in real time at over 2000 Hz without requiring complete image from the events. We implemented gaze target estimation using smooth-pursuit eye movements and confirmed high-speed pupil tracking that may reduce the delay in gaze-based interaction.
- 1 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5140-5145
Error Metric Using Correlation Between Binocular Corneal Images
The 3D point-of-gaze has been calculated using the binocular visual axes in the model-based eye gaze estimation. However, the 3D point-of-gaze is often shifted largely when the visual axis includes certain errors. The distance between the estimated point-of-gaze and the visual axis can be used as an error metric; however, horizontal errors cannot be evaluated, and an additional error metric is required to assess the reliability of the estimated point-of-gaze. Therefore, we propose a novel error metric using the correlation between binocular corneal images. We hypothesize that binocular corneal images extracted around the reflection of the estimated point-of-gaze exhibit a high correlation when the 3D point-of-gaze is correctly estimated. The two approaches were implemented using the corneal images extracted directly and generated based on binocular corneal imaging, and these approaches were evaluated through comparative experiments. We confirmed the feasibility of the proposed error metric and the effectiveness of binocular corneal imaging.
- 1 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5140-5145
Error Metric Using Correlation Between Binocular Corneal Images
The 3D point-of-gaze has been calculated using the binocular visual axes in the model-based eye gaze estimation. However, the 3D point-of-gaze is often shifted largely when the visual axis includes certain errors. The distance between the estimated point-of-gaze and the visual axis can be used as an error metric; however, horizontal errors cannot be evaluated, and an additional error metric is required to assess the reliability of the estimated point-of-gaze. Therefore, we propose a novel error metric using the correlation between binocular corneal images. We hypothesize that binocular corneal images extracted around the reflection of the estimated point-of-gaze exhibit a high correlation when the 3D point-of-gaze is correctly estimated. The two approaches were implemented using the corneal images extracted directly and generated based on binocular corneal imaging, and these approaches were evaluated through comparative experiments. We confirmed the feasibility of the proposed error metric and the effectiveness of binocular corneal imaging.
- 17 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Cooperative Eye Tracking and Localization Based on Corneal Imaging
Corneal imaging has been studied as an eye-tracking method, and the focused object and point-of-gaze are estimated by extracting scene information reflected on the corneal surface. However, when an eye tracker is regarded as a daily-use device, it is an essential function to estimate its self-position. In our previous research, we attempted self-position estimation using interior illumination patterns reflected on the cornea. However, the accuracy of localization was not sufficient; thus, we focused on convolutional neural network developed remarkably and the inertial measurement unit (IMU) as additional improvements. In this study, we propose to improve the accuracy of localization by integrating SE-ResNet and IMU with Monte Carlo localization. Data collection and annotation become a problem when deep neural network is employed. To address this problem, three-dimensional (3D) environmental map was reconstructed, and SE-ResNet was trained using virtual images generated using the 3D environmental map. We conducted comparative experiments and confirmed the feasibility of our proposed method.
- 17 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Cooperative Eye Tracking and Localization Based on Corneal Imaging
Corneal imaging has been studied as an eye-tracking method, and the focused object and point-of-gaze are estimated by extracting scene information reflected on the corneal surface. However, when an eye tracker is regarded as a daily-use device, it is an essential function to estimate its self-position. In our previous research, we attempted self-position estimation using interior illumination patterns reflected on the cornea. However, the accuracy of localization was not sufficient; thus, we focused on convolutional neural network developed remarkably and the inertial measurement unit (IMU) as additional improvements. In this study, we propose to improve the accuracy of localization by integrating SE-ResNet and IMU with Monte Carlo localization. Data collection and annotation become a problem when deep neural network is employed. To address this problem, three-dimensional (3D) environmental map was reconstructed, and SE-ResNet was trained using virtual images generated using the 3D environmental map. We conducted comparative experiments and confirmed the feasibility of our proposed method.
- 20 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (4) , 9849-9856
Transferable Shape Estimation of Soft Pneumatic Actuators Based on Active Vibroacoustic Sensing
A soft pneumatic actuator (SPA) is one of the most prominent components in a soft robotic system. The sensing of SPAs is challenging owing to their elasticity and deformability. Sensors for specific factors are required to successfully sense an SPA. A flexible sensor is an important component for sensing the conditions of SPAs, such as the shape and deformation due to contact events during applications. Developing versatile sensors with high flexibility and tolerability for SPAs is challenging. Data-driven sensing approaches involve individual machine learning models for different actuators. In contrast, it is an enormous advantage to have versatile sensors as hardware and machine learning models as software employed on various actuators. Therefore, we propose a transferable shape estimation method based on active vibro-acoustic sensing to achieve tolerability and increase versatility. We created easily transferable sensing devices for SPAs. In addition, we employed a data-driven approach that utilizes a simple transfer learning technique on a two-dimensional convolutional neural network model. We confirm the feasibility and versatility of the proposed method through evaluation experiments. A transferable estimation method was used on SPAs to estimate the bending angle and length under various sensing and environmental conditions, and the average errors were less than 3.5$^\circ$ and 2.1mm, respectively.- 20 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (4) , 9849-9856
Transferable Shape Estimation of Soft Pneumatic Actuators Based on Active Vibroacoustic Sensing
A soft pneumatic actuator (SPA) is one of the most prominent components in a soft robotic system. The sensing of SPAs is challenging owing to their elasticity and deformability. Sensors for specific factors are required to successfully sense an SPA. A flexible sensor is an important component for sensing the conditions of SPAs, such as the shape and deformation due to contact events during applications. Developing versatile sensors with high flexibility and tolerability for SPAs is challenging. Data-driven sensing approaches involve individual machine learning models for different actuators. In contrast, it is an enormous advantage to have versatile sensors as hardware and machine learning models as software employed on various actuators. Therefore, we propose a transferable shape estimation method based on active vibro-acoustic sensing to achieve tolerability and increase versatility. We created easily transferable sensing devices for SPAs. In addition, we employed a data-driven approach that utilizes a simple transfer learning technique on a two-dimensional convolutional neural network model. We confirm the feasibility and versatility of the proposed method through evaluation experiments. A transferable estimation method was used on SPAs to estimate the bending angle and length under various sensing and environmental conditions, and the average errors were less than 3.5$^\circ$ and 2.1mm, respectively.- Open Access
- 25 May 2021
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Eye Gaze Estimation using Imperceptible Marker Presented on High-Speed Display
Advanced eye-tracking methods require a dedicated display equipped with near-infrared LEDs (light-emitting diodes). However, this requirement hinders the widespread adoption of such methods. Additionally, some glints may pass undetected when a large display is employed. To avoid these problems, we propose eye gaze estimation using imperceptible markers presented on a commercially available high-speed display. The marker reference points reflected on the cornea are extracted instead of glints, and the point-of-gaze can be estimated using the cross-ratio method. The accuracy of the estimated point-of-gaze was approximately 1.64 degrees, as verified from experimental evaluations of the estimation using a high-speed display.
- 25 May 2021
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessEye Gaze Estimation using Imperceptible Marker Presented on High-Speed Display
Advanced eye-tracking methods require a dedicated display equipped with near-infrared LEDs (light-emitting diodes). However, this requirement hinders the widespread adoption of such methods. Additionally, some glints may pass undetected when a large display is employed. To avoid these problems, we propose eye gaze estimation using imperceptible markers presented on a commercially available high-speed display. The marker reference points reflected on the cornea are extracted instead of glints, and the point-of-gaze can be estimated using the cross-ratio method. The accuracy of the estimated point-of-gaze was approximately 1.64 degrees, as verified from experimental evaluations of the estimation using a high-speed display.