KTKentaro Takemura

Kentaro Takemura

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Kentaro Takemura has a total of 70 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Extracting Corneal Reflection of Screen by High-Speed Control of Polarization

    by Ayato Nakamura, Kentaro Takemura

    Polarization has been considered to be a reference instead of near-infrared light sources in eye tracking because the light emitted from a liquid-crystal display is typically polarized. However, the degree of polarization depends on the display content. Thus, devising a novel method is crucial for stably extracting the display reflection from the corneal surface. Therefore, we propose an eye-tracking method that inserts a white background between the display contents using a high-speed display to extract the screen reflection on the cornea. A high-speed camera and polarization modulator are integrated to extract the polarized light emitted from a high-speed display, and then the point-of-gaze is estimated. We evaluated the accuracy of the estimated point-of-gaze under several conditions to compare the proposed method with conventional approaches. The results revealed that the proposed method improved eye gaze estimation.


  • Open Access

    RFTIRTouch: Touch Sensing Device for Dual-sided Transparent Plane Based on Repropagated Frustrated Total Internal Reflection

    by Ratchanon Wattanaparinton, Kotaro Kitada, Kentaro Takemura

    Frustrated total internal reflection (FTIR) imaging is widely applied in various touch-sensing systems. However, vision-based touch sensing has structural constraints, and the system size tends to increase. Although a sensing system with reduced thickness has been developed recently using repropagated FTIR (RFTIR), it lacks the property of instant installation anywhere because observation from the side of a transparent medium is required. Therefore, this study proposes an "RFTIRTouch" sensing device to capture RFTIR images from the contact surface. RFTIRTouch detects the touch position on a dual-sided plane using a physics-based estimation and can be retrofitted to existing transparent media with simple calibration. Our evaluation experiments confirm that the touch position can be estimated within an error of approximately 2.1 mm under optimal conditions. Furthermore, several application examples are implemented to demonstrate the advantages of RFTIRTouch, such as its ability to measure dual sides with a single sensor and waterproof the contact surface.


  • Open Access

    Event-Based Pupil Tracking Using Bright and Dark Pupil Effect

    by Tatsuya Kagemoto, Kentaro Takemura

    Real-time high-speed gaze estimation can enable next-generation gaze-based interaction. The event camera, which captures intensity variations at high frequency, has been employed to this end. However, pupil tracking based only on events is difficult because events are sparse and limited. We propose high-speed pupil tracking using an event camera based on the bright and dark pupil effect. Two illumination sources generate events in the pupil area, and the pupil center is determined in real time at over 2000 Hz without requiring complete image from the events. We implemented gaze target estimation using smooth-pursuit eye movements and confirmed high-speed pupil tracking that may reduce the delay in gaze-based interaction.


  • Error Metric Using Correlation Between Binocular Corneal Images

    by Natsuki Kawakami, Kentaro Takemura

    The 3D point-of-gaze has been calculated using the binocular visual axes in the model-based eye gaze estimation. However, the 3D point-of-gaze is often shifted largely when the visual axis includes certain errors. The distance between the estimated point-of-gaze and the visual axis can be used as an error metric; however, horizontal errors cannot be evaluated, and an additional error metric is required to assess the reliability of the estimated point-of-gaze. Therefore, we propose a novel error metric using the correlation between binocular corneal images. We hypothesize that binocular corneal images extracted around the reflection of the estimated point-of-gaze exhibit a high correlation when the 3D point-of-gaze is correctly estimated. The two approaches were implemented using the corneal images extracted directly and generated based on binocular corneal imaging, and these approaches were evaluated through comparative experiments. We confirmed the feasibility of the proposed error metric and the effectiveness of binocular corneal imaging.

  • Cooperative Eye Tracking and Localization Based on Corneal Imaging

    by Yuki Kanai, Kentaro Takemura

    Corneal imaging has been studied as an eye-tracking method, and the focused object and point-of-gaze are estimated by extracting scene information reflected on the corneal surface. However, when an eye tracker is regarded as a daily-use device, it is an essential function to estimate its self-position. In our previous research, we attempted self-position estimation using interior illumination patterns reflected on the cornea. However, the accuracy of localization was not sufficient; thus, we focused on convolutional neural network developed remarkably and the inertial measurement unit (IMU) as additional improvements. In this study, we propose to improve the accuracy of localization by integrating SE-ResNet and IMU with Monte Carlo localization. Data collection and annotation become a problem when deep neural network is employed. To address this problem, three-dimensional (3D) environmental map was reconstructed, and SE-ResNet was trained using virtual images generated using the 3D environmental map. We conducted comparative experiments and confirmed the feasibility of our proposed method.

  • Transferable Shape Estimation of Soft Pneumatic Actuators Based on Active Vibroacoustic Sensing

    by Kazumi Chandrasiri, Kentaro Takemura

    A soft pneumatic actuator (SPA) is one of the most prominent components in a soft robotic system. The sensing of SPAs is challenging owing to their elasticity and deformability. Sensors for specific factors are required to successfully sense an SPA. A flexible sensor is an important component for sensing the conditions of SPAs, such as the shape and deformation due to contact events during applications. Developing versatile sensors with high flexibility and tolerability for SPAs is challenging. Data-driven sensing approaches involve individual machine learning models for different actuators. In contrast, it is an enormous advantage to have versatile sensors as hardware and machine learning models as software employed on various actuators. Therefore, we propose a transferable shape estimation method based on active vibro-acoustic sensing to achieve tolerability and increase versatility. We created easily transferable sensing devices for SPAs. In addition, we employed a data-driven approach that utilizes a simple transfer learning technique on a two-dimensional convolutional neural network model. We confirm the feasibility and versatility of the proposed method through evaluation experiments. A transferable estimation method was used on SPAs to estimate the bending angle and length under various sensing and environmental conditions, and the average errors were less than 3.5 $^\circ$ and 2.1mm, respectively.


  • Open Access

    Eye Gaze Estimation using Imperceptible Marker Presented on High-Speed Display

    by Kento Seida, Kentaro Takemura

    Advanced eye-tracking methods require a dedicated display equipped with near-infrared LEDs (light-emitting diodes). However, this requirement hinders the widespread adoption of such methods. Additionally, some glints may pass undetected when a large display is employed. To avoid these problems, we propose eye gaze estimation using imperceptible markers presented on a commercially available high-speed display. The marker reference points reflected on the cornea are extracted instead of glints, and the point-of-gaze can be estimated using the cross-ratio method. The accuracy of the estimated point-of-gaze was approximately 1.64 degrees, as verified from experimental evaluations of the estimation using a high-speed display.