Yushi Sato
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yushi Sato has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Daisuke Iwai
Graduate School of Engineering Science, The University of Osaka, Japan
4 shared publications - Kosuke Sato
Osaka University, Osaka, Japan
3 shared publications Haruka Matsukura
Graduate School of Engineering Science, Osaka University, Toyonaka, Japan
1 shared publicationKosuke Sato
Graduate School of Engineering Science, Osaka University, Toyonaka, Japan
1 shared publicationNaruki Tanabe
Graduate School of Engineering Science, Osaka University, Toyonaka, Japan
1 shared publication- Takefumi Hiraki
University of Tsukuba
1 shared publication
Latest Publications
- Open Access
- 24 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 99333
Correction to “Sound Texture Feedback for a Projected Extended Hand Interface”
In the above article [1] , we discovered that the y-axis labels of the box plot in Fig. 7(b) are incorrect. This error does not affect the conclusions of the published paper. The details of the error and correction are as follows:
- 24 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 99333
Open AccessCorrection to “Sound Texture Feedback for a Projected Extended Hand Interface”
In the above article [1] , we discovered that the y-axis labels of the box plot in Fig. 7(b) are incorrect. This error does not affect the conclusions of the published paper. The details of the error and correction are as follows:
- Open Access
- 11 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 38247-38257
Responsive-ExtendedHand: Adaptive Visuo-Haptic Feedback Recognizing Object Property With RGB-D Camera for Projected Extended Hand
The ExtendedHand interface displays computer graphics (CG) hand images in real space from a projector, allowing the user to visually point at and touch real objects that are out of their physical reach. Furthermore, when the projected CG hand (extended hand) touches an object, the user can feel the tactile sensation of the object through pseudo-haptics by giving the extended hand visual effects that emphasize the action. In the previous psychological study, the human operator had to manually assign the location and shape of objects and the intensities of their visual effects in advance in order to emphasize the appropriate visual effect for the object touched by the extended hand. To increase practical feasibility, we propose an adaptive system that utilizes an RGB-D camera and deep neural networks to generate the appropriate visual effects automatically and apply them to the projected extended hand. By employing U-Net to generate the appropriate intensities of the visual effects from the captured color and depth images, the system can estimate the appropriate visual effects for objects without pre-setting them. The user evaluation results showed that the proposed system allowed users to naturally perceive the tactile sensation of objects at a rate of 44%, instead of the manual rate of 49%.
- 11 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 38247-38257
Open AccessResponsive-ExtendedHand: Adaptive Visuo-Haptic Feedback Recognizing Object Property With RGB-D Camera for Projected Extended Hand
The ExtendedHand interface displays computer graphics (CG) hand images in real space from a projector, allowing the user to visually point at and touch real objects that are out of their physical reach. Furthermore, when the projected CG hand (extended hand) touches an object, the user can feel the tactile sensation of the object through pseudo-haptics by giving the extended hand visual effects that emphasize the action. In the previous psychological study, the human operator had to manually assign the location and shape of objects and the intensities of their visual effects in advance in order to emphasize the appropriate visual effect for the object touched by the extended hand. To increase practical feasibility, we propose an adaptive system that utilizes an RGB-D camera and deep neural networks to generate the appropriate visual effects automatically and apply them to the projected extended hand. By employing U-Net to generate the appropriate intensities of the visual effects from the captured color and depth images, the system can estimate the appropriate visual effects for objects without pre-setting them. The user evaluation results showed that the proposed system allowed users to naturally perceive the tactile sensation of objects at a rate of 44%, instead of the manual rate of 49%.
- Open Access
- 19 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 27673-27682
Sound Texture Feedback for a Projected Extended Hand Interface
The ExtendedHand interface projects a computer graphics (CG) hand that synchronizes with a user’s physical hand movements onto a real environment, visually extending the user’s reach. This paper focuses on enhancing the user’s tactile perception of an object through cross-modal phenomena by providing a sound texture (auditory information that matches the object) when the CG hand touches it. Here, ExtendedHand enables users to touch objects beyond their physical reach, an experience that cannot be achieved with their physical body. In such situations, the appropriateness of adjusting sound pressure based on physical laws according to distance for users is unclear. Additionally, we have empirical knowledge that the speed at which we touch objects with our hands results in different sounds. Within ExtendedHand, since the movement of the user’s physical hand is amplified and reflected in the CG hand’s movement, the physical hand’s speed does not match the CG hand’s speed. This raises the question of whether sound texture feedback should align with the visual information of the CG hand or the proprioceptive sensory information of the physical hand. In this paper, we conducted two user studies to explore appropriate sound texture feedback for the projected CG hand. The results indicate that when the CG hand touches objects at various distances, the sound pressure should follow the same sound pressure attenuation as observed in physical phenomena. Additionally, the results suggest that despite swift tracing actions with the CG hand, users perceive sounds produced at a slower pace to be more suitable.
- 19 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 27673-27682
Open AccessSound Texture Feedback for a Projected Extended Hand Interface
The ExtendedHand interface projects a computer graphics (CG) hand that synchronizes with a user’s physical hand movements onto a real environment, visually extending the user’s reach. This paper focuses on enhancing the user’s tactile perception of an object through cross-modal phenomena by providing a sound texture (auditory information that matches the object) when the CG hand touches it. Here, ExtendedHand enables users to touch objects beyond their physical reach, an experience that cannot be achieved with their physical body. In such situations, the appropriateness of adjusting sound pressure based on physical laws according to distance for users is unclear. Additionally, we have empirical knowledge that the speed at which we touch objects with our hands results in different sounds. Within ExtendedHand, since the movement of the user’s physical hand is amplified and reflected in the CG hand’s movement, the physical hand’s speed does not match the CG hand’s speed. This raises the question of whether sound texture feedback should align with the visual information of the CG hand or the proprioceptive sensory information of the physical hand. In this paper, we conducted two user studies to explore appropriate sound texture feedback for the projected CG hand. The results indicate that when the CG hand touches objects at various distances, the sound pressure should follow the same sound pressure attenuation as observed in physical phenomena. Additionally, the results suggest that despite swift tracing actions with the CG hand, users perceive sounds produced at a slower pace to be more suitable.
- Open Access
- 1 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 120473-120488
Modifying Texture Perception With Pseudo-Haptic Feedback for a Projected Virtual Hand Interface
Human body augmentation makes it possible to obtain new abilities that we cannot achieve with our actual bodies. A projected virtual hand interface is a promising approach for body augmentation because it can extend a user's reach in daily life without the need to wear a device. Although users can manipulate a projected virtual hand as if it were their own hand and can interact with distant objects through it, they cannot feel the sensation of touch when the projected virtual hand is overlaid on a real object. In this paper, we propose a novel pseudo-haptic feedback framework to provide users with the tactile texture of objects without the use of haptic devices. We designed three types of visual effects that produce unevenness, slipperiness, and softness. The experimental results indicate that the proposed visual effects can lead users to feel the intended tactile sensation. Furthermore, the visual effects provide users with tactile sensations with three to five levels of intensity without producing a strange feeling.
- 1 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 120473-120488
Open AccessModifying Texture Perception With Pseudo-Haptic Feedback for a Projected Virtual Hand Interface
Human body augmentation makes it possible to obtain new abilities that we cannot achieve with our actual bodies. A projected virtual hand interface is a promising approach for body augmentation because it can extend a user's reach in daily life without the need to wear a device. Although users can manipulate a projected virtual hand as if it were their own hand and can interact with distant objects through it, they cannot feel the sensation of touch when the projected virtual hand is overlaid on a real object. In this paper, we propose a novel pseudo-haptic feedback framework to provide users with the tactile texture of objects without the use of haptic devices. We designed three types of visual effects that produce unevenness, slipperiness, and softness. The experimental results indicate that the proposed visual effects can lead users to feel the intended tactile sensation. Furthermore, the visual effects provide users with tactile sensations with three to five levels of intensity without producing a strange feeling.