Jisu Yim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jisu Yim has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Geehyuk Lee
HCI Lab, School of Computing, KAIST, Daejeon, Republic of Korea
8 shared publications - Taejun Kim
HCI Lab, School of Computing, KAIST, Daejeon, Republic of Korea
3 shared publications - Yohan Yun
HCI Lab, School of Computing, KAIST, Daejeon, Republic of Korea
3 shared publications - Donghyeon Ko
HCI Lab, School of Computing, KAIST, Daejeon, Republic of Korea
2 shared publications - Kyunghwan Kim
HCI Lab, School of Computing, KAIST, Korea, Republic of
2 shared publications - YoungIn Kim
HCI Lab, School of Computing, KAIST, Daejeon, Republic of Korea
2 shared publications
Latest Publications
- Open Access
- 13 November 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (8) , 145-169
AutoPark: Adaptive Friction Mouse Facilitating Stable Multi-touch Gesture Input
Multi-touch mice have been proposed to integrate the rich input vocabulary of multi-touch gestures into traditional computer mice. However, incorporating multi-finger gestures into a mouse introduces a design conflict: Mice are optimized for low friction to support smooth cursor navigation, whereas touch gestures require high friction for stability. In this paper, we present AutoPark—the concept of a multi-touch mouse that dynamically adjusts its friction based on user intent. AutoPark mouse operates in a low-friction mode for cursor movement and shifts to a high-friction state for multi-touch interactions. Our first user study measured the shear forces during touch gestures, confirming that conventional friction levels of mousepads are insufficient to maintain gesture input stability on a mouse. We developed an AutoPark prototype and conducted controlled experiments, comparing it with both conventional low-friction and gesture-favored high-friction setups. The results demonstrate that AutoPark enhances gesture stability while maintaining comparable pointing performance in our study tasks, supporting a richer gesture input vocabulary within mouse-based GUI interactions.
- 13 November 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (8) , 145-169
Open AccessAutoPark: Adaptive Friction Mouse Facilitating Stable Multi-touch Gesture Input
Multi-touch mice have been proposed to integrate the rich input vocabulary of multi-touch gestures into traditional computer mice. However, incorporating multi-finger gestures into a mouse introduces a design conflict: Mice are optimized for low friction to support smooth cursor navigation, whereas touch gestures require high friction for stability. In this paper, we present AutoPark—the concept of a multi-touch mouse that dynamically adjusts its friction based on user intent. AutoPark mouse operates in a low-friction mode for cursor movement and shifts to a high-friction state for multi-touch interactions. Our first user study measured the shear forces during touch gestures, confirming that conventional friction levels of mousepads are insufficient to maintain gesture input stability on a mouse. We developed an AutoPark prototype and conducted controlled experiments, comparing it with both conventional low-friction and gesture-favored high-friction setups. The results demonstrate that AutoPark enhances gesture stability while maintaining comparable pointing performance in our study tasks, supporting a richer gesture input vocabulary within mouse-based GUI interactions.
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
StringTouch: A Non-occlusive 3DoF Haptic Interface Using String Structures for Modulating Finger Sensations
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Open AccessStringTouch: A Non-occlusive 3DoF Haptic Interface Using String Structures for Modulating Finger Sensations
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Typing Haptically: Towards Enabling Non-auditory Smartphone Text Entry with Haptic Feedback for Blind and Low Vision Users
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessTyping Haptically: Towards Enabling Non-auditory Smartphone Text Entry with Haptic Feedback for Blind and Low Vision Users
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Tension&Gaze: Gaze-Responsive UI Gated by Finger Tension
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessTension&Gaze: Gaze-Responsive UI Gated by Finger Tension
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Palmrest+: Expanding Laptop Input Space with Shear Force on Palm-Resting Area
The palmrest area of laptops has the potential as an additional input space, considering its consistent palm contact during keyboard interaction. We propose Palmrest+, leveraging shear force exerted on the palmrest area. We suggest two input techniques: Palmrest Shortcut, for instant shortcut execution, and Palmrest Joystick, for continuous value input. These allow seamless and subtle input amidst keyboard typing. Evaluation of Palmrest Shortcut against conventional keyboard shortcuts revealed faster performance for applying shear force in unimanual and bimanual-manner with a significant reduction in gaze shifting. Additionally, the assessment of Palmrest Joystick against the laptop touchpad demonstrated comparable performance in selecting one- and two- dimensional targets with low-precision pointing, i.e., for short distances and large target sizes. The maximal hand displacement significantly decreased for both Palmrest Shortcut and Palmrest Joystick compared to conventional methods. These findings verify the feasibility and effectiveness of leveraging the palmrest area as an additional input space on laptops, offering promising enhanced typing-related user interaction experiences.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-14
Open AccessPalmrest+: Expanding Laptop Input Space with Shear Force on Palm-Resting Area
The palmrest area of laptops has the potential as an additional input space, considering its consistent palm contact during keyboard interaction. We propose Palmrest+, leveraging shear force exerted on the palmrest area. We suggest two input techniques: Palmrest Shortcut, for instant shortcut execution, and Palmrest Joystick, for continuous value input. These allow seamless and subtle input amidst keyboard typing. Evaluation of Palmrest Shortcut against conventional keyboard shortcuts revealed faster performance for applying shear force in unimanual and bimanual-manner with a significant reduction in gaze shifting. Additionally, the assessment of Palmrest Joystick against the laptop touchpad demonstrated comparable performance in selecting one- and two- dimensional targets with low-precision pointing, i.e., for short distances and large target sizes. The maximal hand displacement significantly decreased for both Palmrest Shortcut and Palmrest Joystick compared to conventional methods. These findings verify the feasibility and effectiveness of leveraging the palmrest area as an additional input space on laptops, offering promising enhanced typing-related user interaction experiences.
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Pro-Tact: Hierarchical Synthesis of Proprioception and Tactile Exploration for Eyes-Free Ray Pointing on Out-of-View VR Menus
We introduce Pro-Tact, a novel eyes-free pointing technique for interacting with out-of-view (OoV) VR menus. This technique combines rapid rough pointing using proprioception with fine-grain adjustments through tactile exploration, enabling menu interaction without visual attention. Our user study demonstrated that Pro-Tact allows users to select menu items accurately (95% accuracy for 54 items) in an eyes-free manner, with reduced fatigue and sickness compared to eyes-engaged interaction. Additionally, we observed that participants voluntarily interacted with OoV menus eyes-free when Pro-Tact’s tactile feedback was provided in practical VR application usage contexts. This research contributes by introducing the novel interaction technique, Pro-Tact, and quantitatively evaluating its benefits in terms of performance, user experience, and user preference in OoV menu interactions.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessPro-Tact: Hierarchical Synthesis of Proprioception and Tactile Exploration for Eyes-Free Ray Pointing on Out-of-View VR Menus
We introduce Pro-Tact, a novel eyes-free pointing technique for interacting with out-of-view (OoV) VR menus. This technique combines rapid rough pointing using proprioception with fine-grain adjustments through tactile exploration, enabling menu interaction without visual attention. Our user study demonstrated that Pro-Tact allows users to select menu items accurately (95% accuracy for 54 items) in an eyes-free manner, with reduced fatigue and sickness compared to eyes-engaged interaction. Additionally, we observed that participants voluntarily interacted with OoV menus eyes-free when Pro-Tact’s tactile feedback was provided in practical VR application usage contexts. This research contributes by introducing the novel interaction technique, Pro-Tact, and quantitatively evaluating its benefits in terms of performance, user experience, and user preference in OoV menu interactions.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-5
STButton: Exploring Opportunities for Buttons with Spatio-Temporal Tactile Output
We present STButton, a physical button with a high-resolution spatio-temporal tactile feedback surface. The 5 x 8 pin array tactile display size of 20mm x 28mm enables buttons to express various types of information, such as value with the number of raised pins, direction with the location of raised pins, and duration of time with blinking animation. With a highly expressive tactile surface, the button can seamlessly transfer assistive feedforward and feedback during spontaneous button interaction, such as touching to locate the button or applying gradual pressure to press the button. In the demonstration, attendees experience five scenarios of button interaction: the seat heater button on a car, the volume control button on a remote controller, the power button on a laptop, the menu button on a VR controller, and the play button on a game controller. In each scenario, the representative role of tactile feedback is configured differently, allowing attendees to experience the rich interaction space and potential benefits of STButton. Early accessed attendees appreciated the unique opportunity to transfer information with a highly expressive tactile surface and emphasized that STButton adds a tangible layer to the user experience, enhancing emotional and sensory engagement.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessSTButton: Exploring Opportunities for Buttons with Spatio-Temporal Tactile Output
We present STButton, a physical button with a high-resolution spatio-temporal tactile feedback surface. The 5 x 8 pin array tactile display size of 20mm x 28mm enables buttons to express various types of information, such as value with the number of raised pins, direction with the location of raised pins, and duration of time with blinking animation. With a highly expressive tactile surface, the button can seamlessly transfer assistive feedforward and feedback during spontaneous button interaction, such as touching to locate the button or applying gradual pressure to press the button. In the demonstration, attendees experience five scenarios of button interaction: the seat heater button on a car, the volume control button on a remote controller, the power button on a laptop, the menu button on a VR controller, and the play button on a game controller. In each scenario, the representative role of tactile feedback is configured differently, allowing attendees to experience the rich interaction space and potential benefits of STButton. Early accessed attendees appreciated the unique opportunity to transfer information with a highly expressive tactile surface and emphasized that STButton adds a tangible layer to the user experience, enhancing emotional and sensory engagement.
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
HapticPalmrest: Haptic Feedback through the Palm for the Laptop Keyboard
Programmable haptic feedback on touchscreen keyboards enriches user experiences but is hard to realize for physical keyboards because this requires individually augmenting each key with an actuator. As an alternative approach, we propose HapticPalmrest, where haptic feedback for a physical keyboard is provided to the palms. This is particularly feasible for a laptop environment, where users usually rest their palms while interacting with the keyboard. To verify the feasibility of the approach, we conducted two user studies. The first study showed that at least one palm was on palmrest for more than 90% of key interaction time. The second study showed a vibration power of 1.17 g (peak-to-peak) and a duration of 4 ms was sufficient for reliable perception of palmrest vibrations during keyboard interaction. We finally demonstrated the potential of such an approach by designing Dwell+ Key, an application that extends the function of each key by enabling timed dwelling operations.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessHapticPalmrest: Haptic Feedback through the Palm for the Laptop Keyboard
Programmable haptic feedback on touchscreen keyboards enriches user experiences but is hard to realize for physical keyboards because this requires individually augmenting each key with an actuator. As an alternative approach, we propose HapticPalmrest, where haptic feedback for a physical keyboard is provided to the palms. This is particularly feasible for a laptop environment, where users usually rest their palms while interacting with the keyboard. To verify the feasibility of the approach, we conducted two user studies. The first study showed that at least one palm was on palmrest for more than 90% of key interaction time. The second study showed a vibration power of 1.17 g (peak-to-peak) and a duration of 4 ms was sufficient for reliable perception of palmrest vibrations during keyboard interaction. We finally demonstrated the potential of such an approach by designing Dwell+ Key, an application that extends the function of each key by enabling timed dwelling operations.