Jejoong Kim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jejoong Kim has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Kwanguk Kim
Department of Computer Science, Hanyang University, Seoul, Republic of Korea
5 shared publications - Myeongul Jung
Department of Clothing and Textiles, Hanyang University, Seoul, Republic of Korea
4 shared publications - Jihwan Kim
Department of Computer Science, Hanyang University, Seoul, Republic of Korea
2 shared publications - Eunice L. Jung
Department of Brain and Cognitive Sciences, Seoul National University, Seoul, Korea
1 shared publication - Eunui Jo
Department of Psychology, Duksung Women’s University, Seoul, Korea
1 shared publication Hannah Lee
1 shared publication
Latest Publications
- Open Access
- 22 October 2025
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 13 (1) , e69330
Becoming a Rapid Shooter in a Game Using Embodied Electrical Muscle Stimulation: Development and Usability Study
Background: Electrical muscle stimulation (EMS) systems enhance human capabilities, such as reaction time, by inducing preemptive muscle contractions. One of the key challenges for EMS applications is preserving the user’s sense of agency, and it is defined as a subjective experience of initiating and controlling one’s actions. Prior research highlights the importance of the “sweet spot”—a balance between sense of agency and preemptive gain—for effective EMS use. However, most prior studies have focused on simplistic tasks, leaving a gap in understanding how the sweet spot functions in complex and ecological game scenarios. Moreover, the potential benefits of a personalized approach were not explored. Objective: This study examines the effects of embodied EMS on performance and sense of agency in a serious-games–based pistol-shooting scenario. Additionally, we investigated the effects of personalization in the same game scenario. Methods: Two studies were conducted. Study 1 identified the optimal EMS timing (“sweet spot”) to improve response time while preserving agency. A total of 13 participants completed a visual stimulus-response task after EMS calibration. Participants performed 150 right-button clicks on a target using an EMS-equipped mouse, with EMS timings ranging from −200 to +100 ms. An agency questionnaire followed each trial. Logistic regression was used to identify the sweet spot. Study 2 applied the findings of Study 1 to a pistol-shooting game. A total of 10 new participants were recruited. Before gameplay, individual sweet spots were measured for the individually embodied EMS condition. During the game, participants navigated to a target location, distinguished enemies from hostages, and shot enemies. After a practice session, participants completed the game under 4 counterbalanced conditions: averagely embodied EMS (used the average sweet spot value from Study 1), individually embodied EMS (used each participant’s own sweet spot value), immediate EMS (stimulation at a target onset timing), and no EMS. Results: Study 1 identified a sweet spot that significantly improved reaction time while preserving agency. Logistic analysis showed an average sweet spot of 46.8 ms and individual variability across participants. Study 2 confirmed these findings in a pistol-shooting game. Both averagely and individually embodied EMS significantly reduced reaction times compared to no EMS ( P =.03 and P =.001, respectively), without compromising agency. Individually embodied EMS yielded additional benefits. In the slower than average group, the sense of agency in the individually embodied EMS condition showed an additional benefit that was not observed in the averagely embodied EMS condition ( P =.003 and P =, respectively). Conclusions: The findings indicate that embodied EMS enhances performance in complex game scenarios while maintaining users’ sense of agency, with individualization yielding additional benefits. These results extend prior evidence to more complex game contexts and provide valuable implications for the personalized design of EMS systems in sports training, rehabilitation, and serious gaming.
- 22 October 2025
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 13 (1) , e69330
Open AccessBecoming a Rapid Shooter in a Game Using Embodied Electrical Muscle Stimulation: Development and Usability Study
Background: Electrical muscle stimulation (EMS) systems enhance human capabilities, such as reaction time, by inducing preemptive muscle contractions. One of the key challenges for EMS applications is preserving the user’s sense of agency, and it is defined as a subjective experience of initiating and controlling one’s actions. Prior research highlights the importance of the “sweet spot”—a balance between sense of agency and preemptive gain—for effective EMS use. However, most prior studies have focused on simplistic tasks, leaving a gap in understanding how the sweet spot functions in complex and ecological game scenarios. Moreover, the potential benefits of a personalized approach were not explored. Objective: This study examines the effects of embodied EMS on performance and sense of agency in a serious-games–based pistol-shooting scenario. Additionally, we investigated the effects of personalization in the same game scenario. Methods: Two studies were conducted. Study 1 identified the optimal EMS timing (“sweet spot”) to improve response time while preserving agency. A total of 13 participants completed a visual stimulus-response task after EMS calibration. Participants performed 150 right-button clicks on a target using an EMS-equipped mouse, with EMS timings ranging from −200 to +100 ms. An agency questionnaire followed each trial. Logistic regression was used to identify the sweet spot. Study 2 applied the findings of Study 1 to a pistol-shooting game. A total of 10 new participants were recruited. Before gameplay, individual sweet spots were measured for the individually embodied EMS condition. During the game, participants navigated to a target location, distinguished enemies from hostages, and shot enemies. After a practice session, participants completed the game under 4 counterbalanced conditions: averagely embodied EMS (used the average sweet spot value from Study 1), individually embodied EMS (used each participant’s own sweet spot value), immediate EMS (stimulation at a target onset timing), and no EMS. Results: Study 1 identified a sweet spot that significantly improved reaction time while preserving agency. Logistic analysis showed an average sweet spot of 46.8 ms and individual variability across participants. Study 2 confirmed these findings in a pistol-shooting game. Both averagely and individually embodied EMS significantly reduced reaction times compared to no EMS ( P =.03 and P =.001, respectively), without compromising agency. Individually embodied EMS yielded additional benefits. In the slower than average group, the sense of agency in the individually embodied EMS condition showed an additional benefit that was not observed in the averagely embodied EMS condition ( P =.003 and P =, respectively). Conclusions: The findings indicate that embodied EMS enhances performance in complex game scenarios while maintaining users’ sense of agency, with individualization yielding additional benefits. These results extend prior evidence to more complex game contexts and provide valuable implications for the personalized design of EMS systems in sports training, rehabilitation, and serious gaming.
- 14 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1649-1658
Bodily Sensation Map vs. Bodily Motion Map: Visualizing and Analyzing Emotional Body Motions
Emotion detection using features presented in the body has been comparatively understudied compared to other emotional modalities. This study investigated and compared how emotions are revealed through bodily sensations and body movement information. We propose a novel visualization method for addressing body part activation or deactivation associated with different emotions using motion capture data (bodily motion maps; BMMs) and aim to compare its emotional features with existing methods of addressing sensation towards body activation or deactivation using the computerised self-report method (bodily sensation maps; BSMs). A user study is conducted with twenty-nine participants to gather BSMs and BMMs under seven emotional statuses (happy, sad, surprise, angry, disgust, fearful, and neutral). The results indicate that people's BMMs as well as their BSMs contain shared features that can discriminate between emotions. The asynchronies between bodily sensation and body motion existed. Furthermore, convolutional neural network (CNN)-based automatic emotion recognition outperforms humans’ emotion recognition abilities. The implications of the current study's method of comparing emotional features between bodily sensation and body motion for future emotion-related studies for mental disorders are discussed.
- 14 February 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 15 (3) , 1649-1658
Bodily Sensation Map vs. Bodily Motion Map: Visualizing and Analyzing Emotional Body Motions
Emotion detection using features presented in the body has been comparatively understudied compared to other emotional modalities. This study investigated and compared how emotions are revealed through bodily sensations and body movement information. We propose a novel visualization method for addressing body part activation or deactivation associated with different emotions using motion capture data (bodily motion maps; BMMs) and aim to compare its emotional features with existing methods of addressing sensation towards body activation or deactivation using the computerised self-report method (bodily sensation maps; BSMs). A user study is conducted with twenty-nine participants to gather BSMs and BMMs under seven emotional statuses (happy, sad, surprise, angry, disgust, fearful, and neutral). The results indicate that people's BMMs as well as their BSMs contain shared features that can discriminate between emotions. The asynchronies between bodily sensation and body motion existed. Furthermore, convolutional neural network (CNN)-based automatic emotion recognition outperforms humans’ emotion recognition abilities. The implications of the current study's method of comparing emotional features between bodily sensation and body motion for future emotion-related studies for mental disorders are discussed.
- Open Access
- 19 January 2024
- Published by Springer Nature in Virtual Reality
- Vol. 28 (1) , 1-18
Individualized foveated rendering with eye-tracking head-mounted display
Foveated rendering (FR) technology is designed to improve the efficiency of graphical rendering processes. In rendering, individualized approaches can help to balance users’ experiences of visual quality and saving computational resource. However, previous studies have not rigorously examined it related with the FR techniques. To address this issue, we developed an individualized FR (IFR) method using different central vision sizes and peripheral vision resolutions across individuals in virtual reality. In three user studies with 88 participants who were divided into groups designated as “large central area (LCA)” and “small central area (SCA),” the effects of IFR were compared with those of using the full-resolution condition and the average FR condition. The results indicate that the LCA group experienced higher visual quality under the IFR and full-resolution conditions than under the average FR condition. In contrast, the SCA group exhibited comparable levels of dependent measures between the IFR and average FR conditions, but both were lower than those of the full-resolution condition. We also evaluated the computational benefits of the proposed IFR method, and the results demonstrated the effectiveness of our approach in saving resources across the two groups. Although lower-bound adjustments may be required for some users, our overall results suggest that IFR is a malleable technology for enhancing rendering efficiency in virtual reality.
- 19 January 2024
- Published by Springer Nature in Virtual Reality
- Vol. 28 (1) , 1-18
Open AccessIndividualized foveated rendering with eye-tracking head-mounted display
Foveated rendering (FR) technology is designed to improve the efficiency of graphical rendering processes. In rendering, individualized approaches can help to balance users’ experiences of visual quality and saving computational resource. However, previous studies have not rigorously examined it related with the FR techniques. To address this issue, we developed an individualized FR (IFR) method using different central vision sizes and peripheral vision resolutions across individuals in virtual reality. In three user studies with 88 participants who were divided into groups designated as “large central area (LCA)” and “small central area (SCA),” the effects of IFR were compared with those of using the full-resolution condition and the average FR condition. The results indicate that the LCA group experienced higher visual quality under the IFR and full-resolution conditions than under the average FR condition. In contrast, the SCA group exhibited comparable levels of dependent measures between the IFR and average FR conditions, but both were lower than those of the full-resolution condition. We also evaluated the computational benefits of the proposed IFR method, and the results demonstrated the effectiveness of our approach in saving resources across the two groups. Although lower-bound adjustments may be required for some users, our overall results suggest that IFR is a malleable technology for enhancing rendering efficiency in virtual reality.
- Open Access
- 8 November 2022
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 10 (4) , e40119
Impact of Personalized Avatars and Motion Synchrony on Embodiment and Users’ Subjective Experience: Empirical Study
Background: Embodiment through a virtual avatar is a key element for people to feel that they are in the virtual world. Objective: This study aimed to elucidate the interaction between 2 methods of eliciting embodiment through a virtual avatar: motion synchronization and appearance similarity between a human and avatar, to understand embodiment (agency, body ownership, and self-location) and subjective experience (presence, simulator sickness, and emotion) in virtual reality. Methods: Using a full-body motion capture system, 24 participants experienced their virtual avatars with a 3D-scanned face and size-matched body from a first-person perspective. This study used a 2 (motion; sync and async) × 2 (appearance; personalized and generic) within-subject design. Results: The results indicated that agency and body ownership increased when motion and appearance were matched, whereas self-location, presence, and emotion were affected by motion only. Interestingly, if the avatar’s appearance was similar to the participants (personalized avatar), they formed an agency toward the avatar’s motion that was not performed by themselves. Conclusions: Our findings would be applicable in the field of behavioral therapy, rehabilitation, and entertainment applications, by eliciting higher agency with a personalized avatar.
- 8 November 2022
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 10 (4) , e40119
Open AccessImpact of Personalized Avatars and Motion Synchrony on Embodiment and Users’ Subjective Experience: Empirical Study
Background: Embodiment through a virtual avatar is a key element for people to feel that they are in the virtual world. Objective: This study aimed to elucidate the interaction between 2 methods of eliciting embodiment through a virtual avatar: motion synchronization and appearance similarity between a human and avatar, to understand embodiment (agency, body ownership, and self-location) and subjective experience (presence, simulator sickness, and emotion) in virtual reality. Methods: Using a full-body motion capture system, 24 participants experienced their virtual avatars with a 3D-scanned face and size-matched body from a first-person perspective. This study used a 2 (motion; sync and async) × 2 (appearance; personalized and generic) within-subject design. Results: The results indicated that agency and body ownership increased when motion and appearance were matched, whereas self-location, presence, and emotion were affected by motion only. Interestingly, if the avatar’s appearance was similar to the participants (personalized avatar), they formed an agency toward the avatar’s motion that was not performed by themselves. Conclusions: Our findings would be applicable in the field of behavioral therapy, rehabilitation, and entertainment applications, by eliciting higher agency with a personalized avatar.
- 13 October 2022
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 14 (9) , 1951-1964
Social Telecommunication Experience with Full-Body Ownership Humanoid Robot
- 13 October 2022
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 14 (9) , 1951-1964
Social Telecommunication Experience with Full-Body Ownership Humanoid Robot
- Open Access
- 30 June 2020
- Published by Korean Society of Stress Medicine in Stress
- Vol. 28 (2) , 41-50
An Integrative Review of Facial Emotion Information Processing in Depression
- 30 June 2020
- Published by Korean Society of Stress Medicine in Stress
- Vol. 28 (2) , 41-50
Open AccessAn Integrative Review of Facial Emotion Information Processing in Depression
- 30 September 2018
- Published by Korean Society for Emotion and Sensibility in Korean Society for Emotion and Sensibility
- Vol. 21 (3) , 151-164
Effects of Emotional Information on Visual Perception and Working Memory in Biological Motion
- 30 September 2018
- Published by Korean Society for Emotion and Sensibility in Korean Society for Emotion and Sensibility
- Vol. 21 (3) , 151-164
Effects of Emotional Information on Visual Perception and Working Memory in Biological Motion
- Open Access
- 13 October 2017
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (10) , e0186498
Load-sensitive impairment of working memory for biological motion in schizophrenia
Impaired working memory (WM) is a core cognitive deficit in schizophrenia. Nevertheless, past studies have reported that patients may also benefit from increasing salience of memory stimuli. Such efficient encoding largely depends upon precise perception. Thus an investigation on the relationship between perceptual processing and WM would be worthwhile. Here, we used biological motion (BM), a socially relevant stimulus that schizophrenics have difficulty discriminating from similar meaningless motions, in a delayed-response task. Non-BM stimuli and static polygons were also used for comparison. In each trial, one of the three types of stimuli was presented followed by two probes, with a short delay in between. Participants were asked to indicate whether one of them was identical to the memory item or both were novel. The number of memory items was one or two. Healthy controls were more accurate in recognizing BM than non-BM regardless of memory loads. Patients with schizophrenia exhibited similar accuracy patterns to those of controls in the Load 1 condition only. These results suggest that information contained in BM could facilitate WM encoding in general, but the effect is vulnerable to the increase of cognitive load in schizophrenia, implying inefficient encoding driven by imprecise perception.
- 13 October 2017
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 12 (10) , e0186498
Open AccessLoad-sensitive impairment of working memory for biological motion in schizophrenia
Impaired working memory (WM) is a core cognitive deficit in schizophrenia. Nevertheless, past studies have reported that patients may also benefit from increasing salience of memory stimuli. Such efficient encoding largely depends upon precise perception. Thus an investigation on the relationship between perceptual processing and WM would be worthwhile. Here, we used biological motion (BM), a socially relevant stimulus that schizophrenics have difficulty discriminating from similar meaningless motions, in a delayed-response task. Non-BM stimuli and static polygons were also used for comparison. In each trial, one of the three types of stimuli was presented followed by two probes, with a short delay in between. Participants were asked to indicate whether one of them was identical to the memory item or both were novel. The number of memory items was one or two. Healthy controls were more accurate in recognizing BM than non-BM regardless of memory loads. Patients with schizophrenia exhibited similar accuracy patterns to those of controls in the Load 1 condition only. These results suggest that information contained in BM could facilitate WM encoding in general, but the effect is vulnerable to the increase of cognitive load in schizophrenia, implying inefficient encoding driven by imprecise perception.
- Open Access
- 1 August 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (11) , 13
A new technique for generating disordered point-light animations for the study of biological motion perception
Studies of biological motion perception often use stimuli depicting human actions portrayed via point-light (PL) displays. Typically, counterpart, or control, stimuli for PL biological motion are created by spatially scrambling motion trajectories of individual PL dots. Depending on the purpose of the study, however, this procedure may be inappropriate as a foil for genuine PL animations, because spatial scrambling not only disrupts coherent motion activity but also eliminates pair-wise motion relationships among dots and, unless corrected, alters the spatial spread of PL dot motions. We introduce a new technique for producing perturbed PL animations, called pair-wise shuffled motion, that preserves the elementary features of biological motion in spatial and motion energy domains and only disrupts the specific sense of global, coherent perception of biological motion. First we describe the procedure for creating pair-wise shuffled motion sequences. Next we compare unperturbed PL animations to pair-wise shuffled motion, to spatially scrambled motion, and to spatially constrained scrambled motion in terms of spatial distributions of the dots, spatiotemporal amplitude spectra derived from Fourier analysis of those sequences, and space-time motion energy associated with those perturbed animations. We then show that the results from those analyses generalize to a large family of PL animations, including the widely used PL walker. Finally we present results from a two-interval forced-choice biological-motion discrimination experiment comparing the robustness of scrambled and pair-wise shuffled motions as foil stimuli. Results from these comparisons suggest that pair-wise shuffled motion offers advantages as a foil stimulus compared to foils using the conventional scrambling technique. Pair-wise shuffled motion provides an additional, effective control display for evaluating PL biological motion perception in future psychophysical, computational, and imaging studies that focus on mechanisms of processing spatiotemporal information signifying biological motion within PL displays.
- 1 August 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (11) , 13
Open AccessA new technique for generating disordered point-light animations for the study of biological motion perception
Studies of biological motion perception often use stimuli depicting human actions portrayed via point-light (PL) displays. Typically, counterpart, or control, stimuli for PL biological motion are created by spatially scrambling motion trajectories of individual PL dots. Depending on the purpose of the study, however, this procedure may be inappropriate as a foil for genuine PL animations, because spatial scrambling not only disrupts coherent motion activity but also eliminates pair-wise motion relationships among dots and, unless corrected, alters the spatial spread of PL dot motions. We introduce a new technique for producing perturbed PL animations, called pair-wise shuffled motion, that preserves the elementary features of biological motion in spatial and motion energy domains and only disrupts the specific sense of global, coherent perception of biological motion. First we describe the procedure for creating pair-wise shuffled motion sequences. Next we compare unperturbed PL animations to pair-wise shuffled motion, to spatially scrambled motion, and to spatially constrained scrambled motion in terms of spatial distributions of the dots, spatiotemporal amplitude spectra derived from Fourier analysis of those sequences, and space-time motion energy associated with those perturbed animations. We then show that the results from those analyses generalize to a large family of PL animations, including the widely used PL walker. Finally we present results from a two-interval forced-choice biological-motion discrimination experiment comparing the robustness of scrambled and pair-wise shuffled motions as foil stimuli. Results from these comparisons suggest that pair-wise shuffled motion offers advantages as a foil stimulus compared to foils using the conventional scrambling technique. Pair-wise shuffled motion provides an additional, effective control display for evaluating PL biological motion perception in future psychophysical, computational, and imaging studies that focus on mechanisms of processing spatiotemporal information signifying biological motion within PL displays.
- 13 August 2013
- Published by Taylor & Francis in Cognitive Neuropsychiatry
- Vol. 19 (3) , 268-279
Failure to benefit from target novelty during encoding contributes to working memory deficits in schizophrenia
IntroductionAlthough working memory (WM) impairments are well documented in schizophrenic patients (PSZ), the underlying mechanisms are poorly understood. The aim of this study was to investigate the role of target salience during encoding to determine whether impaired visual attention in PSZ leads to poor WM.MethodsThirty-one PSZ and 28 demographically matched healthy controls (HC) performed a spatial delayed-response task. Attentional demands were manipulated during WM encoding by presenting high salient (novel) or low salient (familiar) targets. Participants also rated their level of response confidence at the end of each trial, allowing us to analyse different response types.ResultsWM was impaired in PSZ. Increasing target salience by increasing novelty improved WM performance in HC but not in PSZ. Poor WM performance in PSZ was largely due to an increase in the proportion of incorrect but high confident responses most likely reflecting a failure to encode the correct target.ConclusionsOur findings su...
- 13 August 2013
- Published by Taylor & Francis in Cognitive Neuropsychiatry
- Vol. 19 (3) , 268-279
Failure to benefit from target novelty during encoding contributes to working memory deficits in schizophrenia
IntroductionAlthough working memory (WM) impairments are well documented in schizophrenic patients (PSZ), the underlying mechanisms are poorly understood. The aim of this study was to investigate the role of target salience during encoding to determine whether impaired visual attention in PSZ leads to poor WM.MethodsThirty-one PSZ and 28 demographically matched healthy controls (HC) performed a spatial delayed-response task. Attentional demands were manipulated during WM encoding by presenting high salient (novel) or low salient (familiar) targets. Participants also rated their level of response confidence at the end of each trial, allowing us to analyse different response types.ResultsWM was impaired in PSZ. Increasing target salience by increasing novelty improved WM performance in HC but not in PSZ. Poor WM performance in PSZ was largely due to an increase in the proportion of incorrect but high confident responses most likely reflecting a failure to encode the correct target.ConclusionsOur findings su...