HSHyewon Song

Hyewon Song

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Hyewon Song has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Facial Animation Strategies for Improved Emotional Expression in Virtual Reality

    by Hyewon Song, Beom Kwon

    The portrayal of emotions by virtual characters is crucial in virtual reality (VR) communication. Effective communication in VR relies on a shared understanding, which is significantly enhanced when virtual characters authentically express emotions that align with their spoken words. While human emotions are often conveyed through facial expressions, existing facial animation techniques have mainly focused on lip-syncing and head movements to improve naturalness. This study investigates the influence of various factors in facial animation on the emotional representation of virtual characters. We conduct a comparative and analytical study using an audio-visual database, examining the impact of different animation factors. To this end, we utilize a total of 24 voice samples, representing 12 different speakers, with each emotional voice segment lasting approximately 4–5 s. Using these samples, we design six perceptual experiments to investigate the impact of facial cues—including facial expression, lip movement, head motion, and overall appearance—on the expression of emotions by virtual characters. Additionally, we engaged 20 participants to evaluate and select appropriate combinations of facial expressions, lip movements, head motions, and appearances that align with the given emotion and its intensity. Our findings indicate that emotional representation in virtual characters is closely linked to facial expressions, head movements, and overall appearance. Conversely, lip-syncing, which has been a primary focus in prior studies, seems less critical for conveying emotions, as its accuracy is difficult to perceive with the naked eye. The results of our study can significantly benefit the VR community by aiding in the development of virtual characters capable of expressing a diverse range of emotions.


  • Open Access

    A Selective Expression Manipulation With Parametric 3D Facial Model

    by Jiwoo Kang, Hyewon Song, Kyoungoh Lee, Sanghoon Lee

    This paper proposes a novel method to represent expressive 3D facial shapes called the Selective Expression Manipulation (SEM) by fitting the expression coefficients of delta-blendshapes, which is the standard parametric facial model widely used in industries. SEM focuses on preserving blendshape semantics to characterize the facial shapes since the facial shape obtained by minimizing the distance to sparse facial landmarks might fail to signify a facial expression from a human being’s perspective. Assuming each delta-blendshape corresponds to a facial movement with semantic meaning, SEM finds a series of facial motions required to compose the target facial expression. In addition, SEM sequentially determines a sufficient number of expressions and coefficients closely resembling the target facial movements by introducing similarities to quantify the directional correlation of facial motions between a target and a blendshape, excluding redundant expressions in terms of motions from the neutral shape. As a result, far fewer inter-correlated expressions that significantly increase the target correlation can be obtained. Furthermore, SEM exhibits substantial improvement in accuracy, correlation, semantics, and stability in experiments over previous facial fitting schemes and state-of-the-art methods. It is demonstrated that SEM enables accurate and realistic 3D facial shape generation by semantically manipulating expression delta-blendshapes.


  • Open Access

    Local Spherical Harmonics for Facial Shape and Albedo Estimation

    by Suwoong Heo, Hyewon Song, Jiwoo Kang, Sanghoon Lee

    In this paper, we present a novel facial albedo and 3D shape recovery method with a local spherical harmonic illumination model. From a face in an image, the proposed method can produce a high-quality 3D shape and albedo using a novel parameterization of local illuminations. Because a facial shape is partially convex, a single spherical harmonics is generally used for the illumination of a face within a constrained illumination environment. However, when a facial image is captured in an unconstrained scene, the illumination is inappropriately estimated due to the presence of shadow and specular reflections. To address this issue, we propose a novel local spherical harmonic illumination model for representing the illumination of a face. Unlike the existing parameterization of local illumination, our local spherical harmonic illumination model utilizes a smooth weight function for the seamless representation of natural illumination. Therefore, the albedo and shape information in an image can be precisely estimated using the first-order spherical harmonics. For accurate estimation of albedo, we also utilize facial albedo statistics to prevent the estimated albedo from becoming biased toward input image. Furthermore, we developed an accurate and reliable 3D shape reconstruction method from a normal map based on tetrahedron-based deformation. Comparing to the Laplacian deformation based method, our method is applicable to any mesh regardless of its structure. Through rigorous experiments, we demonstrate that the proposed local spherical harmonic illumination model is effective in estimating the complex illumination and can recover a high-quality facial albedo and 3D shape.


  • Open Access

    Partial Gated Feedback Recurrent Neural Network for Data Compression Type Classification

    by Hyewon Song, Beom Kwon, Hoon Yoo, Sanghoon Lee

    Owing to the widespread use of digital devices such as mobile phones and tablet PCs that are capable of easily viewing contents, the number of digital crimes committed using these digital devices has increased. One of the most common digital crimes is to hide the header information of the compressed data, which makes the user’s data unusable. It is difficult to restore original data without the header because header contains the compression type. In this paper, we propose a Partial Gated Feedback Recurrent Neural Network (PGF-RNN) for the identification of lossless compression algorithms. We modify the gated recurrent units to improve the correlation of layers by grouping the fully-connected layers to effectively determine the characteristics of the compressed data. We emphasize on the temporal features, which consider a wide range of data, and spatial features from fully-connected layers to extract the feature vectors of each compression type. To improve the performance of the proposed PGF-RNN, we apply post-processing that considers the frequency of bit sequences on some compression types with similar compressed data. The proposed method is evaluated on 31 well-known lossless compression algorithms of the Association for Computational Linguistics dataset. The average top 1 accuracy of the proposed method is 92.63%.


  • Open Access

    Accurate Blind Lempel-Ziv-77 Parameter Estimation via 1-D to 2-D Data Conversion Over Convolutional Neural Network

    by Beom Kwon, Hyewon Song, Sanghoon Lee

    The data sequence compressed using the Lempel-Ziv-77 (LZ77) algorithm comprises a series of fixed-length tuples. To decompress this data, it is essential to know the encoding parameters such as the tuple length used for the compression. If this essential information becomes unavailable owing to conditions such as loss of the header, it is difficult to accurately determine the parameters using the compressed data. In this study, we investigate the blind estimation of tuple length from the LZ77-compressed data when the header is unavailable. To this end, we propose a novel idea of utilizing the LZ77 image generated from the LZ77-compressed data. The LZ77 image exhibits unique patterns based on the image size. The correlation between the image size and tuple length is indicated by different patterns of vertical lines in the LZ77 image. By exploiting a convolutional neural network (CNN), we develop an iterative algorithm while generating LZ77 images with different size. The results of the experiment on a public database show that the LZ77 image plays the role of an extremely powerful visual feature descriptor, and the proposed iterative algorithm estimates the tuple length with 100% accuracy.


  • Performance comparisons of array invariant and matched field processing using broadband ship noise and a tilted vertical array

    by Gihoon Byun, H. C. Song, J. S. Kim

    This paper compares the localization performance of array invariant (AI) and matched field processing (MFP) using a ship of opportunity radiating random noise (200–900 Hz) and a tilted vertical array. AI is a deterministic approach to source-range estimation (i.e., depth-blind), exploiting the dispersion characteristics of broadband signals with minimal/no knowledge of the environment in shallow water. It involves time-domain plane-wave beamforming to separate multiple coherent arrivals (eigenrays) in beam angle and travel time, called “beam-time migration,” from which the source range is directly estimated. In contrast, MFP is a model-based approach that requires accurate knowledge of the environment and array geometry (e.g., array tilt) to generate “replicas” for all possible source locations, finding the best match in the two-dimensional ambiguity surface of range and depth. While AI and MFP are both sensitive to array tilt, AI is equipped with self-calibration capability to estimate the array tilt and source range simultaneously. With the array tilt information from AI incorporated, the performance of MFP for range estimation can be comparable to that of AI to such an extent that the environmental knowledge is accurate.


  • Diversity-based acoustic communication with a glider in deep water

    by H. C. Song, Bruce M. Howe, Michael G. Brown, Rex K. Andrew

    The primary use of underwater gliders is to collect oceanographic data within the water column and periodically relay the data at the surface via a satellite connection. In summer 2006, a Seaglider equipped with an acoustic recording system received transmissions from a broadband acoustic source centered at 75 Hz deployed on the bottom off Kauai, Hawaii, while moving away from the source at ranges up to ∼200 km in deep water and diving up to 1000-m depth. The transmitted signal was an m-sequence that can be treated as a binary-phase shift-keying communication signal. In this letter multiple receptions are exploited (i.e., diversity combining) to demonstrate the feasibility of using the glider as a mobile communication gateway.


  • High-rate synthetic aperture communications in shallow water

    by H. C. Song, W. S. Hodgkiss, W. A. Kuperman, T. Akal, M. Stevenson

    Time reversal communication exploits spatial diversity to achieve spatial and temporal focusing in complex ocean environments. Spatial diversity can be provided easily by a vertical array in a waveguide. Alternatively, spatial diversity can be obtained from a virtual horizontal array generated by two elements, a transmitter and a receiver, due to relative motion between them, referred to as a synthetic aperture. This paper presents coherent synthetic aperture communication results from at-sea experiments conducted in two different frequency bands: (1) 2-4 kHz and (2) 8-20 kHz. Case (1) employs binary-phase shift-keying modulation, while case (2) involves up to eight-phase shift keying modulation with a data rate of 30 kbits/s divided by the number of transmissions (diversity) to be accumulated. The receiver utilizes time reversal diversity combining followed by a single channel equalizer, with frequent channel updates to accommodate the time-varying channel due to coupling of space and time in the presence of motion. Two to five consecutive transmissions from a source moving at 4 kts over 3-6 km range in shallow water are combined successfully after Doppler compensation, confirming the feasibility of coherent synthetic aperture communications using time reversal.


  • Open Access

    Null-broadening in a waveguide

    by J. S. Kim, W. S. Hodgkiss, W. A. Kuperman, H. C. Song

    Null-broadening, introduced in plane wave beamforming, is extended to an ocean waveguide in the context of matched field processing. The method is based on the minimum variance processor with white noise constraint and the distribution of fictitious sources using the theory of waveguide invariants. The proposed method is demonstrated in simulation as well as with data collected during the SWellEx-96 experiment. As another application, it is shown that the width of a null can be controlled in an adaptive time reversal mirror with a source-receive array.