Dongyeon Kim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Dongyeon Kim has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
- Seung-Woo Nam
Seoul National University
5 shared publications - Byoungho Lee
Inter-University Semiconductor Research Center, Department of Electrical and Computer Engineering, Seoul National University, 1 Gwanakro, Gwanak-Gu, Seoul 08826, Republic of Korea
4 shared publications - Yoonchan Jeong
Department of Electrical and Computer Engineering, Seoul National University, Seoul, South Korea
4 shared publications - Alexandre Chapiro
Meta Platforms Inc., Menlo Park, CA, USA
3 shared publications - Rafal Mantiuk
University of Cambridge, Cambridge, United Kingdom
3 shared publications - Gordon Wetzstein
Stanford University
2 shared publications
Latest Publications
- Open Access
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Adapting Quality Metrics to Tone Mapping
- 19 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessAdapting Quality Metrics to Tone Mapping
- Open Access
- 14 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Supra-threshold Contrast Perception in Augmented Reality
- 14 December 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessSupra-threshold Contrast Perception in Augmented Reality
- Open Access
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-11
AR-DAVID: Augmented Reality Display Artifact Video Dataset
The perception of visual content in optical-see-through augmented reality (AR) devices is affected by the light coming from the environment. This additional light interacts with the content in a non-trivial manner because of the illusion of transparency, different focal depths, and motion parallax. To investigate the impact of environment light on display artifact visibility (such as blur or color fringes), we created the first subjective quality dataset targeted toward augmented reality displays. Our study consisted of 6 scenes, each affected by one of 6 distortions at two strength levels, seen against one of 3 background patterns shown at 2 luminance levels: 432 conditions in total. Our dataset shows that environment light has a much smaller masking effect than expected. Further, we show that this effect cannot be explained by compositing of the AR-content with the background using optical blending models. As a consequence, we demonstrate that existing video quality metrics perform worse than expected when predicting the perceived magnitude of degradation in AR displays, motivating further research.
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-11
Open AccessAR-DAVID: Augmented Reality Display Artifact Video Dataset
The perception of visual content in optical-see-through augmented reality (AR) devices is affected by the light coming from the environment. This additional light interacts with the content in a non-trivial manner because of the illusion of transparency, different focal depths, and motion parallax. To investigate the impact of environment light on display artifact visibility (such as blur or color fringes), we created the first subjective quality dataset targeted toward augmented reality displays. Our study consisted of 6 scenes, each affected by one of 6 distortions at two strength levels, seen against one of 3 background patterns shown at 2 luminance levels: 432 conditions in total. Our dataset shows that environment light has a much smaller masking effect than expected. Further, we show that this effect cannot be explained by compositing of the AR-content with the background using optical blending models. As a consequence, we demonstrate that existing video quality metrics perform worse than expected when predicting the perceived magnitude of degradation in AR displays, motivating further research.
- Open Access
- 19 July 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (4) , 1-13
Holographic Parallax Improves 3D Perceptual Realism
Holographic near-eye displays are a promising technology to solve long-standing challenges in virtual and augmented reality display systems. Over the last few years, many different computer-generated holography (CGH) algorithms have been proposed that are supervised by different types of target content, such as 2.5D RGB-depth maps, 3D focal stacks, and 4D light fields. It is unclear, however, what the perceptual implications are of the choice of algorithm and target content type. In this work, we build a perceptual testbed of a full-color, high-quality holographic near-eye display. Under natural viewing conditions, we examine the effects of various CGH supervision formats and conduct user studies to assess their perceptual impacts on 3D realism. Our results indicate that CGH algorithms designed for specific viewpoints exhibit noticeable deficiencies in achieving 3D realism. In contrast, holograms incorporating parallax cues consistently outperform other formats across different viewing conditions, including the center of the eyebox. This finding is particularly interesting and suggests that the inclusion of parallax cues in CGH rendering plays a crucial role in enhancing the overall quality of the holographic experience. This work represents an initial stride towards delivering a perceptually realistic 3D experience with holographic near-eye displays.
- 19 July 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (4) , 1-13
Open AccessHolographic Parallax Improves 3D Perceptual Realism
Holographic near-eye displays are a promising technology to solve long-standing challenges in virtual and augmented reality display systems. Over the last few years, many different computer-generated holography (CGH) algorithms have been proposed that are supervised by different types of target content, such as 2.5D RGB-depth maps, 3D focal stacks, and 4D light fields. It is unclear, however, what the perceptual implications are of the choice of algorithm and target content type. In this work, we build a perceptual testbed of a full-color, high-quality holographic near-eye display. Under natural viewing conditions, we examine the effects of various CGH supervision formats and conduct user studies to assess their perceptual impacts on 3D realism. Our results indicate that CGH algorithms designed for specific viewpoints exhibit noticeable deficiencies in achieving 3D realism. In contrast, holograms incorporating parallax cues consistently outperform other formats across different viewing conditions, including the center of the eyebox. This finding is particularly interesting and suggests that the inclusion of parallax cues in CGH rendering plays a crucial role in enhancing the overall quality of the holographic experience. This work represents an initial stride towards delivering a perceptually realistic 3D experience with holographic near-eye displays.
- Open Access
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Holographic Parallax
Cutting-edge computer-generated holography (CGH) algorithms have realized significant advancements in reconstructing the desired light field, enabling the creation of 4D light field holograms. These holograms offer view-dependent effects, such as motion parallax, occlusion, and specular reflections, which are crucial for enhancing the perceptual realism of 3D scenes. Our holographic display prototype leverages sophisticated CGH algorithms in conjunction with a high-speed binary spatial light modulator (SLM) to deliver an immersive experience of 4D light field holograms. This demonstration highlights the latest progress in CGH technology and emphasizes the critical role of parallax cues in providing perceptually realistic 3D contents.
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessHolographic Parallax
Cutting-edge computer-generated holography (CGH) algorithms have realized significant advancements in reconstructing the desired light field, enabling the creation of 4D light field holograms. These holograms offer view-dependent effects, such as motion parallax, occlusion, and specular reflections, which are crucial for enhancing the perceptual realism of 3D scenes. Our holographic display prototype leverages sophisticated CGH algorithms in conjunction with a high-speed binary spatial light modulator (SLM) to deliver an immersive experience of 4D light field holograms. This demonstration highlights the latest progress in CGH technology and emphasizes the critical role of parallax cues in providing perceptually realistic 3D contents.
- 17 June 2024
- Published by Optica Publishing Group in Optics Express
- Vol. 32 (14) , 23975-23988
Full-color time-sequential super multi-view near-eye display with front-lit waveguide illumination
Light field (LF) displays can offer a quasi-natural three-dimensional (3D) viewing experience by tailoring the four-dimensional light information. However, the primary drawback of conventional LF displays is their limited image quality due to restricted information. To address this limitation, time-multiplexing techniques are employed, but the resulting system configurations are often impractical for achieving compact systems. Here, we present a compact time-sequential super multi-view LF near-eye display integrated with a front-lit, multi-directional illumination module for virtual reality application. This illumination module consists of an RGB light-emitting diode array and a waveguide, allowing us to exploit a high-speed reflective-type spatial light modulator and provide high-bit depth, full-color 3D scenes with quasi-continuous parallax in a compact form factor display. The prototype is implemented for a live demo and evaluated with both simulation and experiment. Our work provides a viable path towards the wide adoption of 3D virtual reality head-mounted displays.
- 17 June 2024
- Published by Optica Publishing Group in Optics Express
- Vol. 32 (14) , 23975-23988
Full-color time-sequential super multi-view near-eye display with front-lit waveguide illumination
Light field (LF) displays can offer a quasi-natural three-dimensional (3D) viewing experience by tailoring the four-dimensional light information. However, the primary drawback of conventional LF displays is their limited image quality due to restricted information. To address this limitation, time-multiplexing techniques are employed, but the resulting system configurations are often impractical for achieving compact systems. Here, we present a compact time-sequential super multi-view LF near-eye display integrated with a front-lit, multi-directional illumination module for virtual reality application. This illumination module consists of an RGB light-emitting diode array and a waveguide, allowing us to exploit a high-speed reflective-type spatial light modulator and provide high-bit depth, full-color 3D scenes with quasi-continuous parallax in a compact form factor display. The prototype is implemented for a live demo and evaluated with both simulation and experiment. Our work provides a viable path towards the wide adoption of 3D virtual reality head-mounted displays.
- Open Access
Depolarized Holography with Polarization-multiplexing Metasurface
The evolution of computer-generated holography (CGH) algorithms has prompted significant improvements in the performances of holographic displays. Nonetheless, they start to encounter a limited degree of freedom in CGH optimization and physical constraints stemming from the coherent nature of holograms. To surpass the physical limitations, we consider polarization as a new degree of freedom by utilizing a novel optical platform called metasurface. Polarization-multiplexing metasurfaces enable incoherent-like behavior in holographic displays due to the mutual incoherence of orthogonal polarization states. We leverage this unique characteristic of a metasurface by integrating it into a holographic display and exploiting polarization diversity to bring an additional degree of freedom for CGH algorithms. To minimize the speckle noise while maximizing the image quality, we devise a fully differentiable optimization pipeline by taking into account the metasurface proxy model, thereby jointly optimizing spatial light modulator phase patterns and geometric parameters of metasurface nanostructures. We evaluate the metasurface-enabled depolarized holography through simulations and experiments, demonstrating its ability to reduce speckle noise and enhance image quality.
Open AccessDepolarized Holography with Polarization-multiplexing Metasurface
The evolution of computer-generated holography (CGH) algorithms has prompted significant improvements in the performances of holographic displays. Nonetheless, they start to encounter a limited degree of freedom in CGH optimization and physical constraints stemming from the coherent nature of holograms. To surpass the physical limitations, we consider polarization as a new degree of freedom by utilizing a novel optical platform called metasurface. Polarization-multiplexing metasurfaces enable incoherent-like behavior in holographic displays due to the mutual incoherence of orthogonal polarization states. We leverage this unique characteristic of a metasurface by integrating it into a holographic display and exploiting polarization diversity to bring an additional degree of freedom for CGH algorithms. To minimize the speckle noise while maximizing the image quality, we devise a fully differentiable optimization pipeline by taking into account the metasurface proxy model, thereby jointly optimizing spatial light modulator phase patterns and geometric parameters of metasurface nanostructures. We evaluate the metasurface-enabled depolarized holography through simulations and experiments, demonstrating its ability to reduce speckle noise and enhance image quality.
- 1 January 2023
- Published by Optica Publishing Group
- Vol. 6, JW2A.18
Hologram generation method for color correction
In holographic displays, the color of reconstructed images often experiences a shift due to the light source's spectral property. To tackle this issue, we propose a method that incorporates both the laser and the camera into the optimization loop. Additionally, we employ a cascaded hologram optimization strategy to expedite the video hologram generation process. The simulation results effectively substantiate the efficacy of our proposed method.
- 1 January 2023
- Published by Optica Publishing Group
- Vol. 6, JW2A.18
Hologram generation method for color correction
In holographic displays, the color of reconstructed images often experiences a shift due to the light source's spectral property. To tackle this issue, we propose a method that incorporates both the laser and the camera into the optimization loop. Additionally, we employ a cascaded hologram optimization strategy to expedite the video hologram generation process. The simulation results effectively substantiate the efficacy of our proposed method.
- Open Access
- 22 July 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 41 (4) , 1-15
Accommodative holography
Holographic displays have gained unprecedented attention as next-generation virtual and augmented reality applications with recent achievements in the realization of a high-contrast image through computer-generated holograms (CGHs). However, these holograms show a high energy concentration in a limited angular spectrum, whereas the holograms with uniformly distributed angular spectrum suffer from a severe speckle noise in the reconstructed images. In this study, we claim that these two physical phenomena attributed to the existing CGHs significantly limit the support of accommodation cues, which is known as one of the biggest advantages of holographic displays. To support the statement, we analyze and evaluate various CGH algorithms with contrast gradients - a change of contrast over the change of the focal diopter of the eye - simulated based on the optical configuration of the display system and human visual perception models. We first introduce two approaches to improve monocular accommodation response in holographic viewing experience; optical and computational approaches to provide holographic images with sufficient contrast gradients. We design and conduct user experiments with our prototype of holographic near-eye displays, validating the deficient support of accommodation cues in the existing CGH algorithms and demonstrating the feasibility of the proposed solutions with significant improvements on accommodative gains.
- 22 July 2022
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 41 (4) , 1-15
Open AccessAccommodative holography
Holographic displays have gained unprecedented attention as next-generation virtual and augmented reality applications with recent achievements in the realization of a high-contrast image through computer-generated holograms (CGHs). However, these holograms show a high energy concentration in a limited angular spectrum, whereas the holograms with uniformly distributed angular spectrum suffer from a severe speckle noise in the reconstructed images. In this study, we claim that these two physical phenomena attributed to the existing CGHs significantly limit the support of accommodation cues, which is known as one of the biggest advantages of holographic displays. To support the statement, we analyze and evaluate various CGH algorithms with contrast gradients - a change of contrast over the change of the focal diopter of the eye - simulated based on the optical configuration of the display system and human visual perception models. We first introduce two approaches to improve monocular accommodation response in holographic viewing experience; optical and computational approaches to provide holographic images with sufficient contrast gradients. We design and conduct user experiments with our prototype of holographic near-eye displays, validating the deficient support of accommodation cues in the existing CGH algorithms and demonstrating the feasibility of the proposed solutions with significant improvements on accommodative gains.
- 1 August 2020
- Published by Wiley in SID Symposium Digest of Technical Papers
- Vol. 51 (1) , 1660-1663
P‐81: Holographic Near‐to‐Eye Display for Vision‐Correcting Application
Holographic near‐to‐eye display for vision‐correcting application is introduced by manipulating the hologram rather than modifying the optical system. The aberration corrected hologram is acquired considering overall optical system as well as eye lens. The hologram rendering is mainly based on complex ray tracing that each ray not only contains amplitude but also phase information due to calculated optical path. In experiment, the overall setup for holographic near‐to‐eye display is implemented with an imaging lens containing high numerical aperture that resembles actual human eye lens. This approach is highly effective in providing aberration corrected hologram since it does not require any manual manipulation in compensating the hologram. In the near future, this approach will allow users to have prescribed holograms depending on the structure of individual eye.
- 1 August 2020
- Published by Wiley in SID Symposium Digest of Technical Papers
- Vol. 51 (1) , 1660-1663
P‐81: Holographic Near‐to‐Eye Display for Vision‐Correcting Application
Holographic near‐to‐eye display for vision‐correcting application is introduced by manipulating the hologram rather than modifying the optical system. The aberration corrected hologram is acquired considering overall optical system as well as eye lens. The hologram rendering is mainly based on complex ray tracing that each ray not only contains amplitude but also phase information due to calculated optical path. In experiment, the overall setup for holographic near‐to‐eye display is implemented with an imaging lens containing high numerical aperture that resembles actual human eye lens. This approach is highly effective in providing aberration corrected hologram since it does not require any manual manipulation in compensating the hologram. In the near future, this approach will allow users to have prescribed holograms depending on the structure of individual eye.