Junseok Kim
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Junseok Kim has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Juhyun Ko
Samsung Electronics, Hwaseong 18448, Gyeonggi-do, Republic of Korea
5 shared publications - Paul K. J. Park
Samsung Electronics, Hwaseong 18448, Gyeonggi-do, Republic of Korea
5 shared publications - Yeoungjin Chang
Department of Semiconductor Display, Gachon University, Seongnam 13120, Gyeonggi-do, Republic of Korea
3 shared publications
Latest Publications
- Open Access
Hybrid Event–Frame Sensing for Human-Perceptual Imaging and Machine Vision
Frame-based RGB image sensors and event-based vision sensors provide complementary sensing capabilities for human-perceptual imaging and machine vision. RGB image sensors capture dense spatial, color, and texture information that is essential for human-viewable imaging, semantic recognition, and conventional image signal processing pipelines. In contrast, dynamic vision sensors (DVSs) and event vision sensors (EVSs) asynchronously detect local brightness changes and provide sparse temporal information with low latency, high temporal resolution, and reduced redundant data output. Because neither modality alone satisfies all requirements of emerging vision systems, hybrid event–frame sensing has become an important direction for compact, low-latency, and energy-efficient sensing. This review presents a sensor-oriented taxonomy of hybrid event–frame sensing architectures and systems, including dual-camera event–frame systems, optically aligned event–frame systems, pixel-level shared hybrid image sensors, stacked CIS–DVS hybrid image sensors, homogeneous-pixel sensing systems, and event-only reconstruction systems. We analyze key sensor specifications, including latency, spatial resolution, color fidelity, power consumption, and form factor, and discuss how these specifications guide sensor configuration and design. The review identifies stacked CIS–DVS sensors as one of the most balanced and competitive architectures because they can support compact integration, synchronized event–frame sensing, and on-chip processing. However, important challenges remain, including color fidelity, demosaicing, event-pixel ratio optimization, calibration, benchmarking, and edge-AI deployment. Finally, we emphasize that future hybrid event–frame sensing systems should be developed through sensor–algorithm–ISP–AI co-design. This review provides practical guidelines for developing next-generation hybrid event–frame sensing systems for both human-perceptual imaging and machine vision.
Open AccessHybrid Event–Frame Sensing for Human-Perceptual Imaging and Machine Vision
Frame-based RGB image sensors and event-based vision sensors provide complementary sensing capabilities for human-perceptual imaging and machine vision. RGB image sensors capture dense spatial, color, and texture information that is essential for human-viewable imaging, semantic recognition, and conventional image signal processing pipelines. In contrast, dynamic vision sensors (DVSs) and event vision sensors (EVSs) asynchronously detect local brightness changes and provide sparse temporal information with low latency, high temporal resolution, and reduced redundant data output. Because neither modality alone satisfies all requirements of emerging vision systems, hybrid event–frame sensing has become an important direction for compact, low-latency, and energy-efficient sensing. This review presents a sensor-oriented taxonomy of hybrid event–frame sensing architectures and systems, including dual-camera event–frame systems, optically aligned event–frame systems, pixel-level shared hybrid image sensors, stacked CIS–DVS hybrid image sensors, homogeneous-pixel sensing systems, and event-only reconstruction systems. We analyze key sensor specifications, including latency, spatial resolution, color fidelity, power consumption, and form factor, and discuss how these specifications guide sensor configuration and design. The review identifies stacked CIS–DVS sensors as one of the most balanced and competitive architectures because they can support compact integration, synchronized event–frame sensing, and on-chip processing. However, important challenges remain, including color fidelity, demosaicing, event-pixel ratio optimization, calibration, benchmarking, and edge-AI deployment. Finally, we emphasize that future hybrid event–frame sensing systems should be developed through sensor–algorithm–ISP–AI co-design. This review provides practical guidelines for developing next-generation hybrid event–frame sensing systems for both human-perceptual imaging and machine vision.
- Open Access
- 27 June 2026
- Published by MDPI AG in Electronics
- Vol. 15 (13) , 2828
Low-Latency Machine Vision Based on a Neuromorphic Vision Sensor
Low-latency visual perception is essential for interactive machine vision on edge AI devices, but conventional frame-based image sensors impose frame period delays and generate dense image data that increase memory bandwidth and processing latency. Although Dynamic Vision Sensors (DVSs) are known to provide low latency, sparse output, and high dynamic range, these sensor-level properties do not automatically translate into practical application-level latency reduction on resource-constrained edge platforms. This paper presents a latency-driven sensing algorithm co-design approach for DVS-based low-latency machine vision. The main objective is to connect DVS sensor-level characteristics, event representations, task-dependent processing flows, and measured response times on mobile application processors. We first analyze latency requirements for three representative edge AI applications (i.e., person detection, gesture recognition, and Simultaneous Localization and Mapping (SLAM)), which correspond to different latency regimes and processing structures. We then describe the DVS operating principle, pixel-level event latency, and readout latency, showing how asynchronous event generation reduces sensing delay and suppresses redundant static background information before algorithmic processing. In contrast to prior event camera studies that mainly optimize a single task or a specific event representation, this work evaluates three task-specific event processing systems on mobile processors. Person detection achieves 92 ms processing latency on Exynos 7570, gesture recognition based on event-driven 4-DoF motion estimation achieves 20 ms latency on Exynos 5422, and SLAM achieves 15.9 ms latency on Snapdragon 845. These results satisfy the practical latency targets of the corresponding applications and demonstrate that DVS-based sensing can provide not only sensor-level speed advantages but also system-level latency benefits for AIoT, mobile, robotics, and AR/VR machine vision systems.
- 27 June 2026
- Published by MDPI AG in Electronics
- Vol. 15 (13) , 2828
Open AccessLow-Latency Machine Vision Based on a Neuromorphic Vision Sensor
Low-latency visual perception is essential for interactive machine vision on edge AI devices, but conventional frame-based image sensors impose frame period delays and generate dense image data that increase memory bandwidth and processing latency. Although Dynamic Vision Sensors (DVSs) are known to provide low latency, sparse output, and high dynamic range, these sensor-level properties do not automatically translate into practical application-level latency reduction on resource-constrained edge platforms. This paper presents a latency-driven sensing algorithm co-design approach for DVS-based low-latency machine vision. The main objective is to connect DVS sensor-level characteristics, event representations, task-dependent processing flows, and measured response times on mobile application processors. We first analyze latency requirements for three representative edge AI applications (i.e., person detection, gesture recognition, and Simultaneous Localization and Mapping (SLAM)), which correspond to different latency regimes and processing structures. We then describe the DVS operating principle, pixel-level event latency, and readout latency, showing how asynchronous event generation reduces sensing delay and suppresses redundant static background information before algorithmic processing. In contrast to prior event camera studies that mainly optimize a single task or a specific event representation, this work evaluates three task-specific event processing systems on mobile processors. Person detection achieves 92 ms processing latency on Exynos 7570, gesture recognition based on event-driven 4-DoF motion estimation achieves 20 ms latency on Exynos 5422, and SLAM achieves 15.9 ms latency on Snapdragon 845. These results satisfy the practical latency targets of the corresponding applications and demonstrate that DVS-based sensing can provide not only sensor-level speed advantages but also system-level latency benefits for AIoT, mobile, robotics, and AR/VR machine vision systems.
- Open Access
Event-Based Machine Vision for Edge AI Computing
Event-based sensors provide sparse, motion-centric measurements that can reduce data bandwidth and enable always-on perception on resource-constrained edge devices. This paper presents an event-based machine vision framework for smart-home AIoT that couples a Dynamic Vision Sensor (DVS) with compute-efficient algorithms for (i) human/object detection, (ii) 2D human pose estimation, (iii) hand posture recognition for human–machine interfaces. The main methodological contributions are timestamp-based, polarity-agnostic recency encoding that preserves moving-edge structure while suppressing static background, and task-specific network optimizations (architectural reduction and mixed-bit quantization) tailored to sparse event images. With a fixed downstream network, the recency encoding improves action recognition accuracy over temporal accumulation (0.908 vs. 0.896). In a 24 h indoor monitoring experiment (640 × 480), the raw DVS stream is about 30× smaller than conventional CMOS video and remains about 5× smaller after standard compression. For human detection, the optimized event processing reduces computation from 5.8 G to 81 M FLOPs and runtime from 172 ms to 15 ms (more than 11× speed-up). For pose estimation, a pruned HRNet reduces model size from 127 MB to 19 MB and inference time from 70 ms to 6 ms on an NVIDIA Titan X while maintaining a comparable accuracy (mAP from 0.95 to 0.94) on MS COCO 2017 using synthetic event streams generated by an event simulator. For hand posture recognition, a compact CNN achieves 99.19% recall and 0.0926% FAR with 14.31 ms latency on a single i5-4590 CPU core using 10-frame sequence voting. These results indicate that event-based sensing combined with lightweight inference is a practical approach to privacy-friendly, real-time perception under strict edge constraints.
Open AccessEvent-Based Machine Vision for Edge AI Computing
Event-based sensors provide sparse, motion-centric measurements that can reduce data bandwidth and enable always-on perception on resource-constrained edge devices. This paper presents an event-based machine vision framework for smart-home AIoT that couples a Dynamic Vision Sensor (DVS) with compute-efficient algorithms for (i) human/object detection, (ii) 2D human pose estimation, (iii) hand posture recognition for human–machine interfaces. The main methodological contributions are timestamp-based, polarity-agnostic recency encoding that preserves moving-edge structure while suppressing static background, and task-specific network optimizations (architectural reduction and mixed-bit quantization) tailored to sparse event images. With a fixed downstream network, the recency encoding improves action recognition accuracy over temporal accumulation (0.908 vs. 0.896). In a 24 h indoor monitoring experiment (640 × 480), the raw DVS stream is about 30× smaller than conventional CMOS video and remains about 5× smaller after standard compression. For human detection, the optimized event processing reduces computation from 5.8 G to 81 M FLOPs and runtime from 172 ms to 15 ms (more than 11× speed-up). For pose estimation, a pruned HRNet reduces model size from 127 MB to 19 MB and inference time from 70 ms to 6 ms on an NVIDIA Titan X while maintaining a comparable accuracy (mAP from 0.95 to 0.94) on MS COCO 2017 using synthetic event streams generated by an event simulator. For hand posture recognition, a compact CNN achieves 99.19% recall and 0.0926% FAR with 14.31 ms latency on a single i5-4590 CPU core using 10-frame sequence voting. These results indicate that event-based sensing combined with lightweight inference is a practical approach to privacy-friendly, real-time perception under strict edge constraints.
- Open Access
High-Speed Image Restoration Based on a Dynamic Vision Sensor
We report on the post-capture, on-demand deblurring technique based on a Dynamic Vision Sensor (DVS). Motion blur causes photographic defects inherently in most use cases of mobile cameras. To compensate for motion blur in mobile photography, we use a fast event-based vision sensor. However, in this paper, we found severe artifacts resulting in image quality degradation caused by color ghosts, event noises, and discrepancies between conventional image sensors and event-based sensors. To overcome these inevitable artifacts, we propose and demonstrate event-based compensation techniques such as cross-correlation optimization, contrast maximization, resolution mismatch compensation (event upsampling for alignment), and disparity matching. The results show that the deblur performance can be improved dramatically in terms of metrics such as the Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), and Spatial Frequency Response (SFR). Thus, we expect that the proposed event-based image restoration technique can be widely deployed in mobile cameras.
Open AccessHigh-Speed Image Restoration Based on a Dynamic Vision Sensor
We report on the post-capture, on-demand deblurring technique based on a Dynamic Vision Sensor (DVS). Motion blur causes photographic defects inherently in most use cases of mobile cameras. To compensate for motion blur in mobile photography, we use a fast event-based vision sensor. However, in this paper, we found severe artifacts resulting in image quality degradation caused by color ghosts, event noises, and discrepancies between conventional image sensors and event-based sensors. To overcome these inevitable artifacts, we propose and demonstrate event-based compensation techniques such as cross-correlation optimization, contrast maximization, resolution mismatch compensation (event upsampling for alignment), and disparity matching. The results show that the deblur performance can be improved dramatically in terms of metrics such as the Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), and Spatial Frequency Response (SFR). Thus, we expect that the proposed event-based image restoration technique can be widely deployed in mobile cameras.
- Open Access
Motion Blur-Free High-Speed Hybrid Image Sensing
We propose and demonstrate a novel motion blur-free hybrid image sensing technique. Unlike the previous hybrid image sensors, we developed a homogeneous hybrid image sensing technique including 60 fps CMOS Image Sensor (CIS) and 1440 fps pseudo Dynamic Vision Sensor (DVS) image frames without any performance degradation caused by static bad pixels. To achieve the fast readout, we implemented two one-side ADCs on two photodiodes (PDs) and the pixel output settling time can be reduced significantly by using the column switch control. The high-speed pseudo DVS frame can be obtained by differentiating fast-readout CIS frames, by which, in turn, the world’s smallest pseudo DVS pixel (1.8 μm) can be achieved. In addition, we confirmed that CIS (50 Mp resolution) and DVS (0.78 Mp resolution) data obtained from the hybrid image sensor can be transmitted over the MIPI (4.5 Gb/s four-lane D-PHY) interface without signal loss. The results showed that the motion blur of a 60 fps CIS frame image can be compensated dramatically by using the proposed pseudo DVS frames together with a deblur algorithm. Finally, using the event simulation, we verified that a 1440 fps pseudo DVS frame can compensate the motion blur of the CIS image captured in the situation of jogging at a 3 m distance.
Open AccessMotion Blur-Free High-Speed Hybrid Image Sensing
We propose and demonstrate a novel motion blur-free hybrid image sensing technique. Unlike the previous hybrid image sensors, we developed a homogeneous hybrid image sensing technique including 60 fps CMOS Image Sensor (CIS) and 1440 fps pseudo Dynamic Vision Sensor (DVS) image frames without any performance degradation caused by static bad pixels. To achieve the fast readout, we implemented two one-side ADCs on two photodiodes (PDs) and the pixel output settling time can be reduced significantly by using the column switch control. The high-speed pseudo DVS frame can be obtained by differentiating fast-readout CIS frames, by which, in turn, the world’s smallest pseudo DVS pixel (1.8 μm) can be achieved. In addition, we confirmed that CIS (50 Mp resolution) and DVS (0.78 Mp resolution) data obtained from the hybrid image sensor can be transmitted over the MIPI (4.5 Gb/s four-lane D-PHY) interface without signal loss. The results showed that the motion blur of a 60 fps CIS frame image can be compensated dramatically by using the proposed pseudo DVS frames together with a deblur algorithm. Finally, using the event simulation, we verified that a 1440 fps pseudo DVS frame can compensate the motion blur of the CIS image captured in the situation of jogging at a 3 m distance.