JLJaehyup Lee

Jaehyup Lee

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jaehyup Lee has a total of 35 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    CompMVR: Compression-Aware Multi-View Restoration Using Diffusion Models for Geometrically Consistent 3D Reconstruction

    by Dong-Hwi Kim, Chaewon Moon, Hojun Song, Dongbeom Kim, Junyeong Jang, Aro Kim, Gahyeon Kim, Heejung Choi, Jehee Kim, Gianella Cravioto, et al.

  • C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation

    by Jeonghyeok Do, Jaehyup Lee, Seungchul Lee, Munchurl Kim

    Synthetic Aperture Radar (SAR) imagery provides robust environmental and temporal coverage (e.g., during clouds, seasons, day-night cycles), yet its noise and unique structural patterns pose interpretation challenges, especially for non-experts. SAR-to-EO (Electro-Optical) image translation (SET) has emerged to make SAR images more perceptually interpretable. However, traditional approaches, trained from scratch on limited SAR-EO datasets, are prone to overfitting and struggle with dataset inconsistencies. To address these challenges, we introduce Confidence Diffusion for SAR-to-EO Translation (C-DiffSET), a framework leveraging a pretrained Latent Diffusion Model (LDM) to effectively adapt its extensive generative priors from natural images to the EO domain. Our investigation reveals that the pretrained VAE encoder effectively aligns SAR and EO images within a shared latent space, demonstrating robustness even to varying noise levels in SAR inputs. To further improve pixel-wise fidelity for SET and mitigate artifacts from temporal discrepancies, such as appearing or disappearing objects, we propose a novel confidence-guided diffusion (C-Diff) loss. This loss dynamically guides the diffusion process to down-weight penalties in uncertain regions, thereby enhancing structural accuracy. C-DiffSET achieves state-of-the-art (SOTA) results on multiple benchmark datasets (QXS-SAROPT, SAR2Opt, SpaceNet6, Stellar-Vision), significantly outperforming recent image-to-image translation methods and specialized SET methods across all standard metrics. The source code and trained models are available at https://github.com/KAIST-VICLab/C-DiffSET.


  • RPM: Robust PAN-Sharpening With Multispectral Misalignment Correction

    by Juheon Park, Seunghyun Kim, Minyoung Jeon, Hyun-Ho Kim, Doochun Seo, Jaeheon Jung, Jaehyup Lee

    Most existing PAN-sharpening methods assume perfect co-registration between the panchromatic (PAN) image and multispectral (MS) bands. In real-world aerial and satellite imaging, however, both PAN–MS misalignment and inter-band misalignment among MS channels frequently occur, leading to significant degradation in fusion quality. In this work, we propose RPM, a robust PAN-sharpening framework that simultaneously corrects inter-band shifts while fusing PAN and MS information. The core idea is a shift-to-align training strategy, where random band-wise shifts are introduced during training so that the network learns alignment-invariant spectral fusion guided by the PAN image. Without requiring explicitly aligned ground truth, RPM enforces spectral fidelity, spatial consistency, and robustness to inter-band misalignment. Extensive experiments on multiple benchmark datasets demonstrate that RPM consistently achieves state-of-the-art performance: on the WV3 dataset, it reduces ERGAS by up to 2–3%, lowers SAM by about 1%, and improves PSNR, SCC, HQNR, and Q8 scores by 0.1–0.2% compared with recent methods. Moreover, RPM performs inference in the millisecond range per image patch, which is over 1000× faster than prior approaches that typically require several seconds.

  • Open Access

    ABBSPO: Adaptive Bounding Box Scaling and Symmetric Prior based Orientation Prediction for Detecting Aerial Image Objects

    by Woojin Lee, Hyugjae Chang, Jaeho Moon, Jaehyup Lee, Munchurl Kim

    Weakly supervised oriented object detection (WS-OOD) has gained attention as a cost-effective alternative to fully supervised methods, providing both efficiency and high accuracy. Among weakly supervised approaches, horizontal bounding box (HBox)-supervised OOD stands out for its ability to directly leverage existing HBox annotations while achieving the highest accuracy under weak supervision settings. This paper introduces adaptive bounding box scaling and symmetry-prior-based orientation prediction, called ABBSPO, a framework for WS-OOD. Our ABBSPO addresses limitations of previous HBox-supervised OOD methods, which compare ground truth (GT) HBoxes directly with the minimum circumscribed rectangles of predicted RBoxes, often leading to inaccurate scale estimation. To overcome this, we propose: (i) Adaptive Bounding Box Scaling (ABBS), which appropriately scales GT HBoxes to optimize for the size of each predicted RBox, ensuring more accurate scale prediction; and (ii) a Symmetric Prior Angle (SPA) loss that exploits inherent symmetry of aerial objects for self-supervised learning, resolving issues in previous methods where learning collapses when predictions for all three augmented views (original, rotated, and flipped) are consistently incorrect. Extensive experimental results demonstrate that ABBSPO achieves state-of-the-art performance, outperforming existing methods.

  • Open Access

    From Street to Orbit: Training-Free Cross-View Retrieval via Location Semantics and LLM Guidance

    by Jeongho Min, Dongyoung Kim, Jaehyup Lee

    Cross-view image retrieval, particularly street-to-satellite matching, is a critical task for applications such as autonomous navigation, urban planning, and localization in GPS-denied environments. However, existing approaches often require supervised training on curated datasets and rely on panoramic or UAV-based images, which limits real-world deployment. In this paper, we present a simple yet effective cross-view image retrieval framework that leverages a pretrained vision encoder and a large language model (LLM), requiring no additional training. Given a monocular street-view image, our method extracts geographic cues through web-based image search and LLM-based location inference, generates a satellite query via geocoding API, and retrieves matching tiles using a pretrained vision encoder (e.g., DINOv2) with PCA-based whitening feature refinement. Despite using no ground-truth supervision or finetuning, our proposed method outperforms prior learning-based approaches on the benchmark dataset under zero-shot settings. Moreover, our pipeline enables automatic construction of semantically aligned street-to-satellite datasets, which is offering a scalable and cost-efficient alternative to manual annotation. All source codes will be made publicly available at https://jeonghomin.github.io/street2orbit.github.io/.

  • U-SET: Uncertainty-Aware SAR-to-EO Translation

    by Minyoung Jeon, Hyun-Ho Kim, Juheon Park, Doochun Seo, Jaehyup Lee

    Synthetic aperture radar (SAR) imagery has become increasingly vital across diverse applications, including military surveillance, environmental monitoring, and disaster response. However, interpreting SAR images poses challenges for non-experts owing to their distinct imaging characteristics, such as speckle noise and structural distortions. Additionally, inherent properties of SAR imaging and temporal disparities frequently lead to local misalignments between paired SAR and electro-optical (EO) images. To mitigate these issues, we introduce U-SET, an uncertainty-aware framework for SAR-to-EO translation that explicitly models pixel-wise uncertainty, facilitating locally adaptive learning. By leveraging the uncertainty estimation capabilities of deep-learning models, U-SET effectively prioritizes structurally complex and ambiguous regions during training. Comprehensive evaluations on our newly compiled KOMPSAT dataset demonstrate that U-SET achieves state-of-the-art performance, outperforming existing methods across six image quality metrics in both quantitative and qualitative assessments.

  • Open Access

    U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening

    by Sungpyo Kim, Jeonghyeok Do, Jaehyup Lee, Munchurl Kim

    Conventional methods for PAN-sharpening often struggle to restore fine details due to limitations in leveraging high-frequency information. Moreover, diffusion-based approaches lack sufficient conditioning to fully utilize Panchromatic (PAN) images and low-resolution multispectral (LRMS) inputs effectively. To address these challenges, we propose an uncertainty-aware knowledge distillation diffusion framework with details enhancement for PAN-sharpening, called U-Know-DiffPAN. The U-Know-DiffPAN incorporates uncertainty-aware knowledge distillation for effective transfer of feature details from our teacher model to a student one. The teacher model in our U-Know-DiffPAN captures frequency details through freqeuncy selective attention, facilitating accurate reverse process learning. By conditioning the encoder on compact vector representations of PAN and LRMS and the decoder on Wavelet transforms, we enable rich frequency utilization. So, the high-capacity teacher model distills frequency-rich features into a lightweight student model aided by an uncertainty map. From this, the teacher model can guide the student model to focus on difficult image regions for PAN-sharpening via the usage of the uncertainty map. Extensive experiments on diverse datasets demonstrate the robustness and superior performance of our U-Know-DiffPAN over very recent state-of-the-art PAN-sharpening methods.