JLJiajun Lv

Jiajun Lv

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Jiajun Lv has a total of 42 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Gaussian-LIC2: LiDAR-Inertial-Camera Gaussian Splatting SLAM

    by Xiaolei Lang, Jiajun Lv, Kai Tang, Laijian Li, Jianxin Huang, Lina Liu, Yong Liu, Xingxing Zuo

    This paper presents a photo-realistic LiDAR-Inertial-Camera Gaussian Splatting SLAM system that simultaneously addresses visual quality, geometric accuracy, and real-time performance. The proposed method performs robust and accurate pose estimation within a continuous-time trajectory optimization framework, while incrementally reconstructing a large-scale 3D Gaussian map using camera and LiDAR data, all in real time. The resulting map enables high-quality, real-time novel view rendering of both RGB images and depth maps. To effectively address under-reconstruction in regions not covered by the LiDAR, we employ a lightweight zero-shot depth model that synergistically combines RGB appearance cues with sparse LiDAR measurements to generate dense depth maps. The depth completion enables reliable Gaussian initialization in LiDAR-blind areas, significantly improving system applicability for sparse LiDAR sensors. To enhance geometric accuracy, we fully use sparse but precise LiDAR depths to supervise Gaussian map optimization and accelerate it with carefully designed CUDA-accelerated strategies. Furthermore, we explore how the incrementally reconstructed Gaussian map can improve the robustness of the odometry. By efficiently incorporating photometric constraints from the Gaussian map into the continuous-time factor graph optimization, we demonstrate improved tracking performance, especially under LiDAR degenerated scenarios. We also showcase downstream applications via extending our elaborate system, including video frame interpolation and fast 3D mesh production. To support rigorous evaluation, we collect a dedicated LiDAR-Inertial-Camera dataset featuring ground-truth poses, depth maps, and extrapolated trajectories for assessing out-of-sequence novel view synthesis in large-scale outdoor scenarios. Extensive experiments on both public and self-collected datasets demonstrate the superiority and versatility of our system across LiDAR sensors with varying sampling densities.


  • PA-EVIO: Polarity-Aided Event–Visual–Inertial Odometry With Adaptive Event Representation

    by Kai Tang, Xiaolei Lang, Yukai Ma, Yuehao Huang, Yaqing Gu, Laijian Li, Jie Ren, Yong Liu, Jiajun Lv

    Event cameras have received extensive research interest because of their advantages over conventional cameras in high-speed motion and high-dynamic-range (HDR) environments. In this paper, we present a polarity-aided event-visual-inertial odometry system (PA-EVIO) that integrates the time-surface generation module, the feature processing module, and the state estimator module. Unlike the exponential decay with a fixed decay rate, the event adaptive decay, based on an event activity model, adjusts the decay rate according to the dynamics of the event stream and provides better texture performance. We propose a compensation method to enhance the robustness of feature tracking with polarity-weighted time surfaces and alleviate the adverse effect of polarity fluctuations caused by motion direction changes. The proposed odometry leverages the advantages of event cameras while also incorporating visual information to enhance robustness, particularly in scenarios where the event data is sparse or the image data is of good quality. We conduct extensive experiments to evaluate the proposed method, covering scenarios with high dynamic range and aggressive motion speed. The results from the DAVIS240C, HKU-Arclab, and UZH-FPV datasets indicate that our method outperforms other EIO and EVIO methods with real-time performance. The code will be released at https://github.com/APRIL-ZJU/PA-EVIO.


  • Open Access

    UltraLBM-UNet: Ultralight Bidirectional Mamba-based Model for Skin Lesion Segmentation

    by Linxuan Fan, Juntao Jiang, Weixuan Liu, Zhucun Xue, Jiajun Lv, Jiangning Zhang, Yong Liu

    Skin lesion segmentation is a crucial step in dermatology for guiding clinical decision-making. However, existing methods for accurate, robust, and resource-efficient lesion analysis have limitations, including low performance and high computational complexity. To address these limitations, we propose UltraLBM-UNet, a lightweight U-Net variant that integrates a bidirectional Mamba-based global modeling mechanism with multi-branch local feature perception. The proposed architecture integrates efficient local feature injection with bidirectional state-space modeling, enabling richer contextual interaction across spatial dimensions while maintaining computational compactness suitable for point-of-care deployment. Extensive experiments on the ISIC 2017, ISIC 2018, and PH2 datasets demonstrate that our model consistently achieves state-of-the-art segmentation accuracy, outperforming existing lightweight and Mamba counterparts with only 0.034M parameters and 0.060 GFLOPs. In addition, we introduce a hybrid knowledge distillation strategy to train an ultra-compact student model, where the distilled variant UltraLBM-UNet-T, with only 0.011M parameters and 0.019 GFLOPs, achieves competitive segmentation performance. These results highlight the suitability of UltraLBM-UNet for point-of-care deployment, where accurate and robust lesion analyses are essential. The source code is publicly available at https://github.com/LinLinLin-X/UltraLBM-UNet.

  • GS-Loc: A Vision Foundation Model-Driven 3D Gaussian Splatting Framework for Robust Visual Relocalization

    by Yupei Zeng, Yuhang Dong, Xuanhua Chen, Guangyuan Lu, Runjian Li, Jiajun Lv, Longhua Ma, Guanzhong Tian

    Robust and accurate localization technologies are crucial for autonomous vehicles and mobile robots. Precisely perceiving the 3D environment and its semantic attributes in the real world greatly enhances the ability of these systems to perform localization tasks effectively. This letter proposes GS-Loc, the first visual relocalization framework based on a vision foundation model that utilizes 3D Gaussian Splatting (3DGS) as a map representation. GS-Loc leverages the powerful visual feature extraction capabilities of a vision foundation model as a Global Locator, performing global descriptor matching between query images and a reference image database. This enables each query image to be matched with the most optimal candidate image in the map and an initial pose within the map. Leveraging the high-dimensional feature embeddings extracted by vision foundation models, we propose the Foundation Feature-Consistent Matcher (FFC-Matcher), which establishes a feature similarity filtering mechanism to extract geometrically consistent feature subsets from high-quality images and depth maps rendered by the 3DGS model, thereby enabling pose refinement through 2D-3D feature matching. To enhance the efficiency of GS-Loc, we introduce sparsification of the 3DGS model by retaining only the Gaussians that contain relevant feature information. Extensive evaluations on the KITTI360 and ROBOTCAR datasets show that even with a model size reduced by approximately 50%, our approach still achieves state-of-the-art performance compared to other methods.

  • Open Access

    CogDDN: A Cognitive Demand-Driven Navigation with Decision Optimization and Dual-Process Thinking

    by Yuehao Huang, Liang Liu, Shuangming Lei, Yukai Ma, Hao Su, Jianbiao Mei, Pengxiang Zhao, Yaqing Gu, Yong Liu, Jiajun Lv


  • Open Access

    Monocular Event-Inertial Odometry with Adaptive decay-based Time Surface and Polarity-aware Tracking

    by Kai Tang, Xiaolei Lang, Yukai Ma, Yuehao Huang, Laijian Li, Yong Liu, Jiajun Lv

    Event cameras have garnered considerable attention due to their advantages over traditional cameras in low power consumption, high dynamic range, and no motion blur. This paper proposes a monocular event-inertial odometry incorporating an adaptive decay kernel-based time surface with polarity-aware tracking. We utilize an adaptive decay-based Time Surface to extract texture information from asynchronous events, which adapts to the dynamic characteristics of the event stream and enhances the representation of environmental textures. However, polarity-weighted time surfaces suffer from event polarity shifts during changes in motion direction. To mitigate its adverse effects on feature tracking, we optimize the feature tracking by incorporating an additional polarity-inverted time surface to enhance the robustness. Comparative analysis with visual-inertial and event-inertial odometry methods shows that our approach outperforms state-of-the-art techniques, with competitive results across various datasets.

  • Coco-LIC: Continuous-Time Tightly-Coupled LiDAR-Inertial-Camera Odometry Using Non-Uniform B-Spline

    by Xiaolei Lang, Chao Chen, Kai Tang, Yukai Ma, Jiajun Lv, Yong Liu, Xingxing Zuo

    In this paper, we propose an effcient continuous-time LiDAR-Inertial-Camera Odometry, utilizing non-uniform B-splines to tightly couple measurements from the LiDAR, IMU, and camera. In contrast to uniform B-spline-based continuous-time methods, our non-uniform B-spline approach offers signifcant advantages in terms of achieving real-time effciency and high accuracy. This is accomplished by dynamically and adaptively placing control points, taking into account the varying dynamics of the motion. To enable effcient fusion of heterogeneous LiDAR-Inertial-Camera data within a short sliding-window optimization, we assign depth to visual pixels using corresponding map points from a global LiDAR map, and formulate frame-to-map reprojection factors for the associated pixels in the current image frame. This way circumvents the necessity for depth optimization of visual pixels, which typically entails a lengthy sliding window with numerous control points for continuous-time trajectory estimation. We conduct dedicated experiments on real-world datasets to demonstrate the advantage and effcacy of adopting non-uniform continuous-time trajectory representation. Our LiDAR-Inertial-Camera odometry system is also extensively evaluated on both challenging scenarios with sensor degenerations and large-scale scenarios, and has shown comparable or higher accuracy than the state-of-the-art methods. The codebase of this paper will also be open-sourced at https://github.com/APRIL-ZJU/Coco-LIC .


  • Open Access

    Correlation Pyramid Network for 3D Single Object Tracking

    by Mengmeng Wang, Teli Ma, Xingxing Zuo, Jiajun Lv, Yong Liu

    3D LiDAR-based single object tracking (SOT) has gained increasing attention as it plays a crucial role in 3D applications such as autonomous driving. The central problem is how to learn a target-aware representation from the sparse and incomplete point clouds. In this paper, we propose a novel Correlation Pyramid Network (CorpNet) with a unified encoder and a motion-factorized decoder. Specifically, the encoder introduces multi-level self attentions and cross attentions in its main branch to enrich the template and search region features and realize their fusion and interaction, respectively. Additionally, considering the sparsity characteristics of the point clouds, we design a lateral correlation pyramid structure for the encoder to keep as many points as possible by integrating hierarchical correlated features. The output features of the search region from the encoder can be directly fed into the decoder for predicting target locations without any extra matcher. Moreover, in the decoder of CorpNet, we design a motion-factorized head to explicitly learn the different movement patterns of the up axis and the x-y plane together. Extensive experiments on two commonly-used datasets show our CorpNet achieves state-of-the-art results while running in real-time.

  • Continuous-Time Fixed-Lag Smoothing for LiDAR-Inertial-Camera SLAM

    by Jiajun Lv, Xiaolei Lang, Jinhong Xu, Mengmeng Wang, Yong Liu, Xingxing Zuo

    Localization and mapping with heterogeneous multisensor fusion have been prevalent in recent years. To adequately fuse multimodal sensor measurements received at different time instants and different frequencies, we estimate the continuous-time trajectory by fixed-lag smoothing within a factor-graph optimization framework. With the continuous-time formulation, we can query poses at any time instants corresponding to the sensor measurements. To bound the computation complexity of the continuous-time fixed-lag smoother, we maintain temporal and keyframe sliding windows with constant size, and probabilistically marginalize out control points of the trajectory and other states, which allows preserving prior information for future sliding-window optimization. Based on continuous-time fixed-lag smoothing, we design tightly coupled multimodal SLAM algorithms with a variety of sensor combinations, like the LiDAR-inertial and LiDAR-inertial-camera SLAM systems, in which online time offset calibration is also naturally supported. More importantly, benefiting from the marginalization and our derived analytical Jacobians for optimization, the proposed continuous-time SLAM systems can achieve real-time performance regardless of the high complexity of continuous-time formulation. The proposed multimodal SLAM systems have been widely evaluated on three public datasets and self-collect datasets. The results demonstrate that the proposed continuous-time SLAM systems can achieve high-accuracy pose estimations and outperform existing state-of-the-art methods. To benefit the research community, we will open source our code at https://github.com/APRIL-ZJU/clic .


  • Open Access

    OL-SLAM: A Robust and Versatile System of Object Localization and SLAM

    by Chao Chen, Yukai Ma, Jiajun Lv, Xiangrui Zhao, Laijian Li, Yong Liu, Wang Gao

    This paper proposes a real-time, versatile Simultaneous Localization and Mapping (SLAM) and object localization system, which fuses measurements from LiDAR, camera, Inertial Measurement Unit (IMU), and Global Positioning System (GPS). Our system can locate itself in an unknown environment and build a scene map based on which we can also track and obtain the global location of objects of interest. Precisely, our SLAM subsystem consists of the following four parts: LiDAR-inertial odometry, Visual-inertial odometry, GPS-inertial odometry, and global pose graph optimization. The target-tracking and positioning subsystem is developed based on YOLOv4. Benefiting from the use of GPS sensor in the SLAM system, we can obtain the global positioning information of the target; therefore, it can be highly useful in military operations, rescue and disaster relief, and other scenarios.