JNJiwei Nie

Jiwei Nie

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jiwei Nie has a total of 14 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Enhancing Visual Place Recognition With Hybrid Attention Mechanisms in MixVPR

    by Jun Hu, Jiwei Nie, Zuotao Ning, Chaolu Feng, Luyang Wang, Jingyao Li, Shuai Cheng

    Visual Place Recognition (VPR) is a fundamental task in robotics and computer vision, where the ability to recognize locations from visual inputs is crucial for autonomous navigation systems. Traditional methods, which rely on handcrafted features or standard convolutional neural networks (CNNs), struggle with environmental changes that significantly alter a place’s appearance. Recent advancements in deep learning have improved VPR by focusing on deep-learned features, enhancing robustness under varying conditions. However, these methods often overlook saliency cues, leading to inefficiencies in dynamic scenes. To address these limitations, we propose an improved MixVPR model that incorporates both self-attention and cross-attention mechanisms through a spatial-wise hybrid attention mechanism. This enhancement integrates spatial saliency cues into the global image embedding, improving accuracy and reliability. We also utilize the DINOv2 visual transformer for robust feature extraction. Extensive experiments on mainstream VPR benchmarks demonstrate that our method achieves superior performance while maintaining computational efficiency. Ablation studies and visualizations further validate the contributions of our attention mechanisms to the model’s performance improvement.


  • Efficient Saliency Encoding for Visual Place Recognition: Introducing the Lightweight Pooling-Centric Saliency-Aware VPR Method

    by Jiwei Nie, Dingyu Xue, Feng Pan, Zuotao Ning, Wei Liu, Jun Hu, Shuai Cheng

    The letter introduces a novel Visual Place Recognition (VPR) method called Lightweight Pooling-centric Saliency-aware VPR (LPS-VPR), a high-performance VPR method capable of exploiting saliency information without computational burden. The key contribution of the method is a pooling-based saliency encoder (PSE) that efficiently extracts and integrates local context saliency cues into the image embedding, avoiding using computationally intensive operations such as attention for saliency cues extraction. The method employs a multi-level feature pyramid fusion with a cascaded backtracking structure, merging multi-scale embedding information from different levels of the backbone network with negligible computational demand. The LPS-VPR method demonstrates superior performance on mainstream VPR benchmarks, showcasing state-of-the-art (SoTA) runtime efficiency and detailed ablation studies highlight the effectiveness of each LPS-VPR component. Extended visual demonstrations further underscore the effectiveness and superiority of LPS-VPR, making it a promising solution for real-world large-scale VPR applications.


  • A Training-Free, Lightweight Global Image Descriptor for Long-Term Visual Place Recognition Toward Autonomous Vehicles

    by Jiwei Nie, Joe-Mei Feng, Dingyu Xue, Feng Pan, Wei Liu, Jun Hu, Shuai Cheng

    Long-term visual place recognition (VPR) has recently become a popular research topic in the field of autonomous driving. In urban scenarios, variations in scene appearance due to the change in seasons and illumination bring great challenges for scene description. Several learning-based VPR techniques can learn latent invariant descriptors for appearance variations and show excellent performance in long-term VPR tasks. However, these methods require huge datasets and computational resources (e.g., GPUs) for training and inference. Mobile platforms such as autonomous vehicles often cannot provide sufficient computing power. To address this issue, in this paper, a training-free lightweight global image descriptor named SSR-VLAD is proposed for VPR. This descriptor is able to work accurately in real-time without GPUs, even on embedded platforms. The contribution of this work has two aspects. (1) A novel semantic skeleton representation (SSR) is proposed to describe the semantic spatial distribution of scenes by using the semantic spatial context; (2) Inspired by the Vector of Locally Aggregated Descriptors (VLAD), a spatial-temporal aggregation framework for SSR features is constructed to aggregate all SSR features into one SSR-VLAD descriptor, which encodes the spatial and temporal information into a fixed-size global descriptor. SSR-VLAD shows robust performance towards the appearance variations of scenes. Specifically, on three public datasets with challenging urban scenes, experimental results show that SSR-VLAD has competitive VPR performance compared to several state-of-the-art (SoTA) VPR methods. Additionally, SSR-VLAD achieves SoTA real-time computational performance with lower RAM consumption in computationally constrained scenarios.