Lupeng Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Lupeng Liu has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Jun Xiao
University of Chinese Academy of Sciences, Beijing, China
15 shared publications - Dongbo Yu
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
7 shared publications - Ying Wang
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
7 shared publications - Yunbiao Wang
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
6 shared publications - Ye Tao
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
3 shared publications - Yunbiao Wang
School of Artificial Intelligence, University of Chinese Academy and Sciences, No. 19 Yuquan Road, Beijing 100049, China
3 shared publications
Latest Publications
- Open Access
- 2 November 2026
- Published by MDPI AG in Biomimetics
- Vol. 11 (11) , 798
Bio-Inspired High-Precision Vision-Based Hand-Eye Calibration via an Integrated Target
Humans perform precision manipulation by continuously watching their own hands: vision delivers high-precision localization that compensates for the low fidelity of proprioception, and the internal eye–hand mapping is calibrated and refined through visual feedback. Inspired by this biological strategy, this paper proposes a bio-inspired high-precision vision-based hand–eye calibration method using an Integrated Target. A global RGB-D camera fixed above the workspace, playing the role of the human eye, directly measures the absolute pose of the target rigidly integrated with the hand–eye camera, replacing the low-precision controller-reported end-effector poses (analogous to proprioception) on one side of the calibration equation, while the hand–eye camera observes a stationary calibration board to provide the other. Four techniques support this framework: (i) a rigid-body Integrated Target design eliminating the geometric uncertainty of separate mounting; (ii) a multi-modal conditional random field fusing kinematic priors, color appearance, and depth geometry for high-fidelity target point cloud segmentation; (iii) a three-stage cascaded registration strategy combining kinematic priors with association graph matching, overcoming local optima under self-occlusion and weak textures; and (iv) a registration-residual-aware weighted optimization that maps the end-to-end registration root-mean-square error (RMSE) to relative confidence weights via a Gaussian kernel on the SE(3) manifold. Experiments on a Franka Emika Panda (absolute positioning error mm) demonstrate a segmentation intersection over union (IoU) of 0.9760. Stage 2 coarse registration achieves a mean RMSE of 0.3887 mm with a mean runtime of 0.0961 s per pose, whereas the complete three-stage registration requires 0.49 s per pose. The calibrated measurement system achieves a mean absolute sphere-center distance error of 0.3068 mm. Compared with the kinematics-based baseline (8.92 mm), analogous to blindfolded manipulation, the measurement error is reduced by more than an order of magnitude. In a separate target-level comparison with an ArUco marker target, the Integrated Target achieves valid-observation coverage of 94.7% versus 50.7% over the sampled viewpoints and a mean absolute displacement error of 0.12 mm versus 1.23 mm under controlled 20 mm translations. These results characterize target observability and translational localization, rather than the accuracy of the calibrated hand–eye transformation.- 2 November 2026
- Published by MDPI AG in Biomimetics
- Vol. 11 (11) , 798
Open AccessBio-Inspired High-Precision Vision-Based Hand-Eye Calibration via an Integrated Target
Humans perform precision manipulation by continuously watching their own hands: vision delivers high-precision localization that compensates for the low fidelity of proprioception, and the internal eye–hand mapping is calibrated and refined through visual feedback. Inspired by this biological strategy, this paper proposes a bio-inspired high-precision vision-based hand–eye calibration method using an Integrated Target. A global RGB-D camera fixed above the workspace, playing the role of the human eye, directly measures the absolute pose of the target rigidly integrated with the hand–eye camera, replacing the low-precision controller-reported end-effector poses (analogous to proprioception) on one side of the calibration equation, while the hand–eye camera observes a stationary calibration board to provide the other. Four techniques support this framework: (i) a rigid-body Integrated Target design eliminating the geometric uncertainty of separate mounting; (ii) a multi-modal conditional random field fusing kinematic priors, color appearance, and depth geometry for high-fidelity target point cloud segmentation; (iii) a three-stage cascaded registration strategy combining kinematic priors with association graph matching, overcoming local optima under self-occlusion and weak textures; and (iv) a registration-residual-aware weighted optimization that maps the end-to-end registration root-mean-square error (RMSE) to relative confidence weights via a Gaussian kernel on the SE(3) manifold. Experiments on a Franka Emika Panda (absolute positioning error mm) demonstrate a segmentation intersection over union (IoU) of 0.9760. Stage 2 coarse registration achieves a mean RMSE of 0.3887 mm with a mean runtime of 0.0961 s per pose, whereas the complete three-stage registration requires 0.49 s per pose. The calibrated measurement system achieves a mean absolute sphere-center distance error of 0.3068 mm. Compared with the kinematics-based baseline (8.92 mm), analogous to blindfolded manipulation, the measurement error is reduced by more than an order of magnitude. In a separate target-level comparison with an ArUco marker target, the Integrated Target achieves valid-observation coverage of 94.7% versus 50.7% over the sampled viewpoints and a mean absolute displacement error of 0.12 mm versus 1.23 mm under controlled 20 mm translations. These results characterize target observability and translational localization, rather than the accuracy of the calibrated hand–eye transformation. - 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35 (10577149) , 361-375
Hi-RWKV: Hierarchical RWKV Modeling for Hyperspectral Image Classification
Hyperspectral image (HSI) classification demands models that can jointly capture long-range spatial relations and high-dimensional spectral structures while remaining scalable to large scenes and robust under limited supervision. Existing CNN-, Transformer-, and state-space-based approaches either suffer from restricted receptive fields, quadratic attention complexity, or directional biases that hinder dense pixel-wise prediction. To address these limitations, we propose Hi-RWKV, a hierarchical recurrent weighted key–value framework tailored for hyperspectral analysis. Hi-RWKV introduces three key innovations: (1) a spatial structure–guided bidirectional propagation mechanism that integrates global spatial context while preserving boundary fidelity via edge-aware gating; (2) a spectral identity–driven channel mixing module that incorporates learnable band embeddings and whitening transforms to enhance cross-band discriminability; and (3) a multi-stage hierarchical encoder that progressively refines spectral–spatial representations with strictly linear complexity. Together, these designs enable efficient, direction-free spectral–spatial reasoning essential for large-scale HSI interpretation. Extensive experiments on four benchmarks demonstrate that Hi-RWKV consistently achieves state-of-the-art accuracy under diverse training regimes. Ablation studies confirm that each proposed module offers complementary gains in boundary preservation, spectral discrimination, and data efficiency. By unifying scalable recurrence with hyperspectral-specific structural modeling, Hi-RWKV establishes a strong and efficient paradigm for high-resolution remote sensing. The logs and source data of this article are available at https://github.com/HSI-Lab/Hi-RWKV.
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 35 (10577149) , 361-375
Hi-RWKV: Hierarchical RWKV Modeling for Hyperspectral Image Classification
Hyperspectral image (HSI) classification demands models that can jointly capture long-range spatial relations and high-dimensional spectral structures while remaining scalable to large scenes and robust under limited supervision. Existing CNN-, Transformer-, and state-space-based approaches either suffer from restricted receptive fields, quadratic attention complexity, or directional biases that hinder dense pixel-wise prediction. To address these limitations, we propose Hi-RWKV, a hierarchical recurrent weighted key–value framework tailored for hyperspectral analysis. Hi-RWKV introduces three key innovations: (1) a spatial structure–guided bidirectional propagation mechanism that integrates global spatial context while preserving boundary fidelity via edge-aware gating; (2) a spectral identity–driven channel mixing module that incorporates learnable band embeddings and whitening transforms to enhance cross-band discriminability; and (3) a multi-stage hierarchical encoder that progressively refines spectral–spatial representations with strictly linear complexity. Together, these designs enable efficient, direction-free spectral–spatial reasoning essential for large-scale HSI interpretation. Extensive experiments on four benchmarks demonstrate that Hi-RWKV consistently achieves state-of-the-art accuracy under diverse training regimes. Ablation studies confirm that each proposed module offers complementary gains in boundary preservation, spectral discrimination, and data efficiency. By unifying scalable recurrence with hyperspectral-specific structural modeling, Hi-RWKV establishes a strong and efficient paradigm for high-resolution remote sensing. The logs and source data of this article are available at https://github.com/HSI-Lab/Hi-RWKV.
- 6 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-17
Cross-Domain Incremental Image Classification via Domain-Specific Prototypes and Contrastive Learning
Remote sensing models in incremental learning scenarios often need to contend with both the newly emerged classes and cross-domain feature shifts, a combined challenge that we name it as Cross-Domain Incremental Learning (CDIL). Existing approaches typically address Class-Incremental Learning (CIL) or Domain-Incremental Learning (DIL) separately, failing to effectively handle recurring classes across domain shifts and leading to catastrophic forgetting or misaligned features across domains. To address this gap, we propose a novel CDIL framework that integrates a frozen pre-trained backbone with domain-specific adapter modules and domain-specific prototype construction. This architecture preserves general feature representations while capturing domain-specific nuances via lightweight adapters, and it stores class prototypes from each domain to unify knowledge of recurring classes. We further introduce multi-level supervised contrastive losses to ensure consistent class representation across domains. Extensive experiments on multiple remote sensing image classification benchmarks demonstrate that the proposed method significantly outperforms state-of-the-art CIL and DIL strategies, achieving superior accuracy and retention of old knowledge under severe domain shifts. The code will be released.
- 6 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 64 (01962892) , 1-17
Cross-Domain Incremental Image Classification via Domain-Specific Prototypes and Contrastive Learning
Remote sensing models in incremental learning scenarios often need to contend with both the newly emerged classes and cross-domain feature shifts, a combined challenge that we name it as Cross-Domain Incremental Learning (CDIL). Existing approaches typically address Class-Incremental Learning (CIL) or Domain-Incremental Learning (DIL) separately, failing to effectively handle recurring classes across domain shifts and leading to catastrophic forgetting or misaligned features across domains. To address this gap, we propose a novel CDIL framework that integrates a frozen pre-trained backbone with domain-specific adapter modules and domain-specific prototype construction. This architecture preserves general feature representations while capturing domain-specific nuances via lightweight adapters, and it stores class prototypes from each domain to unify knowledge of recurring classes. We further introduce multi-level supervised contrastive losses to ensure consistent class representation across domains. Extensive experiments on multiple remote sensing image classification benchmarks demonstrate that the proposed method significantly outperforms state-of-the-art CIL and DIL strategies, achieving superior accuracy and retention of old knowledge under severe domain shifts. The code will be released.
- 3 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Effective Spatial–Spectral Feature Representation for Hyperspectral Image Classification
Hyperspectral image (HSI), with their rich spectral information and spatial details, have demonstrated significant potential for classification tasks in fields such as remote sensing, agriculture, and environmental monitoring. However, existing methods still exhibit limitations in feature representation, primarily manifested in insufficient contextual modeling and the inability to effectively address spectral redundancy and significant variations in spatial scales. To address these challenges, this paper proposes an enhanced MambaHSI-based framework for HSI classification, focusing on improving the representation capability of spatial-spectral features. The proposed method consists of three key innovations: (1) A hierarchical DualGroupMamba module that progressively models intra-group and inter-group spectral dependencies to enhance fine-grained spectral discrimination and global contextual awareness; (2) a lightweight Hyperspectral Channel Attention (HCA) that dynamically adjusts the importance of feature channels based on the spatial–spectral information of different bands, effectively suppressing redundant information and highlighting discriminative features. (3) a Hybrid Feature Enhancer (HFE) module that effectively represents and fuses multi-scale spatial features by extracting local texture details and perceiving the overall spatial distribution of scenes, thereby enhancing the model’s adaptability to complex spatial structures. Through a systematic evaluation on four benchmark hyperspectral datasets, the proposed method achieved an average overall classification accuracy of 95.64%, outperforming the current best method by 1.89%. The experimental results validate the superior performance of the proposed approach in enhancing the representation of spatial–spectral features. The latest logs are now available at https://github.com/Tomyaya/EFR.
- 3 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-15
Effective Spatial–Spectral Feature Representation for Hyperspectral Image Classification
Hyperspectral image (HSI), with their rich spectral information and spatial details, have demonstrated significant potential for classification tasks in fields such as remote sensing, agriculture, and environmental monitoring. However, existing methods still exhibit limitations in feature representation, primarily manifested in insufficient contextual modeling and the inability to effectively address spectral redundancy and significant variations in spatial scales. To address these challenges, this paper proposes an enhanced MambaHSI-based framework for HSI classification, focusing on improving the representation capability of spatial-spectral features. The proposed method consists of three key innovations: (1) A hierarchical DualGroupMamba module that progressively models intra-group and inter-group spectral dependencies to enhance fine-grained spectral discrimination and global contextual awareness; (2) a lightweight Hyperspectral Channel Attention (HCA) that dynamically adjusts the importance of feature channels based on the spatial–spectral information of different bands, effectively suppressing redundant information and highlighting discriminative features. (3) a Hybrid Feature Enhancer (HFE) module that effectively represents and fuses multi-scale spatial features by extracting local texture details and perceiving the overall spatial distribution of scenes, thereby enhancing the model’s adaptability to complex spatial structures. Through a systematic evaluation on four benchmark hyperspectral datasets, the proposed method achieved an average overall classification accuracy of 95.64%, outperforming the current best method by 1.89%. The experimental results validate the superior performance of the proposed approach in enhancing the representation of spatial–spectral features. The latest logs are now available at https://github.com/Tomyaya/EFR.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10190-10199
GraphSplat: Sparse-View Generalizable 3D Gaussian Splatting is Worth Graph of Nodes
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 10190-10199
Open AccessGraphSplat: Sparse-View Generalizable 3D Gaussian Splatting is Worth Graph of Nodes
- Open Access
- 30 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 1579-1587
FC-MonoDETR: A Monocular 3D Object Detection Network Based on Foreground Constraint
- 30 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 1579-1587
Open AccessFC-MonoDETR: A Monocular 3D Object Detection Network Based on Foreground Constraint
- 4 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-14
MambaHSI+: Multidirectional State Propagation for Efficient Hyperspectral Image Classification
Hyperspectral image classification faces significant challenges due to high-dimensional spectral redundancy and complex spatial-spectral dependencies. While existing MambaHSI models leverage state-space modeling to enhance representation learning, their unidirectional formulation fails to fully capture bidirectional spatial interactions and cross-band contextual dependencies. Moreover, the uniform projection mechanism struggles to effectively distinguish spectral variations across different wavelengths. To address these limitations, we propose MambaHSI+, a novel framework that integrates bidirectional state-space modeling with spectral trajectory learning. The proposed architecture introduces three key innovations: (1) A bidirectional context modeling module, enhanced by reverse-order modeling, enables multi-directional spatial information propagation through recursive state transitions, facilitating comprehensive local-global feature aggregation while maintaining linear computational efficiency; (2) a spectral trajectory learning paradigm that formulates spectral evolution as continuous state-space process with bidirectional propagation, effectively encoding cross-band relationships; and (3) a Mamba-enhanced channel attention mechanism that adaptively emphasizes discriminative spectral features via selective state-space transformations. Extensive experiments on four benchmark datasets demonstrate state-of-the-art performance, achieving an average accuracy improvement of 2.51% over MambaHSI. By integrating state-space systems with advanced Mamba mechanisms, MambaHSI+ establishes a new paradigm for spectral-spatial representation learning, significantly advancing classification accuracy while ensuring computational efficiency. The latest logs are now available at https://github.com/RockAilab/MambaHSI_Plus.
- 4 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-14
MambaHSI+: Multidirectional State Propagation for Efficient Hyperspectral Image Classification
Hyperspectral image classification faces significant challenges due to high-dimensional spectral redundancy and complex spatial-spectral dependencies. While existing MambaHSI models leverage state-space modeling to enhance representation learning, their unidirectional formulation fails to fully capture bidirectional spatial interactions and cross-band contextual dependencies. Moreover, the uniform projection mechanism struggles to effectively distinguish spectral variations across different wavelengths. To address these limitations, we propose MambaHSI+, a novel framework that integrates bidirectional state-space modeling with spectral trajectory learning. The proposed architecture introduces three key innovations: (1) A bidirectional context modeling module, enhanced by reverse-order modeling, enables multi-directional spatial information propagation through recursive state transitions, facilitating comprehensive local-global feature aggregation while maintaining linear computational efficiency; (2) a spectral trajectory learning paradigm that formulates spectral evolution as continuous state-space process with bidirectional propagation, effectively encoding cross-band relationships; and (3) a Mamba-enhanced channel attention mechanism that adaptively emphasizes discriminative spectral features via selective state-space transformations. Extensive experiments on four benchmark datasets demonstrate state-of-the-art performance, achieving an average accuracy improvement of 2.51% over MambaHSI. By integrating state-space systems with advanced Mamba mechanisms, MambaHSI+ establishes a new paradigm for spectral-spatial representation learning, significantly advancing classification accuracy while ensuring computational efficiency. The latest logs are now available at https://github.com/RockAilab/MambaHSI_Plus.
- Open Access
- 20 January 2025
- Published by MDPI AG in Remote Sensing
- Vol. 17 (2) , 345
RockCloud-Align: A High-Precision Benchmark for Rock-Mass Point-Cloud Registration
Rock-mass point-cloud registration is a critical yet challenging task in the fields of geology and engineering. Currently, the lack of dedicated datasets for rock-mass point-cloud registration significantly limits the development and application of advanced algorithms in this area. To address this gap, we introduce RockCloud-Align, a large-scale dataset specifically designed for rock-mass point-cloud registration. Created using high-resolution LiDAR scans, this dataset covers a wide range of geological scenarios with varying densities and includes over 14,000 meticulously curated point-cloud pairs. RockCloud-Align provides a comprehensive benchmark for evaluating registration algorithms, along with a robust evaluation protocol to standardize the assessment of these methods. Building upon this dataset, we propose a novel registration method that eliminates the dependence on feature points and random sampling consensus, ensuring high efficiency and precision across diverse scenes and densities. Extensive experiments demonstrate that the proposed method significantly outperforms existing approaches in both accuracy and computational efficiency.
- 20 January 2025
- Published by MDPI AG in Remote Sensing
- Vol. 17 (2) , 345
Open AccessRockCloud-Align: A High-Precision Benchmark for Rock-Mass Point-Cloud Registration
Rock-mass point-cloud registration is a critical yet challenging task in the fields of geology and engineering. Currently, the lack of dedicated datasets for rock-mass point-cloud registration significantly limits the development and application of advanced algorithms in this area. To address this gap, we introduce RockCloud-Align, a large-scale dataset specifically designed for rock-mass point-cloud registration. Created using high-resolution LiDAR scans, this dataset covers a wide range of geological scenarios with varying densities and includes over 14,000 meticulously curated point-cloud pairs. RockCloud-Align provides a comprehensive benchmark for evaluating registration algorithms, along with a robust evaluation protocol to standardize the assessment of these methods. Building upon this dataset, we propose a novel registration method that eliminates the dependence on feature points and random sampling consensus, ensuring high efficiency and precision across diverse scenes and densities. Extensive experiments demonstrate that the proposed method significantly outperforms existing approaches in both accuracy and computational efficiency.