Tianchen Deng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Tianchen Deng has a total of 58 co-authors. Here are the top co-authors by number of shared publications:
- Jingchuan Wang
Shanghai Jiao Tong University
9 shared publications - Weidong Chen
Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310027, China
8 shared publications - Danwei Wang
Nanyang Technological University
6 shared publications - Hesheng Wang
Shanghai Jiao Tong University
5 shared publications - Hongle Xie
Department of Automation, Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
4 shared publications - Hongming Shen
Centre for Advanced Robotics Technology Innovation, Nanyang Technological University, Singapore
3 shared publications
Latest Publications
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (11) , 12576-12583
OTPL-VIO: Robust Visual-Inertial Odometry With Optimal Transport Line Association and Adaptive Uncertainty
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (11) , 12576-12583
OTPL-VIO: Robust Visual-Inertial Odometry With Optimal Transport Line Association and Adaptive Uncertainty
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (10) , 11745-11752
Diff4RadBEV: Conditional Diffusion for 4D Radar BEV Enhancement
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (10) , 11745-11752
Diff4RadBEV: Conditional Diffusion for 4D Radar BEV Enhancement
- 23 September 2026
- Published by Springer Nature in International Journal of Computer Vision
- Vol. 134 (10) , 445
Voxelized 3D Gaussian Representation for Dense Visual SLAM on Embedded Vision System
- 23 September 2026
- Published by Springer Nature in International Journal of Computer Vision
- Vol. 134 (10) , 445
Voxelized 3D Gaussian Representation for Dense Visual SLAM on Embedded Vision System
- 16 September 2026
- Published by SAGE Publications in The International Journal of Robotics Research
Towards the Vision-Sound-Language-Action paradigm: The HEAR framework for sound-centric manipulation
Humans and animals use sound as a crucial cue for interacting with the physical world, as acoustic events can reveal contact, completion, hidden contents, or process state. Embodied agents should similarly benefit from auditory awareness during manipulation, yet existing Vision-Language-Action (VLA) policies typically rely on persistent visual observations, while audio-aware variants often treat audio as speech, waveform renderings, or fixed preexecution context. Such interfaces can miss transient sounds, such as beeps, clicks, rattles, or collision cues, especially under system latency and open-loop action chunking. We formalize this timing failure as the Blind Execution Interval (BEI), in which critical acoustic evidence may occur after an action chunk begins but disappear before the next policy update. To address this challenge, we introduce Vision-Sound-Language-Action (VSLA), a continuous control paradigm conditioned on vision, streaming audio, language, and proprioception under delayed decision loops. We further present HEAR, a VSLA framework that preserves causal auditory context across execution gaps, performs multimodal reasoning, models near-future audio dynamics during training, and generates smooth action chunks for closed-loop manipulation. To support learning and evaluation, we introduce OpenX-Sound for robotics-specific audio-visual-action pretraining and HEAR-Bench, a benchmark for sound-centric manipulation with strict causal timing constraints. On HEAR-Bench, HEAR achieves an 81% success rate, outperforming waveform, ASR, and compact audio-native baselines, and reaches 70% sound-causal success across four real-world Franka tasks. These results show that robust sound-centric manipulation requires not only native audio input, but also causal auditory persistence and explicit temporal grounding. Code and videos are available at https://hear.irmv.top .
- 16 September 2026
- Published by SAGE Publications in The International Journal of Robotics Research
Towards the Vision-Sound-Language-Action paradigm: The HEAR framework for sound-centric manipulation
Humans and animals use sound as a crucial cue for interacting with the physical world, as acoustic events can reveal contact, completion, hidden contents, or process state. Embodied agents should similarly benefit from auditory awareness during manipulation, yet existing Vision-Language-Action (VLA) policies typically rely on persistent visual observations, while audio-aware variants often treat audio as speech, waveform renderings, or fixed preexecution context. Such interfaces can miss transient sounds, such as beeps, clicks, rattles, or collision cues, especially under system latency and open-loop action chunking. We formalize this timing failure as the Blind Execution Interval (BEI), in which critical acoustic evidence may occur after an action chunk begins but disappear before the next policy update. To address this challenge, we introduce Vision-Sound-Language-Action (VSLA), a continuous control paradigm conditioned on vision, streaming audio, language, and proprioception under delayed decision loops. We further present HEAR, a VSLA framework that preserves causal auditory context across execution gaps, performs multimodal reasoning, models near-future audio dynamics during training, and generates smooth action chunks for closed-loop manipulation. To support learning and evaluation, we introduce OpenX-Sound for robotics-specific audio-visual-action pretraining and HEAR-Bench, a benchmark for sound-centric manipulation with strict causal timing constraints. On HEAR-Bench, HEAR achieves an 81% success rate, outperforming waveform, ASR, and compact audio-native baselines, and reaches 70% sound-causal success across four real-world Franka tasks. These results show that robust sound-centric manipulation requires not only native audio input, but also causal auditory persistence and explicit temporal grounding. Code and videos are available at https://hear.irmv.top .
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 73 (7) , 10290-10302
MC-Mapping: Magnetic-Aware Collaborative Mapping in Perceptually Degraded Environments
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 73 (7) , 10290-10302
MC-Mapping: Magnetic-Aware Collaborative Mapping in Perceptually Degraded Environments
- 30 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. PP (2162237X) , 1-15
MID: A Self-Supervised Multimodal Iterative Denoising Framework
Denoising is important in many vision, medical, and biological applications, yet real observations are often corrupted by complex nonlinear noise and clean targets are often unavailable. We present MID, a self-supervised iterative denoising framework across data modalities. MID treats an observation as an intermediate state along a controllable corruption process and learns from noisy data only through two networks: a step predictor that estimates the current corruption stage and a residual predictor that estimates the effective residual increment to be removed at that stage. For nonlinear corruption, MID uses a first-order local approximation to enable iterative restoration in a locally linear regime. The same formulation can be instantiated with modality-specific backbones for images, signals, point sets, and sequences. Experiments on diverse tasks in computer vision, biomedicine, and bioinformatics show that MID is robust, broadly applicable, and competitive with recent baselines.
- 30 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. PP (2162237X) , 1-15
MID: A Self-Supervised Multimodal Iterative Denoising Framework
Denoising is important in many vision, medical, and biological applications, yet real observations are often corrupted by complex nonlinear noise and clean targets are often unavailable. We present MID, a self-supervised iterative denoising framework across data modalities. MID treats an observation as an intermediate state along a controllable corruption process and learns from noisy data only through two networks: a step predictor that estimates the current corruption stage and a residual predictor that estimates the effective residual increment to be removed at that stage. For nonlinear corruption, MID uses a first-order local approximation to enable iterative restoration in a locally linear regime. The same formulation can be instantiated with modality-specific backbones for images, signals, point sets, and sequences. Experiments on diverse tasks in computer vision, biomedicine, and bioinformatics show that MID is robust, broadly applicable, and competitive with recent baselines.
- 27 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 75 (00189456) , 2510615
An Efficient LiDAR-Camera Fusion Network for Multiclass 3-D Dynamic Object Detection and Trajectory Prediction
Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic environments, we propose an efficient multi-modal framework for 3D object detection and trajectory prediction, which synergistically integrates LiDAR and camera inputs to achieve real-time perception of pedestrians, vehicles, and riders in 3D space. The framework incorporates two novel models: 1) a Unified modality detector with Mamba and Transformer (UniMT) for object detection, which achieves high-accuracy object detection with fast inference speed, and 2) a Reference Trajectory-based Multi-Class Transformer (RTMCT) for efficient and diverse trajectory prediction of multi-class objects with flexible-length trajectories. Evaluations on the CODa benchmark demonstrate that our method outperforms existing ones in both detection (+3.71% in mAP) and trajectory prediction (-0.408m in minADE5 of pedestrians) metrics. Furthermore, on the challenging nuScenes detection benchmark, our detection model achieves competitive performance among LiDAR-camera fusion methods, with a mAP of 72.7% and NDS of 75.3%. Remarkably, the system demonstrates exceptional generalizability and practical deployment potential. When transferred and implemented on a wheelchair robot with an entry-level NVIDIA RTX 3060 GPU, it achieves real-time inference at 13.9 frames per second (FPS) with satisfactory accuracy across different environments. To facilitate reproducibility and practical deployment, we release the related code of the method at https://github.com/TossherO/3D Perception and its ROS inference version at https://github.com/TossherO/ros packages.
- 27 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 75 (00189456) , 2510615
An Efficient LiDAR-Camera Fusion Network for Multiclass 3-D Dynamic Object Detection and Trajectory Prediction
Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic environments, we propose an efficient multi-modal framework for 3D object detection and trajectory prediction, which synergistically integrates LiDAR and camera inputs to achieve real-time perception of pedestrians, vehicles, and riders in 3D space. The framework incorporates two novel models: 1) a Unified modality detector with Mamba and Transformer (UniMT) for object detection, which achieves high-accuracy object detection with fast inference speed, and 2) a Reference Trajectory-based Multi-Class Transformer (RTMCT) for efficient and diverse trajectory prediction of multi-class objects with flexible-length trajectories. Evaluations on the CODa benchmark demonstrate that our method outperforms existing ones in both detection (+3.71% in mAP) and trajectory prediction (-0.408m in minADE5 of pedestrians) metrics. Furthermore, on the challenging nuScenes detection benchmark, our detection model achieves competitive performance among LiDAR-camera fusion methods, with a mAP of 72.7% and NDS of 75.3%. Remarkably, the system demonstrates exceptional generalizability and practical deployment potential. When transferred and implemented on a wheelchair robot with an entry-level NVIDIA RTX 3060 GPU, it achieves real-time inference at 13.9 frames per second (FPS) with satisfactory accuracy across different environments. To facilitate reproducibility and practical deployment, we release the related code of the method at https://github.com/TossherO/3D Perception and its ROS inference version at https://github.com/TossherO/ros packages.
- 10 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 42 (15523098) , 1556-1576
UniLGL: Learning Uniform Place Recognition for FOV-Limited/Panoramic LiDAR Global Localization
LiDAR-based Global Localization (LGL) is an essential ingredient for autonomous robots. However, existing LGL methods typically consider only partial information (e.g., geometric features) from LiDAR observations or are designed for homogeneous LiDAR sensors, overlooking the uniformity in LGL. In this work, a uniform LGL method is proposed, termed UniLGL, which simultaneously achieves spatial and material uniformity, as well as sensor-type uniformity. The key idea of the proposed method is to encode the complete point cloud, which contains both geometric and material information, into a pair of Bird's Eye View (BEV) images (i.e., a spatial BEV image and an intensity BEV image), thereby transforming the LGL problem into a cascaded LiDAR Place Recognition (LPR) and pose estimation problem from the perspective of image fusion. An end-to-end multi-BEV fusion network is designed to extract uniform features, equipping UniLGL with spatial and material uniformity. To ensure robust LGL across heterogeneous LiDAR sensors, a viewpoint invariance hypothesis is introduced, which replaces the conventional translation equivariance assumption commonly used in existing LPR networks and supervises UniLGL to achieve sensor type uniformity in both global descriptors and local feature representations. Moreover, UniLGL introduces a pipeline that leverages a pre-trained single-image Vision Foundation Model (VFM) for feature extraction to enhance the multi-BEV fusion LPR network, enabling strong generalization with only a few LiDAR data for fine-tuning. Finally, based on the mapping between local features on the 2D BEV image and the point cloud, a robust global pose estimator is derived that determines the global minimum of the global pose on $\text{SE}(3)$ without requiring additional registration. To validate the effectiveness of the proposed uniform LGL, extensive benchmarks are conducted in real-world environments, and the results show that the proposed UniLGL is demonstratively competitive compared to other State-of-the-Art (SOTA) LGL methods. Furthermore, UniLGL has been deployed on diverse platforms, including full-size trucks and agile Micro Aerial Vehicles (MAVs), to enable high-precision localization and mapping as well as multi-MAV collaborative exploration in port and forest environments, demonstrating the applicability of UniLGL in industrial and field scenarios. The code will be released at https://github.com/shenhm516/UniLGL.
- 10 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 42 (15523098) , 1556-1576
UniLGL: Learning Uniform Place Recognition for FOV-Limited/Panoramic LiDAR Global Localization
LiDAR-based Global Localization (LGL) is an essential ingredient for autonomous robots. However, existing LGL methods typically consider only partial information (e.g., geometric features) from LiDAR observations or are designed for homogeneous LiDAR sensors, overlooking the uniformity in LGL. In this work, a uniform LGL method is proposed, termed UniLGL, which simultaneously achieves spatial and material uniformity, as well as sensor-type uniformity. The key idea of the proposed method is to encode the complete point cloud, which contains both geometric and material information, into a pair of Bird's Eye View (BEV) images (i.e., a spatial BEV image and an intensity BEV image), thereby transforming the LGL problem into a cascaded LiDAR Place Recognition (LPR) and pose estimation problem from the perspective of image fusion. An end-to-end multi-BEV fusion network is designed to extract uniform features, equipping UniLGL with spatial and material uniformity. To ensure robust LGL across heterogeneous LiDAR sensors, a viewpoint invariance hypothesis is introduced, which replaces the conventional translation equivariance assumption commonly used in existing LPR networks and supervises UniLGL to achieve sensor type uniformity in both global descriptors and local feature representations. Moreover, UniLGL introduces a pipeline that leverages a pre-trained single-image Vision Foundation Model (VFM) for feature extraction to enhance the multi-BEV fusion LPR network, enabling strong generalization with only a few LiDAR data for fine-tuning. Finally, based on the mapping between local features on the 2D BEV image and the point cloud, a robust global pose estimator is derived that determines the global minimum of the global pose on $\text{SE}(3)$ without requiring additional registration. To validate the effectiveness of the proposed uniform LGL, extensive benchmarks are conducted in real-world environments, and the results show that the proposed UniLGL is demonstratively competitive compared to other State-of-the-Art (SOTA) LGL methods. Furthermore, UniLGL has been deployed on diverse platforms, including full-size trucks and agile Micro Aerial Vehicles (MAVs), to enable high-precision localization and mapping as well as multi-MAV collaborative exploration in port and forest environments, demonstrating the applicability of UniLGL in industrial and field scenarios. The code will be released at https://github.com/shenhm516/UniLGL.