Lingfeng Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Lingfeng Zhang has a total of 42 co-authors. Here are the top co-authors by number of shared publications:
Huaihai Lyu
Institute of Automation, Chinese Academy of Sciences
2 shared publications- Shuyi Zhang
Institute of Automation of Chinese Academy of Sciences
2 shared publications Wei Zhou
Cardiff University
2 shared publicationsXiaoshuai Hao
Tsinghua University
2 shared publications- Xiaoshuai Hao
Beijing Academy of Artificial Intelligence, Beijing, China
2 shared publications Yingbo Tang
Institute of Automation, Chinese Academy of Sciences
2 shared publications
Latest Publications
- Top Cited Papers
- 19 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (3) , 2943-2950
Stairway to Success: An Online Floor-Aware Zero-Shot Object-Goal Navigation Framework via LLM-Driven Coarse-to-Fine Exploration
Deployable service and delivery robots struggle to navigate multi-floor buildings to reach object goals, as existing systems fail due to single-floor assumptions and requirements for offline, globally consistent maps. Multi-floor environments pose unique challenges including cross-floor transitions and vertical spatial reasoning, especially navigating unknown buildings. Object-Goal Navigation benchmarks like HM3D and MP3D also capture this multi-floor reality, yet current methods lack support for online, floor-aware navigation. To bridge this gap, we propose ASCENT, an online framework for Zero-Shot Object-Goal Navigation that enables robots to operate without pre-built maps or retraining on new object categories. It introduces: 1) a Multi-Floor Abstraction module that dynamically constructs hierarchical representations with stair-aware obstacle mapping and cross-floor topology modeling, and 2) a Coarse-to-Fine Reasoning module that combines frontier ranking with LLM-driven contextual analysis for multi-floor navigation decisions. We evaluate on HM3D and MP3D benchmarks, outperforming state-of-the-art zero-shot approaches, and demonstrate real-world deployment on a quadruped robot.
- 19 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (3) , 2943-2950
Top Cited PapersStairway to Success: An Online Floor-Aware Zero-Shot Object-Goal Navigation Framework via LLM-Driven Coarse-to-Fine Exploration
Deployable service and delivery robots struggle to navigate multi-floor buildings to reach object goals, as existing systems fail due to single-floor assumptions and requirements for offline, globally consistent maps. Multi-floor environments pose unique challenges including cross-floor transitions and vertical spatial reasoning, especially navigating unknown buildings. Object-Goal Navigation benchmarks like HM3D and MP3D also capture this multi-floor reality, yet current methods lack support for online, floor-aware navigation. To bridge this gap, we propose ASCENT, an online framework for Zero-Shot Object-Goal Navigation that enables robots to operate without pre-built maps or retraining on new object categories. It introduces: 1) a Multi-Floor Abstraction module that dynamically constructs hierarchical representations with stair-aware obstacle mapping and cross-floor topology modeling, and 2) a Coarse-to-Fine Reasoning module that combines frontier ranking with LLM-driven contextual analysis for multi-floor navigation decisions. We evaluate on HM3D and MP3D benchmarks, outperforming state-of-the-art zero-shot approaches, and demonstrate real-world deployment on a quadruped robot.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12745-12752
Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12745-12752
Open AccessVideo-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thought
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12706-12713
RoboAfford: A Dataset and Benchmark for Enhancing Object and Spatial Affordance Learning in Robot Manipulation
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12706-12713
Open AccessRoboAfford: A Dataset and Benchmark for Enhancing Object and Spatial Affordance Learning in Robot Manipulation
- Open Access
- 4 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Evaluating GPT-4o's Embodied Intelligence: A Comprehensive Empirical Study
This paper explores the embodied intelligence capabilities of GPT-4o, emphasizing its performance in key areas such as embodied reasoning, embodied manipulation, and embodied navigation. We are the first to systematically evaluate GPT-4o on embodied intelligence tasks. As an advanced language model, GPT-4o demonstrates significant potential in complex tasks by integrating visual and linguistic understanding, with particularly noteworthy abilities in image generation. In the embodied reasoning section, the study evaluates GPT-4o's performance in perception, spatial reasoning, temporal reasoning, planning, and causal reasoning. The findings reveal how the model extracts information from images to make informed inferences. The embodied manipulation section analyzes its applications in object understanding, environmental perception, and task planning, showcasing the model's adaptability in dynamic environments. Additionally, the embodied navigation section focuses on GPT-4o's ability to process navigation instructions, perform map reasoning, infer trajectories, and predict actions, indicating its effectiveness in navigation tasks. In summary, GPT-4o shows remarkable advancements in the field of embodied intelligence. Future development plans aim to further enhance its capabilities in multimodal interactions and complex environmental adaptability, laying a foundation for achieving higher levels of artificial intelligence. Through ongoing research and optimization, GPT-4o is poised to play a greater role in the practical applications of embodied intelligence.
- 4 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessEvaluating GPT-4o's Embodied Intelligence: A Comprehensive Empirical Study
This paper explores the embodied intelligence capabilities of GPT-4o, emphasizing its performance in key areas such as embodied reasoning, embodied manipulation, and embodied navigation. We are the first to systematically evaluate GPT-4o on embodied intelligence tasks. As an advanced language model, GPT-4o demonstrates significant potential in complex tasks by integrating visual and linguistic understanding, with particularly noteworthy abilities in image generation. In the embodied reasoning section, the study evaluates GPT-4o's performance in perception, spatial reasoning, temporal reasoning, planning, and causal reasoning. The findings reveal how the model extracts information from images to make informed inferences. The embodied manipulation section analyzes its applications in object understanding, environmental perception, and task planning, showcasing the model's adaptability in dynamic environments. Additionally, the embodied navigation section focuses on GPT-4o's ability to process navigation instructions, perform map reasoning, infer trajectories, and predict actions, indicating its effectiveness in navigation tasks. In summary, GPT-4o shows remarkable advancements in the field of embodied intelligence. Future development plans aim to further enhance its capabilities in multimodal interactions and complex environmental adaptability, laying a foundation for achieving higher levels of artificial intelligence. Through ongoing research and optimization, GPT-4o is poised to play a greater role in the practical applications of embodied intelligence.
- Open Access
- 30 June 2025
- Published by Wiley
MapNav: A Novel Memory Representation via Annotated Semantic Maps for VLM-based Vision-and-Language Navigation
Vision-and-language navigation (VLN) is a key task in Embodied AI, requiring agents to navigate diverse and unseen environments while following natural language instructions. Traditional approaches rely heavily on historical observations as spatio-temporal contexts for decision making, leading to significant storage and computational overhead. In this paper, we introduce MapNav, a novel end-to-end VLN model that leverages Annotated Semantic Map (ASM) to replace historical frames. Specifically, our approach constructs a top-down semantic map at the start of each episode and update it at each timestep, allowing for precise object mapping and structured navigation information. Then, we enhance this map with explicit textual labels for key regions, transforming abstract semantics into clear navigation cues and generate our ASM. MapNav agent using the constructed ASM as input, and use the powerful end-to-end capabilities of VLM to empower VLN. Extensive experiments demonstrate that MapNav achieves state-of-the-art (SOTA) performance in both simulated and real-world environments, validating the effectiveness of our method. Moreover, we will release our ASM generation source code and dataset to ensure reproducibility, contributing valuable resources to the field. We believe that our proposed Map-Nav can be used as a new memory representation method in VLN, paving the way for future research in this field.
- 30 June 2025
- Published by Wiley
Open AccessMapNav: A Novel Memory Representation via Annotated Semantic Maps for VLM-based Vision-and-Language Navigation
Vision-and-language navigation (VLN) is a key task in Embodied AI, requiring agents to navigate diverse and unseen environments while following natural language instructions. Traditional approaches rely heavily on historical observations as spatio-temporal contexts for decision making, leading to significant storage and computational overhead. In this paper, we introduce MapNav, a novel end-to-end VLN model that leverages Annotated Semantic Map (ASM) to replace historical frames. Specifically, our approach constructs a top-down semantic map at the start of each episode and update it at each timestep, allowing for precise object mapping and structured navigation information. Then, we enhance this map with explicit textual labels for key regions, transforming abstract semantics into clear navigation cues and generate our ASM. MapNav agent using the constructed ASM as input, and use the powerful end-to-end capabilities of VLM to empower VLN. Extensive experiments demonstrate that MapNav achieves state-of-the-art (SOTA) performance in both simulated and real-world environments, validating the effectiveness of our method. Moreover, we will release our ASM generation source code and dataset to ensure reproducibility, contributing valuable resources to the field. We believe that our proposed Map-Nav can be used as a new memory representation method in VLN, paving the way for future research in this field.
- Open Access
- 22 April 2025
- Published by Wiley
Evaluating GPT-4o's Embodied Intelligence: A Comprehensive Empirical Study
This paper explores the embodied intelligence capabilities of GPT-4o, emphasizing its performance in key areas such as embodied reasoning, embodied manipulation, and embodied navigation. We are the first to systematically evaluate GPT-4o on embodied intelligence tasks. As an advanced language model, GPT-4o demonstrates significant potential in complex tasks by integrating visual and linguistic understanding, with particularly noteworthy abilities in image generation. In the embodied reasoning section, the study evaluates GPT-4o's performance in perception, spatial reasoning, temporal reasoning, planning, and causal reasoning. The findings reveal how the model extracts information from images to make informed inferences. The embodied manipulation section analyzes its applications in object understanding, environmental perception, and task planning, showcasing the model's adaptability in dynamic environments. Additionally, the embodied navigation section focuses on GPT-4o's ability to process navigation instructions, perform map reasoning, infer trajectories, and predict actions, indicating its effectiveness in navigation tasks. In summary, GPT-4o shows remarkable advancements in the field of embodied intelligence. Future development plans aim to further enhance its capabilities in multimodal interactions and complex environmental adaptability, laying a foundation for achieving higher levels of artificial intelligence. Through ongoing research and optimization, GPT-4o is poised to play a greater role in the practical applications of embodied intelligence.
- 22 April 2025
- Published by Wiley
Open AccessEvaluating GPT-4o's Embodied Intelligence: A Comprehensive Empirical Study
This paper explores the embodied intelligence capabilities of GPT-4o, emphasizing its performance in key areas such as embodied reasoning, embodied manipulation, and embodied navigation. We are the first to systematically evaluate GPT-4o on embodied intelligence tasks. As an advanced language model, GPT-4o demonstrates significant potential in complex tasks by integrating visual and linguistic understanding, with particularly noteworthy abilities in image generation. In the embodied reasoning section, the study evaluates GPT-4o's performance in perception, spatial reasoning, temporal reasoning, planning, and causal reasoning. The findings reveal how the model extracts information from images to make informed inferences. The embodied manipulation section analyzes its applications in object understanding, environmental perception, and task planning, showcasing the model's adaptability in dynamic environments. Additionally, the embodied navigation section focuses on GPT-4o's ability to process navigation instructions, perform map reasoning, infer trajectories, and predict actions, indicating its effectiveness in navigation tasks. In summary, GPT-4o shows remarkable advancements in the field of embodied intelligence. Future development plans aim to further enhance its capabilities in multimodal interactions and complex environmental adaptability, laying a foundation for achieving higher levels of artificial intelligence. Through ongoing research and optimization, GPT-4o is poised to play a greater role in the practical applications of embodied intelligence.
- 10 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (9) , 16281-16296
Railway Side Slope Hazard Detection System Based on Generative Models
The use of drones for image monitoring has gained popularity in railway operations due to several significant advantages. Drones provide high-resolution aerial imagery that covers vast and hard-to-reach areas, enabling comprehensive monitoring of the entire railway network. They offer flexibility and rapid deployment, allowing for real-time data collection and analysis, which is crucial for early detection of potential risks such as landslides, erosion, or track obstructions. Moreover, drones can operate in challenging weather conditions and difficult terrains, ensuring continuous monitoring where traditional methods might fail. However, data collected from drones for railway side slope monitoring is scarce and the railway side slope defect identification and risk assessment have not been fully studied. Furthermore, its frequency is often limited due to operational safety concerns, leading to insufficient data acquisition. To address these limitations, this study innovatively employs diffusion models augmented by large language models (LLM) to enhance training datasets with high-quality synthetic images that encapsulate various defect scenarios. The enhanced YOLO system, integrated with attention mechanisms and LLM-augmented diffusion generation, significantly improves detection accuracy by enabling the model to better generalize under varied real-world conditions. In this study, we collected 600 images from hazardous real-world environments and provided a comprehensive evaluation framework, demonstrating superior performance metrics compared to traditional methods. This approach offers a promising solution for automating and enhancing the reliability of geological hazard monitoring along railway side slopes. The source dataset will be open-sourced at https://github.com/CRH380-CR400/Dataset-of-slope-diseases-along-railway-lines.
- 10 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (9) , 16281-16296
Railway Side Slope Hazard Detection System Based on Generative Models
The use of drones for image monitoring has gained popularity in railway operations due to several significant advantages. Drones provide high-resolution aerial imagery that covers vast and hard-to-reach areas, enabling comprehensive monitoring of the entire railway network. They offer flexibility and rapid deployment, allowing for real-time data collection and analysis, which is crucial for early detection of potential risks such as landslides, erosion, or track obstructions. Moreover, drones can operate in challenging weather conditions and difficult terrains, ensuring continuous monitoring where traditional methods might fail. However, data collected from drones for railway side slope monitoring is scarce and the railway side slope defect identification and risk assessment have not been fully studied. Furthermore, its frequency is often limited due to operational safety concerns, leading to insufficient data acquisition. To address these limitations, this study innovatively employs diffusion models augmented by large language models (LLM) to enhance training datasets with high-quality synthetic images that encapsulate various defect scenarios. The enhanced YOLO system, integrated with attention mechanisms and LLM-augmented diffusion generation, significantly improves detection accuracy by enabling the model to better generalize under varied real-world conditions. In this study, we collected 600 images from hazardous real-world environments and provided a comprehensive evaluation framework, demonstrating superior performance metrics compared to traditional methods. This approach offers a promising solution for automating and enhancing the reliability of geological hazard monitoring along railway side slopes. The source dataset will be open-sourced at https://github.com/CRH380-CR400/Dataset-of-slope-diseases-along-railway-lines.