Yanchen Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Yanchen Liu has a total of 31 co-authors. Here are the top co-authors by number of shared publications:
- Xiaofan Jiang
Columbia University, New York, New York, USA
7 shared publications - Minghui Zhao
Columbia University, New York, USA
6 shared publications - Stephen Xia
Northwestern University, Evanston, Illinois, USA
5 shared publications - Kaiyuan Hou
Columbia University, New York, USA
3 shared publications - Xia Zhou
Computer Science, Columbia University, New York, New York, USA
3 shared publications - Changxi Zheng
Columbia University, New York, USA
2 shared publications
Latest Publications
- Open Access
- 21 April 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Internet of Things
- Vol. 7 (2) , 1-32
EmbodiedFly: Embodied LLM Agent with an Autonomous Reconfigurable Drone
Large Language Models (LLMs) have shown immense human-like capabilities for reasoning and generating digital content. However, their ability to freely sense, interact, and actuate the physical domain remains significantly limited due to three fundamental challenges: (1) physical environments require specialized sensors for different tasks, yet deploying dedicated sensors for each application is impractical; (2) events and objects of interest are often localized to small areas within large spaces, making them difficult to detect with static sensor networks; and (3) foundation models need flexible actuation capabilities to meaningfully interact with the physical world. To bridge this gap, we introduce EmbodiedFly, an embodied LLM agent combining a foundation model pipeline with a reconfigurable drone platform to observe, understand, and interact with the physical world. Our co-design approach features (1) a FM orchestration framework connecting multiple LLMs, VLMs, and an open-set object detection model; (2) a novel image segmentation technique that identifies task-relevant areas; and (3) a custom drone platform that autonomously reconfigures with appropriate sensors and actuators based on commands from the FM orchestration framework. Through real-world deployments, we demonstrate that EmbodiedFly completes diverse physical tasks with up to \(85\%\) higher success rates compared to traditional approaches leveraging static deployments.- 21 April 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Internet of Things
- Vol. 7 (2) , 1-32
Open AccessEmbodiedFly: Embodied LLM Agent with an Autonomous Reconfigurable Drone
Large Language Models (LLMs) have shown immense human-like capabilities for reasoning and generating digital content. However, their ability to freely sense, interact, and actuate the physical domain remains significantly limited due to three fundamental challenges: (1) physical environments require specialized sensors for different tasks, yet deploying dedicated sensors for each application is impractical; (2) events and objects of interest are often localized to small areas within large spaces, making them difficult to detect with static sensor networks; and (3) foundation models need flexible actuation capabilities to meaningfully interact with the physical world. To bridge this gap, we introduce EmbodiedFly, an embodied LLM agent combining a foundation model pipeline with a reconfigurable drone platform to observe, understand, and interact with the physical world. Our co-design approach features (1) a FM orchestration framework connecting multiple LLMs, VLMs, and an open-set object detection model; (2) a novel image segmentation technique that identifies task-relevant areas; and (3) a custom drone platform that autonomously reconfigures with appropriate sensors and actuators based on commands from the FM orchestration framework. Through real-world deployments, we demonstrate that EmbodiedFly completes diverse physical tasks with up to \(85\%\) higher success rates compared to traditional approaches leveraging static deployments. - 17 January 2026
- Published by Springer Nature in Optical Review
- Vol. 33 (1) , 135-141
Multi-Gbps visible light communication with high-efficiency, low-speckle contrast white laser light
- 17 January 2026
- Published by Springer Nature in Optical Review
- Vol. 33 (1) , 135-141
Multi-Gbps visible light communication with high-efficiency, low-speckle contrast white laser light
- 16 November 2025
- Published by Springer Nature
- p. 211-214
Multi-Gbps Visible Light Communication with High-Efficiency, Low-speckle Contrast White Laser Light
- 16 November 2025
- Published by Springer Nature
- p. 211-214
Multi-Gbps Visible Light Communication with High-Efficiency, Low-speckle Contrast White Laser Light
- Open Access
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 463-476
FlexiFly: Interfacing the Physical World with Foundation Models Empowered by Reconfigurable Drone Systems
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 463-476
Open AccessFlexiFly: Interfacing the Physical World with Foundation Models Empowered by Reconfigurable Drone Systems
- Open Access
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 7-12
DomAIn: Towards Programless Smart Homes
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 7-12
Open AccessDomAIn: Towards Programless Smart Homes
- Open Access
- 4 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1742-1744
SPECTRA: A Drone-based Multispectral Sensing Platform for Complex Environment Perception
- 4 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1742-1744
Open AccessSPECTRA: A Drone-based Multispectral Sensing Platform for Complex Environment Perception
- 18 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (9) , 7243-7254
Textureless Deformable Object Tracking With Invisible Markers
Tracking and reconstructing deformable objects with little texture is challenging due to the lack of features. Here we introduce “invisible markers” for accurate and robust correspondence matching and tracking. Our markers are visible only under ultraviolet (UV) light. We build a novel imaging system for capturing videos of deformed objects under their original untouched appearance (which may have little texture) and, simultaneously, with our markers. We develop an algorithm that first establishes accurate correspondences using video frames with markers, and then transfers them to the untouched views as ground-truth labels. In this way, we are able to generate high-quality labeled data for training learning-based algorithms. We contribute a large real-world dataset, DOT, for tracking deformable objects with little or no texture. Our dataset has about one million video frames of various types of deformable objects. We provide ground truth tracked correspondences in both 2D and 3D. We benchmark state-of-the-art methods on optical flow and deformable object reconstruction using our dataset, which poses great challenges. By training on DOT, their performance significantly improves, not only on our dataset, but also on other unseen data.
- 18 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 47 (9) , 7243-7254
Textureless Deformable Object Tracking With Invisible Markers
Tracking and reconstructing deformable objects with little texture is challenging due to the lack of features. Here we introduce “invisible markers” for accurate and robust correspondence matching and tracking. Our markers are visible only under ultraviolet (UV) light. We build a novel imaging system for capturing videos of deformed objects under their original untouched appearance (which may have little texture) and, simultaneously, with our markers. We develop an algorithm that first establishes accurate correspondences using video frames with markers, and then transfers them to the untouched views as ground-truth labels. In this way, we are able to generate high-quality labeled data for training learning-based algorithms. We contribute a large real-world dataset, DOT, for tracking deformable objects with little or no texture. Our dataset has about one million video frames of various types of deformable objects. We provide ground truth tracked correspondences in both 2D and 3D. We benchmark state-of-the-art methods on optical flow and deformable object reconstruction using our dataset, which poses great challenges. By training on DOT, their performance significantly improves, not only on our dataset, but also on other unseen data.
- Open Access
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 99-109
RECA: A Multi-Task Deep Reinforcement Learning-Based Recommender System for Co-Optimizing Energy, Comfort and Air Quality in Commercial Buildings
We present the design and implementation of RECA, a novel human-centric recommender system for co-optimizing energy consumption, comfort and air quality in commercial buildings. Existing works generally optimize these objectives separately, or by only controlling energy consuming resources within the building without directly engaging occupants. We develop a deep reinforcement learning architecture based on multitask learning, demonstrate how it can be used to jointly learn energy savings, comfort and air quality improvements for different actions, and build a recommender system with humans-in-the-loop. Through real deployments in multiple commercial buildings, we found that RECA has the potential to further reduce energy consumption by up to in energy-focused optimization, improve all objectives by in joint optimization, and improve thermal comfort by up to in comfort and air quality focused optimization, over existing solutions.
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 99-109
Open AccessRECA: A Multi-Task Deep Reinforcement Learning-Based Recommender System for Co-Optimizing Energy, Comfort and Air Quality in Commercial Buildings
We present the design and implementation of RECA, a novel human-centric recommender system for co-optimizing energy consumption, comfort and air quality in commercial buildings. Existing works generally optimize these objectives separately, or by only controlling energy consuming resources within the building without directly engaging occupants. We develop a deep reinforcement learning architecture based on multitask learning, demonstrate how it can be used to jointly learn energy savings, comfort and air quality improvements for different actions, and build a recommender system with humans-in-the-loop. Through real deployments in multiple commercial buildings, we found that RECA has the potential to further reduce energy consumption by up to in energy-focused optimization, improve all objectives by in joint optimization, and improve thermal comfort by up to in comfort and air quality focused optimization, over existing solutions.
- Open Access
- 16 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 427-438
A Data-Driven and Human-Centric EV Charging Recommendation System at City-Scale
Electric vehicles (EVs) have gained widespread popularity in recent years, and the scheduling and routing of EV charging have impacted the welfare of both EV drivers and the grid. In this paper, we present a practical, data-driven, and human-centric EV charging recommendation system at the city-scale based on deep reinforcement learning (DRL). The system co-optimizes the welfare of both the EV drivers and the grid. We augmented and aggregated data from various sources, including public data, location-based data companies, and government authorities, with different formats and time granularities. The data includes EV charger information, grid capacity, EV driving behavior information, and city-scale mobility. We created a 30-day per-minute unified EV charger information dataset with charging prices and grid capacity, as well as an EV driving behavior dataset with location and State of Charge (SoC) information. Our evaluation of the recommendation system shows that it is able to provide recommendations that reduce the average driver-to-charger distance and minimize the number of times chargers switch to a different driver. The dataset we prepared for training the DRL agent, including augmented EV driving data and charging station information, will be open-sourced to benefit future research in the community.
- 16 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 427-438
Open AccessA Data-Driven and Human-Centric EV Charging Recommendation System at City-Scale
Electric vehicles (EVs) have gained widespread popularity in recent years, and the scheduling and routing of EV charging have impacted the welfare of both EV drivers and the grid. In this paper, we present a practical, data-driven, and human-centric EV charging recommendation system at the city-scale based on deep reinforcement learning (DRL). The system co-optimizes the welfare of both the EV drivers and the grid. We augmented and aggregated data from various sources, including public data, location-based data companies, and government authorities, with different formats and time granularities. The data includes EV charger information, grid capacity, EV driving behavior information, and city-scale mobility. We created a 30-day per-minute unified EV charger information dataset with charging prices and grid capacity, as well as an EV driving behavior dataset with location and State of Charge (SoC) information. Our evaluation of the recommendation system shows that it is able to provide recommendations that reduce the average driver-to-charger distance and minimize the number of times chargers switch to a different driver. The dataset we prepared for training the DRL agent, including augmented EV driving data and charging station information, will be open-sourced to benefit future research in the community.
- Open Access
- 9 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 370-371
Demo Abstract: Seamless High-Speed Optical Communication for Mobile Wide-Area Using Diffused Infrared Laser | Proceedings of the 22nd International Conference on Information Processing in Sensor Networks
We present a demo showcasing the capabilities of an infrared (IR)-based light communication system with a movable receiver. The system employs IR laser (VCSEL) together with scattering lens as the transmitter and an avalanche photo-diode (APD) with collimator as the receiver, using the reflection cross section existing in the environment (ceilings, walls, etc.) to spread the coverage of the communication system. The demonstration involves transmitting messages encoded as binary data through modulated IR light signals to the movable receiver. The receiver captures the signals using the APD, which are then decoded to retrieve the original message. The demonstration aims to showcase the robustness of the system against various sources of interference and the flexibility of the movable receiver to capture signals from different angles and positions. We believe that our demonstration will be useful for showcasing the potential of IR-based light communication in various applications (e.g., wireless VR/AR and high speed reliable data link) over more traditional communication methods that have limitations such as privacy and bandwidth.
- 9 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 370-371
Open AccessDemo Abstract: Seamless High-Speed Optical Communication for Mobile Wide-Area Using Diffused Infrared Laser | Proceedings of the 22nd International Conference on Information Processing in Sensor Networks
We present a demo showcasing the capabilities of an infrared (IR)-based light communication system with a movable receiver. The system employs IR laser (VCSEL) together with scattering lens as the transmitter and an avalanche photo-diode (APD) with collimator as the receiver, using the reflection cross section existing in the environment (ceilings, walls, etc.) to spread the coverage of the communication system. The demonstration involves transmitting messages encoded as binary data through modulated IR light signals to the movable receiver. The receiver captures the signals using the APD, which are then decoded to retrieve the original message. The demonstration aims to showcase the robustness of the system against various sources of interference and the flexibility of the movable receiver to capture signals from different angles and positions. We believe that our demonstration will be useful for showcasing the potential of IR-based light communication in various applications (e.g., wireless VR/AR and high speed reliable data link) over more traditional communication methods that have limitations such as privacy and bandwidth.