Yuan Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yuan Sun has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Jorge Ortiz
Department of Electrical and Computer Engineering, Rutgers University, New Brunswick, New Jersey, USA
5 shared publications - Navid Salami Pargoo
Electrical & Computer Engineering, Rutgers University, New Brunswick, New Jersey, USA
4 shared publications - Chengbo Zang
Columbia University, New York, USA
1 shared publication - Gil Zussman
Columbia University, New York, USA
1 shared publication - Javad Ghaderi
Department of Electrical Engineering, Columbia University, New York, NY, USA
1 shared publication - Joseph Florentine
ECE Department, Rutgers University, USA
1 shared publication
Latest Publications
- 24 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (4) , 5621-5634
VCHAR: A Variance-Driven Framework for Complex Human Activity Recognition With Vague Label
Complex human activity recognition (CHAR) remains a pivotal challenge within ubiquitous computing, especially in the context of smart environments. Existing studies typically require meticulous labeling of both lower level and higher level activities—a task that is labor-intensive and prone to errors, focusing on datasets that precisely label simple activities or their sequences. These approaches are often impractical in real-world settings due to the scarcity and inaccuracies of available datasets. In response to these challenges, we introduce variance-driven complex human activity recognition (VCHAR), a novel framework capable of detecting both low-level activities and their corresponding high-level activities without requiring precise temporal or sequential labeling of the lower level activities. We introduce a novel approach by applying the KL divergence as the objective function, modeling the outputs of lower level activities as distributions over target time intervals while concurrently detecting higher level activities. This method only requires vaguely labeled activities, removing the need for precise, second-by-second annotations. Additionally, to enhance the layperson's understanding of our model's results, we are the first to apply a novel generative method that explains the result of the sensor model through video, making the information more accessible and understandable. Our evaluation across three publicly available datasets demonstrates that VCHAR uses KL divergence to model the lower level activity distribution over specific time intervals, enhancing the accuracy of complex activity recognition. Furthermore, user studies confirm that VCHAR's explanations are more intelligible compared to existing methods, facilitating a broader understanding of complex activity recognition among nonexperts.
- 24 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (4) , 5621-5634
VCHAR: A Variance-Driven Framework for Complex Human Activity Recognition With Vague Label
Complex human activity recognition (CHAR) remains a pivotal challenge within ubiquitous computing, especially in the context of smart environments. Existing studies typically require meticulous labeling of both lower level and higher level activities—a task that is labor-intensive and prone to errors, focusing on datasets that precisely label simple activities or their sequences. These approaches are often impractical in real-world settings due to the scarcity and inaccuracies of available datasets. In response to these challenges, we introduce variance-driven complex human activity recognition (VCHAR), a novel framework capable of detecting both low-level activities and their corresponding high-level activities without requiring precise temporal or sequential labeling of the lower level activities. We introduce a novel approach by applying the KL divergence as the objective function, modeling the outputs of lower level activities as distributions over target time intervals while concurrently detecting higher level activities. This method only requires vaguely labeled activities, removing the need for precise, second-by-second annotations. Additionally, to enhance the layperson's understanding of our model's results, we are the first to apply a novel generative method that explains the result of the sensor model through video, making the information more accessible and understandable. Our evaluation across three publicly available datasets demonstrates that VCHAR uses KL divergence to model the lower level activity distribution over specific time intervals, enhancing the accuracy of complex activity recognition. Furthermore, user studies confirm that VCHAR's explanations are more intelligible compared to existing methods, facilitating a broader understanding of complex activity recognition among nonexperts.
- Open Access
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 92-97
Urban Sensing for Human-Centered Systems: A Modular Edge Framework for Real-Time Interaction
- 6 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 92-97
Open AccessUrban Sensing for Human-Centered Systems: A Modular Edge Framework for Real-Time Interaction
- 19 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (7) , 12407-12421
GeXSe (Generative Explanatory Sensor System): A Deep Generative Method for Human Activity Recognition of Smart Spaces IOT
Effective sensemaking is essential across various domains, particularly in Human Activity Recognition (HAR), where trust in system outputs plays a critical role. A key challenge in HAR systems for smart spaces lies in their reliance on sensor-based activity recognition, which often lacks interpretability. This highlights the pressing need for models that not only achieve high accuracy in processing raw sensor data but also provide comprehensible insights, enabling laypersons to effectively utilize this otherwise invisible information in smart environments.Our work introduces GeXSe, a novel multi-task framework that jointly models raw sensors for classification while also generating grounded visual explanations. At the core of GeXSe lies a Parallel Multi-Branch Multi-Layer Perceptron Fast Fourier Convolution (PMB-MLP-FFC) module tailored for multi-modal sensor fusion and explanation generation. PMB-MLP-FFC extracts interpretable features optimized for both tasks through multi-branch parallel convolutions and Fourier transforms. We validated GeXSe across 3 diverse public datasets of daily activities recorded by microphone, motion, and environmental sensors. Results show superior activity recognition over baseline models. Furthermore, human evaluation studies confirm the generated visual explanations enhance understanding and trust compared to purely sensor-based outputs.
- 19 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (7) , 12407-12421
GeXSe (Generative Explanatory Sensor System): A Deep Generative Method for Human Activity Recognition of Smart Spaces IOT
Effective sensemaking is essential across various domains, particularly in Human Activity Recognition (HAR), where trust in system outputs plays a critical role. A key challenge in HAR systems for smart spaces lies in their reliance on sensor-based activity recognition, which often lacks interpretability. This highlights the pressing need for models that not only achieve high accuracy in processing raw sensor data but also provide comprehensible insights, enabling laypersons to effectively utilize this otherwise invisible information in smart environments.Our work introduces GeXSe, a novel multi-task framework that jointly models raw sensors for classification while also generating grounded visual explanations. At the core of GeXSe lies a Parallel Multi-Branch Multi-Layer Perceptron Fast Fourier Convolution (PMB-MLP-FFC) module tailored for multi-modal sensor fusion and explanation generation. PMB-MLP-FFC extracts interpretable features optimized for both tasks through multi-branch parallel convolutions and Fourier transforms. We validated GeXSe across 3 diverse public datasets of daily activities recorded by microphone, motion, and environmental sensors. Results show superior activity recognition over baseline models. Furthermore, human evaluation studies confirm the generated visual explanations enhance understanding and trust compared to purely sensor-based outputs.
- Open Access
- 5 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 76-80
Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF
Reinforcement Learning from Human Feedback (RLHF) is popular in large language models (LLMs), whereas traditional Reinforcement Learning (RL) often falls short. Current autonomous driving methods typically utilize either human feedback in machine learning, including RL, or LLMs. Most feedback guides the car agent's learning process (e.g., controlling the car). RLHF is usually applied in the fine-tuning step, requiring direct human "preferences," which are not commonly used in optimizing autonomous driving models. In this research, we innovatively combine RLHF and LLMs to enhance autonomous driving safety. Training a model with human guidance from scratch is inefficient. Our framework starts with a pre-trained autonomous car agent model and implements multiple human-controlled agents, such as cars and pedestrians, to simulate real-life road environments. The autonomous car model is not directly controlled by humans. We integrate both physical and physiological feedback to fine-tune the model, optimizing this process using LLMs. This multi-agent interactive environment ensures safe, realistic interactions before real-world application. Finally, we will validate our model using data gathered from real-life testbeds located in New Jersey and New York City.
- 5 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 76-80
Open AccessOptimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF
Reinforcement Learning from Human Feedback (RLHF) is popular in large language models (LLMs), whereas traditional Reinforcement Learning (RL) often falls short. Current autonomous driving methods typically utilize either human feedback in machine learning, including RL, or LLMs. Most feedback guides the car agent's learning process (e.g., controlling the car). RLHF is usually applied in the fine-tuning step, requiring direct human "preferences," which are not commonly used in optimizing autonomous driving models. In this research, we innovatively combine RLHF and LLMs to enhance autonomous driving safety. Training a model with human guidance from scratch is inefficient. Our framework starts with a pre-trained autonomous car agent model and implements multiple human-controlled agents, such as cars and pedestrians, to simulate real-life road environments. The autonomous car model is not directly controlled by humans. We integrate both physical and physiological feedback to fine-tune the model, optimizing this process using LLMs. This multi-agent interactive environment ensures safe, realistic interactions before real-world application. Finally, we will validate our model using data gathered from real-life testbeds located in New Jersey and New York City.
- Open Access
- 9 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 336-337
Poster Abstract: A Testbed for Context Representation in Physical Spaces | The 22nd International Conference on Information Processing in Sensor Networks
The Internet of Things (IoT) offers transformative potential when combined with Machine Learning (ML), but labeling diverse IoT data remains challenging. To address this, we introduce SenseScape Testbed, an IoT experimentation platform for indoor environments with wireless sensor nodes, robots, and location-tracking nodes. This testbed enables IoT applications such as human activity recognition and indoor mobility tracking, supporting energy efficiency, occupant comfort, and context representation while providing a versatile environment for labeling and testing to advance ML algorithms tailored for IoT applications.
- 9 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 336-337
Open AccessPoster Abstract: A Testbed for Context Representation in Physical Spaces | The 22nd International Conference on Information Processing in Sensor Networks
The Internet of Things (IoT) offers transformative potential when combined with Machine Learning (ML), but labeling diverse IoT data remains challenging. To address this, we introduce SenseScape Testbed, an IoT experimentation platform for indoor environments with wireless sensor nodes, robots, and location-tracking nodes. This testbed enables IoT applications such as human activity recognition and indoor mobility tracking, supporting energy efficiency, occupant comfort, and context representation while providing a versatile environment for labeling and testing to advance ML algorithms tailored for IoT applications.