Yingjian Song
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yingjian Song has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
- WenZhan Song
College of Engineering, University of Georgia, Athens, GA 30602, USA
9 shared publications - Jiayu Chen
School of Electrical and Computer Engineering, The University of Georgia, Athens, Georgia, USA
6 shared publications - Xiang Zhang
Computer Science, University of North Carolina (UNC) at Charlotte, Charlotte, North Carolina, USA
6 shared publications - Yida Zhang
University of Georgia, Athens, USA
6 shared publications - Zaid Farooq Pitafi
Electrical Computer Engineering, University of Georgia, Athens, Georgia, USA
6 shared publications - Zixuan Zeng
Electrical Computer Engineering, University of Georgia, Athens, Georgia, USA
6 shared publications
Latest Publications
- Open Access
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-31
Contactless Sleep Apnea Detection with Bodyseismography
Sleep apnea is a prevalent yet underdiagnosed sleep disorder. Existing monitoring approaches largely rely on wearable devices or smartphone-based systems, which can be uncomfortable, require active user engagement, or be sensitive to environmental conditions. In this paper, we present a feasibility study of a contactless, engagement-free sleep-apnea screening approach using an under-bed horizontal (head-to-foot) seismic sensor that captures micro vibrations from respiration, heartbeat, and movement. We show that the horizontal axis provides a clearer respiratory signature than the vertical axis, enabling respiration-focused signal analysis. From the seismic signal, we extract 15 features across three families—respiratory heartbeat, and movement—and formulate a minute-level three-class classification task: Normal, OSA+hypopnea , and CSA. Using a strict patient-independent 5-fold cross-validation protocol on 116 subjects, we achieve 85.5% balanced accuracy and 80.6% macro F1 with a random forest classifier; class-wise balanced accuracies are 96.3% (Normal), 75.0% (OSA+hypopnea), and 85.2% (CSA). Overall, this work demonstrates the feasibility of under-bed seismic sensing for window-level apnea-related state classification.
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-31
Open AccessContactless Sleep Apnea Detection with Bodyseismography
Sleep apnea is a prevalent yet underdiagnosed sleep disorder. Existing monitoring approaches largely rely on wearable devices or smartphone-based systems, which can be uncomfortable, require active user engagement, or be sensitive to environmental conditions. In this paper, we present a feasibility study of a contactless, engagement-free sleep-apnea screening approach using an under-bed horizontal (head-to-foot) seismic sensor that captures micro vibrations from respiration, heartbeat, and movement. We show that the horizontal axis provides a clearer respiratory signature than the vertical axis, enabling respiration-focused signal analysis. From the seismic signal, we extract 15 features across three families—respiratory heartbeat, and movement—and formulate a minute-level three-class classification task: Normal, OSA+hypopnea , and CSA. Using a strict patient-independent 5-fold cross-validation protocol on 116 subjects, we achieve 85.5% balanced accuracy and 80.6% macro F1 with a random forest classifier; class-wise balanced accuracies are 96.3% (Normal), 75.0% (OSA+hypopnea), and 85.2% (CSA). Overall, this work demonstrates the feasibility of under-bed seismic sensing for window-level apnea-related state classification.
- Open Access
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-44
Peak-Detector: Explainable Peak Detection via Instruction-Tuned Large Language Models in Physiological Signal
Accurate peak detection across diverse cardiac physiological signals, including the Electrocardiogram (ECG), Photoplethysmogram (PPG), Ballistocardiogram (BCG), and Bodyseismography (BSG), is fundamental for cardiovascular monitoring but is often hindered by artifacts and signal variability. Conventional algorithms are typically engineered with expert knowledge for a single signal modality, limiting their generalizability. Conversely, deep learning-based methods often lack interpretability, limiting transparency for expert verification and hindering expert-computer interaction. To address these limitations, we introduce Peak-Detector, a novel framework that leverages instruction-tuned Large Language Models (LLMs) for robust, cross-modal, and explainable peak detection. A core innovation of our framework is a “peak-representation” technique that transforms time-series data into a condensed format, preserving critical event information while significantly reducing signal length. This representation provides a crucial inductive bias, guiding the LLM to reason over physiologically meaningful events rather than raw, noisy data. The model is optimized through a two-stage process: supervised fine-tuning (SFT) followed by reinforcement learning (RL) with a multi-objective reward function. The model's self-explanation capabilities are cultivated by fine-tuning on a custom-built Peak-Explanation dataset. Across four modalities—ECG, PPG, BCG, and BSG—spanning seven datasets (six public benchmarks plus one real-world cohort), Peak-Detector demonstrates strong cross-modal performance, achieving best or tied-best detection under clinically relevant temporal tolerance. Beyond accuracy, the generated rationales surface failure modes and support verification and error analysis. Together, these results indicate a transparent and generalizable framework for trustworthy peak analysis and cardiovascular metric extraction.
- 15 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (2) , 1-44
Open AccessPeak-Detector: Explainable Peak Detection via Instruction-Tuned Large Language Models in Physiological Signal
Accurate peak detection across diverse cardiac physiological signals, including the Electrocardiogram (ECG), Photoplethysmogram (PPG), Ballistocardiogram (BCG), and Bodyseismography (BSG), is fundamental for cardiovascular monitoring but is often hindered by artifacts and signal variability. Conventional algorithms are typically engineered with expert knowledge for a single signal modality, limiting their generalizability. Conversely, deep learning-based methods often lack interpretability, limiting transparency for expert verification and hindering expert-computer interaction. To address these limitations, we introduce Peak-Detector, a novel framework that leverages instruction-tuned Large Language Models (LLMs) for robust, cross-modal, and explainable peak detection. A core innovation of our framework is a “peak-representation” technique that transforms time-series data into a condensed format, preserving critical event information while significantly reducing signal length. This representation provides a crucial inductive bias, guiding the LLM to reason over physiologically meaningful events rather than raw, noisy data. The model is optimized through a two-stage process: supervised fine-tuning (SFT) followed by reinforcement learning (RL) with a multi-objective reward function. The model's self-explanation capabilities are cultivated by fine-tuning on a custom-built Peak-Explanation dataset. Across four modalities—ECG, PPG, BCG, and BSG—spanning seven datasets (six public benchmarks plus one real-world cohort), Peak-Detector demonstrates strong cross-modal performance, achieving best or tied-best detection under clinically relevant temporal tolerance. Beyond accuracy, the generated rationales surface failure modes and support verification and error analysis. Together, these results indicate a transparent and generalizable framework for trustworthy peak analysis and cardiovascular metric extraction.
- Open Access
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-31
SelfDenoiser: Self-supervised Seismic Signal Denoiser for Continuous and Contactless Cardiac Monitoring
Cardiovascular diseases (CVDs) remain a major global health challenge, highlighting the urgent need for advanced cardiac monitoring solutions. Continuous, contactless cardiac monitoring using seismic sensors enables comfortable, privacy-preserving assessments by capturing subtle heart vibrations. However, these systems are highly susceptible to diverse noise sources. Existing denoising methods struggle to handle the complex noise in cardiac seismic signals and poorly leverage the abundant unlabeled data. To address these challenges, we propose SelfDenoiser, a self-supervised framework for denoising and reconstructing cardiac seismic signals using unlabeled data. During training, SelfDenoiser first selects clean segments from the unlabeled pool, then injects adaptive noise into each segment to simulate shared, hard-to-remove interference commonly observed in real-world noise distributions. In addition, realistic artifacts are extracted and integrated into clean signals to model high-intensity, abrupt noise events. An encoder-decoder network designed with fixed temporal resolution is subsequently trained to recover the clean signals, guided by a loss function that captures both temporal and spectral characteristics. We evaluated SelfDenoiser on 11,392 hours of data collected in an Intensive Care Unit (ICU) using seismic sensor-based systems. The model was trained on 610 hours of clean signals selected from a 5176-hour unlabeled pool and tested on a 6216-hour labeled dataset. Results showed substantial improvements in two downstream tasks: heart rate (HR) and inter-beat interval (IBI) estimation, with notably increased data utilization and better accuracy compared to conventional denoising methods. This highlights SelfDenoiser's capability to transform low-quality, noisy signals into high-fidelity, reliable cardiac data.
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-31
Open AccessSelfDenoiser: Self-supervised Seismic Signal Denoiser for Continuous and Contactless Cardiac Monitoring
Cardiovascular diseases (CVDs) remain a major global health challenge, highlighting the urgent need for advanced cardiac monitoring solutions. Continuous, contactless cardiac monitoring using seismic sensors enables comfortable, privacy-preserving assessments by capturing subtle heart vibrations. However, these systems are highly susceptible to diverse noise sources. Existing denoising methods struggle to handle the complex noise in cardiac seismic signals and poorly leverage the abundant unlabeled data. To address these challenges, we propose SelfDenoiser, a self-supervised framework for denoising and reconstructing cardiac seismic signals using unlabeled data. During training, SelfDenoiser first selects clean segments from the unlabeled pool, then injects adaptive noise into each segment to simulate shared, hard-to-remove interference commonly observed in real-world noise distributions. In addition, realistic artifacts are extracted and integrated into clean signals to model high-intensity, abrupt noise events. An encoder-decoder network designed with fixed temporal resolution is subsequently trained to recover the clean signals, guided by a loss function that captures both temporal and spectral characteristics. We evaluated SelfDenoiser on 11,392 hours of data collected in an Intensive Care Unit (ICU) using seismic sensor-based systems. The model was trained on 610 hours of clean signals selected from a 5176-hour unlabeled pool and tested on a 6216-hour labeled dataset. Results showed substantial improvements in two downstream tasks: heart rate (HR) and inter-beat interval (IBI) estimation, with notably increased data utilization and better accuracy compared to conventional denoising methods. This highlights SelfDenoiser's capability to transform low-quality, noisy signals into high-fidelity, reliable cardiac data.
- Open Access
- 24 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 134-138
Blood Pressure Estimation from Vibration Signals via Coarse-to-Fine Contrastive Learning, Feature Selection and Synthesis
- 24 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 134-138
Open AccessBlood Pressure Estimation from Vibration Signals via Coarse-to-Fine Contrastive Learning, Feature Selection and Synthesis
- Open Access
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-32
Multi-granularity Supervised Contrastive Learning with Online Adaptation for Contactless In-bed Posture Classification
In-bed postures offer valuable information about an individual's sleep quality and overall health conditions, particularly for patients with sleep apnea. However, current in-bed posture classification systems lack privacy-friendly and easy-to-install options. Furthermore, existing solutions do not consider variations between patients and are typically trained only once, neglecting the utilization of time consistency and unlabeled data from new patients. To address these limitations, this paper builds on a seismic sensor to introduce a novel sleep posture framework, which comprises two main components, namely, the Multi-Granularity Supervised Contrastive Learning (MGSCL) module and the ensemble Online Adaptation (oa) module. Unlike most existing contrastive learning frameworks that operate at the sample level, MGSCL leverages multi-granular information, operating not only at the sample level but also at the group level. The oa module enables the model to adapt to new patient data while ensuring time consistency in sleep posture predictions. Additionally, it quantifies model uncertainty to generate weighted predictions, further enhancing performance. Evaluated on a dataset of 100 patients collected at a clinical research center, MGSCLoa achieved an average accuracy of 91.67% and an average F1 score of 91.53% with only 40 seconds of labeled data per posture. In a Phase 2 evaluation with 11 participants over 13 nights in home settings, the framework reached an average accuracy of 85.37% and a weighted F1 score of 83.59% using just 3 minutes of labeled data per common posture for each participant. These results underscore the potential of seismic sensor-based in-bed posture classification for assessing sleep quality and related health conditions.
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-32
Open AccessMulti-granularity Supervised Contrastive Learning with Online Adaptation for Contactless In-bed Posture Classification
In-bed postures offer valuable information about an individual's sleep quality and overall health conditions, particularly for patients with sleep apnea. However, current in-bed posture classification systems lack privacy-friendly and easy-to-install options. Furthermore, existing solutions do not consider variations between patients and are typically trained only once, neglecting the utilization of time consistency and unlabeled data from new patients. To address these limitations, this paper builds on a seismic sensor to introduce a novel sleep posture framework, which comprises two main components, namely, the Multi-Granularity Supervised Contrastive Learning (MGSCL) module and the ensemble Online Adaptation (oa) module. Unlike most existing contrastive learning frameworks that operate at the sample level, MGSCL leverages multi-granular information, operating not only at the sample level but also at the group level. The oa module enables the model to adapt to new patient data while ensuring time consistency in sleep posture predictions. Additionally, it quantifies model uncertainty to generate weighted predictions, further enhancing performance. Evaluated on a dataset of 100 patients collected at a clinical research center, MGSCLoa achieved an average accuracy of 91.67% and an average F1 score of 91.53% with only 40 seconds of labeled data per posture. In a Phase 2 evaluation with 11 participants over 13 nights in home settings, the framework reached an average accuracy of 85.37% and a weighted F1 score of 83.59% using just 3 minutes of labeled data per common posture for each participant. These results underscore the potential of seismic sensor-based in-bed posture classification for assessing sleep quality and related health conditions.
- 24 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (11) , 16789-16796
Contactless Vital Signs Monitoring for Animals
Monitoring vital signs such as Heart Rate (HR) and Respiratory Rate (RR) is critical for veterinary medicine. The existing contact based systems are difficult to use on animals for longer periods as they may cause movement restriction. Contactless solutions have recently gained more popularity due to their ease-of-use. However, there are very few validated systems for animals. In this study, we propose a contactless vital signs monitoring system, CageDot for animals. Our system provides continuous real-time monitoring of HR and RR during hospitalization. The CageDot is placed under the animal cage and detects the heart vibrations using a geophone sensor. The CageDot also has a signal quality control algorithm to address the problem of obtaining high-quality cardiac data in real-life noisy environments such as hospitals. Compared to the existing works that use controlled environments, this is especially significant. The algorithm includes several steps that include background noise/movement removal, subject movement detection, heartbeat extraction and vital signs estimation. The experimental results on 16 hospitalized dogs and cats show that this system can achieve high accuracy for vital signs monitoring with a Mean Absolute Error (MAE) of 4.71 for Heart Rate (3.8 percent error rate) and 1.28 (8 percent error rate) for Respiratory Rate.
- 24 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (11) , 16789-16796
Contactless Vital Signs Monitoring for Animals
Monitoring vital signs such as Heart Rate (HR) and Respiratory Rate (RR) is critical for veterinary medicine. The existing contact based systems are difficult to use on animals for longer periods as they may cause movement restriction. Contactless solutions have recently gained more popularity due to their ease-of-use. However, there are very few validated systems for animals. In this study, we propose a contactless vital signs monitoring system, CageDot for animals. Our system provides continuous real-time monitoring of HR and RR during hospitalization. The CageDot is placed under the animal cage and detects the heart vibrations using a geophone sensor. The CageDot also has a signal quality control algorithm to address the problem of obtaining high-quality cardiac data in real-life noisy environments such as hospitals. Compared to the existing works that use controlled environments, this is especially significant. The algorithm includes several steps that include background noise/movement removal, subject movement detection, heartbeat extraction and vital signs estimation. The experimental results on 16 hospitalized dogs and cats show that this system can achieve high accuracy for vital signs monitoring with a Mean Absolute Error (MAE) of 4.71 for Heart Rate (3.8 percent error rate) and 1.28 (8 percent error rate) for Respiratory Rate.
- Open Access
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- Vol. 2024, 869-870
Poster: A Contactless Health Monitoring System for Humans and Animals
Health monitoring is essential for both humans and animals in daily life. While numerous health monitoring systems have been developed, the majority are designed exclusively for either humans or animals, and most require direct physical contact. We have developed BedDot, a contactless health monitoring system for both humans and animals using a seismic sensor. BedDot can be deployed in various environments, such as bed and seat settings for humans, as well as in cages for animals, to monitor occupancy, heart rate (HR), respiratory rate (RR), and blood pressure (BP). Our system demonstrates high accuracy in the clinical experiments of 150 patients and 16 dogs and cats.
- 4 November 2024
- Published by Association for Computing Machinery (ACM)
- Vol. 2024, 869-870
Open AccessPoster: A Contactless Health Monitoring System for Humans and Animals
Health monitoring is essential for both humans and animals in daily life. While numerous health monitoring systems have been developed, the majority are designed exclusively for either humans or animals, and most require direct physical contact. We have developed BedDot, a contactless health monitoring system for both humans and animals using a seismic sensor. BedDot can be deployed in various environments, such as bed and seat settings for humans, as well as in cages for animals, to monitor occupancy, heart rate (HR), respiratory rate (RR), and blood pressure (BP). Our system demonstrates high accuracy in the clinical experiments of 150 patients and 16 dogs and cats.
- Open Access
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-25
Self-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection
In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-25
Open AccessSelf-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection
In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.
- 18 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (5) , 7935-7947
Engagement-Free and Contactless Bed Occupancy and Vital Signs Monitoring
This article presents the design and evaluation of an engagement-free and contactless vital signs and occupancy monitoring system called BedDot. While many existing works demonstrated contactless vital signs estimation, they do not address the practical challenge of environment noises, online bed occupancy detection, and data quality assessment in the real-world environment. This work presents a robust signal quality assessment algorithm consisting of three parts: 1) bed occupancy detection; 2) movement detection; and 3) heartbeat detection, to identify high-quality data. It also presents a series of innovative vital signs estimation algorithms that leverage the advanced signal processing and Bayesian theorem for contactless heart rate (HR), respiratory rate (RR), and interbeat interval (IBI) estimation. The experimental results demonstrate that BedDot achieves over 99% accuracy for bed occupancy detection, and MAE of 1.38 BPM, 1.54 BPM, and 24.84 ms for HR, RR, and IBI estimation, respectively, compared with an FDA-approved device. The BedDot system has been extensively tested with data collected from 75 subjects for more than 80 h under different conditions, demonstrating its generalizability across different people and environments.
- 18 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (5) , 7935-7947
Engagement-Free and Contactless Bed Occupancy and Vital Signs Monitoring
This article presents the design and evaluation of an engagement-free and contactless vital signs and occupancy monitoring system called BedDot. While many existing works demonstrated contactless vital signs estimation, they do not address the practical challenge of environment noises, online bed occupancy detection, and data quality assessment in the real-world environment. This work presents a robust signal quality assessment algorithm consisting of three parts: 1) bed occupancy detection; 2) movement detection; and 3) heartbeat detection, to identify high-quality data. It also presents a series of innovative vital signs estimation algorithms that leverage the advanced signal processing and Bayesian theorem for contactless heart rate (HR), respiratory rate (RR), and interbeat interval (IBI) estimation. The experimental results demonstrate that BedDot achieves over 99% accuracy for bed occupancy detection, and MAE of 1.38 BPM, 1.54 BPM, and 24.84 ms for HR, RR, and IBI estimation, respectively, compared with an FDA-approved device. The BedDot system has been extensively tested with data collected from 75 subjects for more than 80 h under different conditions, demonstrating its generalizability across different people and environments.