Xiaoye Qian
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xiaoye Qian has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Ming-Chun Huang
Duke Kunshan University
12 shared publications - Huan Chen
Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, USA
9 shared publications - Wenyao Xu
Department of Computer Science and Engineering, University at Buffalo, The State University of New York, Buffalo, NY, USA
7 shared publications - Haotian Jiang
Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, Ohio United States
3 shared publications - Huining Li
North Carolina State University, Raleigh, North Carolina, USA
3 shared publications - Yi Cai
Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH, 44106
3 shared publications
Latest Publications
- Open Access
- 5 September 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computing for Healthcare
Digital Twin for Digital Health: Body Joint Modeling and 3D Pose Reconstruction
Body joint modeling and human pose reconstruction provide precise motion and quantitative geometric information about human dynamics. The rich motion information obtained from human pose estimation plays important roles in a wide range of digital twin and connected health applications. However, current related researches have difficulties in extracting the joints’ spatial-temporal correlations from different levels. This is due to the poses being at various complexities in moving various joints differently. Hence, the typical conventional transformer method is non-adaptable and barely meets the aforementioned requirement. In this paper, we propose the B ody J oint I nteractive trans Former s (BJIFormer) to extract the multi-level joints’ spatial-temporal information. The design enables the model to learn the inner joints’ correlation inside the body parts across frames and propagate the extracted information across the body parts with shared joints. The multi-level body joint interactive scheme has greater efficiency improvement by restricting the self-attention computation to partial body parts and connecting each body part by torso. The proposed interactive approach explores the spatial-temporal correlation following the hierarchical paradigm and effectively estimates and reconstructs 3D human poses.
- 5 September 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computing for Healthcare
Open AccessDigital Twin for Digital Health: Body Joint Modeling and 3D Pose Reconstruction
Body joint modeling and human pose reconstruction provide precise motion and quantitative geometric information about human dynamics. The rich motion information obtained from human pose estimation plays important roles in a wide range of digital twin and connected health applications. However, current related researches have difficulties in extracting the joints’ spatial-temporal correlations from different levels. This is due to the poses being at various complexities in moving various joints differently. Hence, the typical conventional transformer method is non-adaptable and barely meets the aforementioned requirement. In this paper, we propose the B ody J oint I nteractive trans Former s (BJIFormer) to extract the multi-level joints’ spatial-temporal information. The design enables the model to learn the inner joints’ correlation inside the body parts across frames and propagate the extracted information across the body parts with shared joints. The multi-level body joint interactive scheme has greater efficiency improvement by restricting the self-attention computation to partial body parts and connecting each body part by torso. The proposed interactive approach explores the spatial-temporal correlation following the hierarchical paradigm and effectively estimates and reconstructs 3D human poses.
- Open Access
- 19 October 2023
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 12, e49558
Pilot Testing of an mHealth App for Tobacco Cessation in People Living With HIV: Protocol for a Pilot Randomized Controlled Trial
Background: An estimated 40% of people living with HIV smoke cigarettes. Although smoking rates in the United States have been declining in recent years, people living with HIV continue to smoke cigarettes at twice the rate of the general population. Mobile health (mHealth) technology is an effective tool for people living with a chronic illness, such as HIV, as currently 84% of households in the United States report that they have a smartphone. Although many studies have used mHealth interventions for smoking cessation, few studies have recruited people living with HIV who smoke. Objective: The objective of the pilot randomized controlled trial (RCT) is to examine the feasibility, acceptability, and preliminary efficacy of the Sense2Quit App as a tool for people living with HIV who are motivated to quit smoking. Methods: The Sense2Quit study is a 2-arm RCT for people living with HIV who smoke cigarettes (n=60). Participants are randomized to either the active intervention condition, which consists of an 8-week supply of nicotine replacement therapy, standard smoking cessation counseling, and access to the Sense2Quit mobile app and smartwatch, or the control condition, which consists of standard smoking cessation counseling and a referral to the New York State Smokers’ Quitline. The Sense2Quit app is a mobile app connected through Bluetooth to a smartwatch that tracks smoking gestures and distinguishes them from other everyday hand movements. In the Sense2Quit app, participants can view their smoking trends, which are recorded through their use of the smartwatch, including how often or how much they smoke and the amount of money that they are spending on cigarettes, watch videos with quitting tips, information, and distractions, play games, set reminders, and communicate with a study team member. Results: Enrollment of study participants began in March 2023 and is expected to end in October 2023. All data collection is expected to be completed by the end of January 2024. This RCT will test the difference in outcomes between the control and intervention arms. The primary outcome will be the percentage of participants with biochemically verified 7-day point prevalence smoking or tobacco abstinence at their 12-week follow-up. Results from this pilot study will be disseminated to the research community following the completion of all data collection. Conclusions: The Sense2Quit study leverages mHealth so that it can help smokers improve their efforts at smoking cessation. Our research has the potential to not only increase quitting rates among people living with HIV who may need a prolonged, tailored intervention but also inform further development of mHealth for people living with HIV. This mHealth study will contribute significant findings to the greater mHealth research community, providing evidence as to how mHealth should be developed and tested among the target population. Trial Registration: ClinicalTrials.gov NCT05609032; https://clinicaltrials.gov/study/NCT05609032 International Registered Report Identifier (IRRID): DERR1-10.2196/49558
- 19 October 2023
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 12, e49558
Open AccessPilot Testing of an mHealth App for Tobacco Cessation in People Living With HIV: Protocol for a Pilot Randomized Controlled Trial
Background: An estimated 40% of people living with HIV smoke cigarettes. Although smoking rates in the United States have been declining in recent years, people living with HIV continue to smoke cigarettes at twice the rate of the general population. Mobile health (mHealth) technology is an effective tool for people living with a chronic illness, such as HIV, as currently 84% of households in the United States report that they have a smartphone. Although many studies have used mHealth interventions for smoking cessation, few studies have recruited people living with HIV who smoke. Objective: The objective of the pilot randomized controlled trial (RCT) is to examine the feasibility, acceptability, and preliminary efficacy of the Sense2Quit App as a tool for people living with HIV who are motivated to quit smoking. Methods: The Sense2Quit study is a 2-arm RCT for people living with HIV who smoke cigarettes (n=60). Participants are randomized to either the active intervention condition, which consists of an 8-week supply of nicotine replacement therapy, standard smoking cessation counseling, and access to the Sense2Quit mobile app and smartwatch, or the control condition, which consists of standard smoking cessation counseling and a referral to the New York State Smokers’ Quitline. The Sense2Quit app is a mobile app connected through Bluetooth to a smartwatch that tracks smoking gestures and distinguishes them from other everyday hand movements. In the Sense2Quit app, participants can view their smoking trends, which are recorded through their use of the smartwatch, including how often or how much they smoke and the amount of money that they are spending on cigarettes, watch videos with quitting tips, information, and distractions, play games, set reminders, and communicate with a study team member. Results: Enrollment of study participants began in March 2023 and is expected to end in October 2023. All data collection is expected to be completed by the end of January 2024. This RCT will test the difference in outcomes between the control and intervention arms. The primary outcome will be the percentage of participants with biochemically verified 7-day point prevalence smoking or tobacco abstinence at their 12-week follow-up. Results from this pilot study will be disseminated to the research community following the completion of all data collection. Conclusions: The Sense2Quit study leverages mHealth so that it can help smokers improve their efforts at smoking cessation. Our research has the potential to not only increase quitting rates among people living with HIV who may need a prolonged, tailored intervention but also inform further development of mHealth for people living with HIV. This mHealth study will contribute significant findings to the greater mHealth research community, providing evidence as to how mHealth should be developed and tested among the target population. Trial Registration: ClinicalTrials.gov NCT05609032; https://clinicaltrials.gov/study/NCT05609032 International Registered Report Identifier (IRRID): DERR1-10.2196/49558
- Open Access
- 2 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
TherapyPal: Towards a Privacy-Preserving Companion Diagnostic Tool based on Digital Symptomatic Phenotyping
As the demand for precision medicine rapidly grows, companion diagnostics is proposed to monitor and evaluate therapeutic effects for adjusting medicine plans in time. Although a set of clinical companion diagnostics tools (e.g., polymerase chain reaction) have been investigated, they are expensive and only accessible in a lab environment, which hinders the promotion to broader patients. In light of this situation, we take the first steps towards developing a real-world companion diagnostic tool by leveraging mobile technology. In this paper, we present TherapyPal, a privacy-preserving medicine effectiveness computational framework by harnessing semantic hashing-based digital symptomatic phenotyping. Specifically, sensor data captured from daily-life activities is first transformed into spectrograms. Then, we develop a hashing learning network to extract privacy-masked symptomatic phenotypes on smartphones. Afterward, symptomatic hashes at different medicine states are fed to a contrastive learning network in the cloud for treatment effectiveness detection. To evaluate the performance, we conduct a clinical study among 65 Parkinson's disease (PD) patients under dopaminergic drug treatment. The results show that TherapyPal can achieve around 84.1% medicine effectiveness detection accuracy among patients and above 0.925 privacy-masked scores for protecting each private attribute, which validates the reliability and security of TherapyPal to be used as a real-world companion diagnostics tool.
- 2 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessTherapyPal: Towards a Privacy-Preserving Companion Diagnostic Tool based on Digital Symptomatic Phenotyping
As the demand for precision medicine rapidly grows, companion diagnostics is proposed to monitor and evaluate therapeutic effects for adjusting medicine plans in time. Although a set of clinical companion diagnostics tools (e.g., polymerase chain reaction) have been investigated, they are expensive and only accessible in a lab environment, which hinders the promotion to broader patients. In light of this situation, we take the first steps towards developing a real-world companion diagnostic tool by leveraging mobile technology. In this paper, we present TherapyPal, a privacy-preserving medicine effectiveness computational framework by harnessing semantic hashing-based digital symptomatic phenotyping. Specifically, sensor data captured from daily-life activities is first transformed into spectrograms. Then, we develop a hashing learning network to extract privacy-masked symptomatic phenotypes on smartphones. Afterward, symptomatic hashes at different medicine states are fed to a contrastive learning network in the cloud for treatment effectiveness detection. To evaluate the performance, we conduct a clinical study among 65 Parkinson's disease (PD) patients under dopaminergic drug treatment. The results show that TherapyPal can achieve around 84.1% medicine effectiveness detection accuracy among patients and above 0.925 privacy-masked scores for protecting each private attribute, which validates the reliability and security of TherapyPal to be used as a real-world companion diagnostics tool.
- Open Access
- 2 June 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Pilot Testing of an mHealth App for Tobacco Cessation in People Living With HIV: Protocol for a Pilot Randomized Controlled Trial (Preprint)
BACKGROUND An estimated 40% of people living with HIV smoke cigarettes. Although smoking rates in the United States have been declining in recent years, people living with HIV continue to smoke cigarettes at twice the rate of the general population. Mobile health (mHealth) technology is an effective tool for people living with a chronic illness, such as HIV, as currently 84% of households in the United States report that they have a smartphone. Although many studies have used mHealth interventions for smoking cessation, few studies have recruited people living with HIV who smoke. OBJECTIVE The objective of the pilot randomized controlled trial (RCT) is to examine the feasibility, acceptability, and preliminary efficacy of the Sense2Quit App as a tool for people living with HIV who are motivated to quit smoking. METHODS The Sense2Quit study is a 2-arm RCT for people living with HIV who smoke cigarettes (n=60). Participants are randomized to either the active intervention condition, which consists of an 8-week supply of nicotine replacement therapy, standard smoking cessation counseling, and access to the Sense2Quit mobile app and smartwatch, or the control condition, which consists of standard smoking cessation counseling and a referral to the New York State Smokers’ Quitline. The Sense2Quit app is a mobile app connected through Bluetooth to a smartwatch that tracks smoking gestures and distinguishes them from other everyday hand movements. In the Sense2Quit app, participants can view their smoking trends, which are recorded through their use of the smartwatch, including how often or how much they smoke and the amount of money that they are spending on cigarettes, watch videos with quitting tips, information, and distractions, play games, set reminders, and communicate with a study team member. RESULTS Enrollment of study participants began in March 2023 and is expected to end in October 2023. All data collection is expected to be completed by the end of January 2024. This RCT will test the difference in outcomes between the control and intervention arms. The primary outcome will be the percentage of participants with biochemically verified 7-day point prevalence smoking or tobacco abstinence at their 12-week follow-up. Results from this pilot study will be disseminated to the research community following the completion of all data collection. CONCLUSIONS The Sense2Quit study leverages mHealth so that it can help smokers improve their efforts at smoking cessation. Our research has the potential to not only increase quitting rates among people living with HIV who may need a prolonged, tailored intervention but also inform further development of mHealth for people living with HIV. This mHealth study will contribute significant findings to the greater mHealth research community, providing evidence as to how mHealth should be developed and tested among the target population. CLINICALTRIAL ClinicalTrials.gov NCT05609032; https://clinicaltrials.gov/study/NCT05609032 INTERNATIONAL REGISTERED REPORT DERR1-10.2196/49558
- 2 June 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPilot Testing of an mHealth App for Tobacco Cessation in People Living With HIV: Protocol for a Pilot Randomized Controlled Trial (Preprint)
BACKGROUND An estimated 40% of people living with HIV smoke cigarettes. Although smoking rates in the United States have been declining in recent years, people living with HIV continue to smoke cigarettes at twice the rate of the general population. Mobile health (mHealth) technology is an effective tool for people living with a chronic illness, such as HIV, as currently 84% of households in the United States report that they have a smartphone. Although many studies have used mHealth interventions for smoking cessation, few studies have recruited people living with HIV who smoke. OBJECTIVE The objective of the pilot randomized controlled trial (RCT) is to examine the feasibility, acceptability, and preliminary efficacy of the Sense2Quit App as a tool for people living with HIV who are motivated to quit smoking. METHODS The Sense2Quit study is a 2-arm RCT for people living with HIV who smoke cigarettes (n=60). Participants are randomized to either the active intervention condition, which consists of an 8-week supply of nicotine replacement therapy, standard smoking cessation counseling, and access to the Sense2Quit mobile app and smartwatch, or the control condition, which consists of standard smoking cessation counseling and a referral to the New York State Smokers’ Quitline. The Sense2Quit app is a mobile app connected through Bluetooth to a smartwatch that tracks smoking gestures and distinguishes them from other everyday hand movements. In the Sense2Quit app, participants can view their smoking trends, which are recorded through their use of the smartwatch, including how often or how much they smoke and the amount of money that they are spending on cigarettes, watch videos with quitting tips, information, and distractions, play games, set reminders, and communicate with a study team member. RESULTS Enrollment of study participants began in March 2023 and is expected to end in October 2023. All data collection is expected to be completed by the end of January 2024. This RCT will test the difference in outcomes between the control and intervention arms. The primary outcome will be the percentage of participants with biochemically verified 7-day point prevalence smoking or tobacco abstinence at their 12-week follow-up. Results from this pilot study will be disseminated to the research community following the completion of all data collection. CONCLUSIONS The Sense2Quit study leverages mHealth so that it can help smokers improve their efforts at smoking cessation. Our research has the potential to not only increase quitting rates among people living with HIV who may need a prolonged, tailored intervention but also inform further development of mHealth for people living with HIV. This mHealth study will contribute significant findings to the greater mHealth research community, providing evidence as to how mHealth should be developed and tested among the target population. CLINICALTRIAL ClinicalTrials.gov NCT05609032; https://clinicaltrials.gov/study/NCT05609032 INTERNATIONAL REGISTERED REPORT DERR1-10.2196/49558
- Open Access
- 21 December 2022
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 6 (4) , 1-28
NeuralGait
Brain health attracts more recent attention as the population ages. Smartphone-based gait sensing and analysis can help identify the risks of brain diseases in daily life for prevention. Existing gait analysis approaches mainly hand-craft temporal gait features or developing CNN-based feature extractors, but they are either prone to lose some inconspicuous pathological information or are only dedicated to a single brain disease screening. We discover that the relationship between gait segments can be used as a principle and generic indicator to quantify multiple pathological patterns. In this paper, we propose NeuralGait, a pervasive smartphone-cloud system that passively captures and analyzes principle gait segments relationship for brain health assessment. On the smartphone end, inertial gait data are collected while putting the smartphone in the pants pocket. We then craft local temporal-frequent gait domain features and develop a self-attention-based gait segment relationship encoder. Afterward, the domain features and relation features are fed to a scalable RiskNet in the cloud for brain health assessment. We also design a pathological hot update protocol to efficiently add new brain diseases in the RiskNet. NeuralGait is practical as it provides brain health assessment with no burden in daily life. In the experiment, we recruit 988 healthy people and 417 patients with a single or combination of PD, TBI, and stroke, and evaluate the brain health assessment using a set of specifically designed metrics including global accuracy, exact accuracy, sensitivity, and false alarm rate. We also demonstrate the generalization (e.g., analysis of feature effectiveness and model efficiency) and inclusiveness of NeuralGait.
- 21 December 2022
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 6 (4) , 1-28
Open AccessNeuralGait
Brain health attracts more recent attention as the population ages. Smartphone-based gait sensing and analysis can help identify the risks of brain diseases in daily life for prevention. Existing gait analysis approaches mainly hand-craft temporal gait features or developing CNN-based feature extractors, but they are either prone to lose some inconspicuous pathological information or are only dedicated to a single brain disease screening. We discover that the relationship between gait segments can be used as a principle and generic indicator to quantify multiple pathological patterns. In this paper, we propose NeuralGait, a pervasive smartphone-cloud system that passively captures and analyzes principle gait segments relationship for brain health assessment. On the smartphone end, inertial gait data are collected while putting the smartphone in the pants pocket. We then craft local temporal-frequent gait domain features and develop a self-attention-based gait segment relationship encoder. Afterward, the domain features and relation features are fed to a scalable RiskNet in the cloud for brain health assessment. We also design a pathological hot update protocol to efficiently add new brain diseases in the RiskNet. NeuralGait is practical as it provides brain health assessment with no burden in daily life. In the experiment, we recruit 988 healthy people and 417 patients with a single or combination of PD, TBI, and stroke, and evaluate the brain health assessment using a set of specifically designed metrics including global accuracy, exact accuracy, sensitivity, and false alarm rate. We also demonstrate the generalization (e.g., analysis of feature effectiveness and model efficiency) and inclusiveness of NeuralGait.
- 19 October 2022
- Published by Elsevier in Smart Health
- Vol. 26, 100332
An explainable COVID-19 detection system based on human sounds
- 19 October 2022
- Published by Elsevier in Smart Health
- Vol. 26, 100332
An explainable COVID-19 detection system based on human sounds
- 18 October 2022
- Published by Elsevier in Smart Health
- Vol. 26
Closed-looped sensing and stimulation system for Parkinson’s disease early diagnosis and rehabilitation
- 18 October 2022
- Published by Elsevier in Smart Health
- Vol. 26
Closed-looped sensing and stimulation system for Parkinson’s disease early diagnosis and rehabilitation
- 11 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 22 (11) , 10663-10670
Transfer Learning Model Knowledge Across Multi-Sensors Locations Over Body Sensor Network
With the growth of sensing technologies, the sensors are applied to diversified fields including health care, elderly protection, human activity abnormal detection, and surveillance. The advanced sensors embedded in mobile devices generate a large amount of valuable data. In recent years, to deal with the massive volumes of data, representation learning emerged as an alternative approach to extract the features without manual feature extraction. In this paper, we develop an unsupervised representation learning system for mining features across multiple sensors placed on different parts of the human body for recognizing human daily activities. The unsupervised representation learning approach allows models to learn the feature representation among a large number of unlabeled data samples collected from different parts of the human body. In order to demonstrate the feasibility of our system, extensive experiments on human daily activities recognition are carried out to evaluate the effectiveness of the learned representations.
- 11 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 22 (11) , 10663-10670
Transfer Learning Model Knowledge Across Multi-Sensors Locations Over Body Sensor Network
With the growth of sensing technologies, the sensors are applied to diversified fields including health care, elderly protection, human activity abnormal detection, and surveillance. The advanced sensors embedded in mobile devices generate a large amount of valuable data. In recent years, to deal with the massive volumes of data, representation learning emerged as an alternative approach to extract the features without manual feature extraction. In this paper, we develop an unsupervised representation learning system for mining features across multiple sensors placed on different parts of the human body for recognizing human daily activities. The unsupervised representation learning approach allows models to learn the feature representation among a large number of unlabeled data samples collected from different parts of the human body. In order to demonstrate the feasibility of our system, extensive experiments on human daily activities recognition are carried out to evaluate the effectiveness of the learned representations.
- 28 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (16) , 15077-15088
mHealth Technologies Toward Active Health Information Collection and Tracking in Daily Life: A Dynamic Gait Monitoring Example
Monitoring the changes in gait patterns is important to individuals’ health. Gait analysis should be taken as early as possible to prevent gait impairments and improve gait quality. Accurate stride-length estimation and gait rehabilitation activity recognition are fundamental components in gait monitoring, gait analysis, and long-term gait care. This article proposes a novel multimodality deep learning architecture to investigate the applications of stride length (SL) estimation and rehabilitation activity recognition. In order to verify this architecture, we have conducted the data collection and data labeling with our customized wearable sensing system. The sensing system can provide sensor readings from 96 sensors-based pressure array and 3-channels accelerometer and gyroscope. Many experiments with multiple perspective analysis are implemented to evaluate the models’ precision, robustness, and reliability. The multimodality deep learning architecture can map multiple sensor readings to the resulting SL with a mean absolute error of 3.89 cm and accurately detect the gait activity with an accuracy of 97.08%. It correlates the step length estimation and gait activity recognition to fulfill comprehensive long-term gait information statistic. The proposed applications’ implementation enriched our previous gait study and brought insights for clinically relevant wearable gait monitoring and gait analysis.
- 28 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (16) , 15077-15088
mHealth Technologies Toward Active Health Information Collection and Tracking in Daily Life: A Dynamic Gait Monitoring Example
Monitoring the changes in gait patterns is important to individuals’ health. Gait analysis should be taken as early as possible to prevent gait impairments and improve gait quality. Accurate stride-length estimation and gait rehabilitation activity recognition are fundamental components in gait monitoring, gait analysis, and long-term gait care. This article proposes a novel multimodality deep learning architecture to investigate the applications of stride length (SL) estimation and rehabilitation activity recognition. In order to verify this architecture, we have conducted the data collection and data labeling with our customized wearable sensing system. The sensing system can provide sensor readings from 96 sensors-based pressure array and 3-channels accelerometer and gyroscope. Many experiments with multiple perspective analysis are implemented to evaluate the models’ precision, robustness, and reliability. The multimodality deep learning architecture can map multiple sensor readings to the resulting SL with a mean absolute error of 3.89 cm and accurately detect the gait activity with an accuracy of 97.08%. It correlates the step length estimation and gait activity recognition to fulfill comprehensive long-term gait information statistic. The proposed applications’ implementation enriched our previous gait study and brought insights for clinically relevant wearable gait monitoring and gait analysis.
- 20 April 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 20 (16) , 9408-9416
Wearable Computing With Distributed Deep Learning Hierarchy: A Study of Fall Detection
With the development of technologies, an increasing number of wearable devices that are currently at the heart of the development of the Internet of Things are used around the world. The concerns about privacy, in particular healthcare wearable devices, are exacerbated as the requirement for selfhealth monitoring increases. In addition, many sources of data are geographically separated and might not be allowed to release due to patients or regulatory constraints. Accordingly, in this paper, a distributed hierarchical deep learning system is proposed. The proposed system applying a distributed hierarchical neural network over a cloud server and smartphones. The system enables multiple smartphones to train a shared consensus model collaboratively while keeping the private data locally to protect data privacy, and the system takes advantage of the abundant computational resources on the cloud server to lower the computational overhead on smartphones. The proposed system is demonstrated by a fall detection study which is the common healthcare issue among human beings. The patients’ data are collected from multiple wearable devices including the smartphone, the smartwatch, and the smart insoles. The experimental results show that the distributed hierarchical deep learning system can reproduce the accuracy, specificity, precision, and sensitivity of centralized machine learning while preserving privacy.
- 20 April 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 20 (16) , 9408-9416
Wearable Computing With Distributed Deep Learning Hierarchy: A Study of Fall Detection
With the development of technologies, an increasing number of wearable devices that are currently at the heart of the development of the Internet of Things are used around the world. The concerns about privacy, in particular healthcare wearable devices, are exacerbated as the requirement for selfhealth monitoring increases. In addition, many sources of data are geographically separated and might not be allowed to release due to patients or regulatory constraints. Accordingly, in this paper, a distributed hierarchical deep learning system is proposed. The proposed system applying a distributed hierarchical neural network over a cloud server and smartphones. The system enables multiple smartphones to train a shared consensus model collaboratively while keeping the private data locally to protect data privacy, and the system takes advantage of the abundant computational resources on the cloud server to lower the computational overhead on smartphones. The proposed system is demonstrated by a fall detection study which is the common healthcare issue among human beings. The patients’ data are collected from multiple wearable devices including the smartphone, the smartwatch, and the smart insoles. The experimental results show that the distributed hierarchical deep learning system can reproduce the accuracy, specificity, precision, and sensitivity of centralized machine learning while preserving privacy.