Li Pan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Li Pan has a total of 39 co-authors. Here are the top co-authors by number of shared publications:
- Guoliang Xing
The Chinese University of Hong Kong, Hong Kong SAR, China
3 shared publications - Xiaomin Ouyang
Hong Kong University of Science and Technology, Hong Kong, Hong Kong
3 shared publications - Heming Fu
The Chinese University of Hong Kong, Hong Kong, China
2 shared publications - Shihua Cao
School of Public Health and Nursing, Hangzhou Normal University, Hangzhou, China; Key Engineering Research Center of Mobile Health Management System, Hangzhou, China
2 shared publications - Sitong Cheng
The Chinese University of Hong Kong, Hong Kong, China
2 shared publications - Zhiyuan Xie
The Chinese University of Hong Kong, Hong Kong, China
2 shared publications
Latest Publications
- Top Cited PapersOpen Access
- 7 May 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 27, e77066
Passive Sensing for Mental Health Monitoring: A Scoping Review of Machine Learning with Wearables and Smartphones (Preprint)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Mental health issues have become a significant global public health challenge. Traditional assessments rely on subjective methods with limited ecological validity. Passive sensing via wearable devices and smartphones, combined with machine learning (ML), enables objective, continuous, and noninvasive mental health monitoring. Objective: This study aims to provide a comprehensive review of the current state of passive sensing-based and machine learning (ML) technologies for mental health monitoring. We summarize the technical approaches, reveal the association patterns between behavioral features and mental disorders, and explore potential directions for future advancements. Methods: Following the PRISMA-ScR guidelines, we searched seven major databases (Web of Science, PubMed, IEEE Xplore, etc.) for studies published between 2015 and 2025. A total of 42 studies were included. Information was extracted from dimensions such as data collection, preprocessing, feature engineering, ML methods, and validation, integrating the association patterns between behavioral features (e.g., sleep, activity, social interaction) and mental disorders (e.g., depression, anxiety). Results: The study found that the most commonly used digital biomarkers were heart rate (n=28), movement index (n=25), and step count (n=17), which were significantly associated with mental disorders such as depression and anxiety. Deep learning models (e.g., CNN, LSTM) performed exceptionally well in processing time-series data. However, traditional methods (e.g., random forest, XGBoost), due to their higher interpretability, remain widely adopted. Current studies face challenges such as small sample sizes (median = 60.5 participants), short data collection periods (45.24% of studies had data collection periods of less than 7 days), and limited device variety (76.19%). Additionally, only one study conducted external validation, limiting the clinical generalizability of the models. On the ethical front, only a few studies (14.29%) explicitly mentioned data anonymization, highlighting the need for enhanced privacy protection and algorithm fairness. Conclusions: The combination of passive sensing technologies and machine learning offers innovative solutions for mental health monitoring. However, key challenges, including data quality, model generalization, and ethical standards, need to be addressed before clinical translation. Future research should focus on large-scale longitudinal data collection, multimodal data integration, algorithm optimization, and interdisciplinary collaboration to drive the widespread adoption and clinical application of these technologies.
- 7 May 2025
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 27, e77066
Top Cited PapersOpen AccessPassive Sensing for Mental Health Monitoring: A Scoping Review of Machine Learning with Wearables and Smartphones (Preprint)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Mental health issues have become a significant global public health challenge. Traditional assessments rely on subjective methods with limited ecological validity. Passive sensing via wearable devices and smartphones, combined with machine learning (ML), enables objective, continuous, and noninvasive mental health monitoring. Objective: This study aims to provide a comprehensive review of the current state of passive sensing-based and machine learning (ML) technologies for mental health monitoring. We summarize the technical approaches, reveal the association patterns between behavioral features and mental disorders, and explore potential directions for future advancements. Methods: Following the PRISMA-ScR guidelines, we searched seven major databases (Web of Science, PubMed, IEEE Xplore, etc.) for studies published between 2015 and 2025. A total of 42 studies were included. Information was extracted from dimensions such as data collection, preprocessing, feature engineering, ML methods, and validation, integrating the association patterns between behavioral features (e.g., sleep, activity, social interaction) and mental disorders (e.g., depression, anxiety). Results: The study found that the most commonly used digital biomarkers were heart rate (n=28), movement index (n=25), and step count (n=17), which were significantly associated with mental disorders such as depression and anxiety. Deep learning models (e.g., CNN, LSTM) performed exceptionally well in processing time-series data. However, traditional methods (e.g., random forest, XGBoost), due to their higher interpretability, remain widely adopted. Current studies face challenges such as small sample sizes (median = 60.5 participants), short data collection periods (45.24% of studies had data collection periods of less than 7 days), and limited device variety (76.19%). Additionally, only one study conducted external validation, limiting the clinical generalizability of the models. On the ethical front, only a few studies (14.29%) explicitly mentioned data anonymization, highlighting the need for enhanced privacy protection and algorithm fairness. Conclusions: The combination of passive sensing technologies and machine learning offers innovative solutions for mental health monitoring. However, key challenges, including data quality, model generalization, and ethical standards, need to be addressed before clinical translation. Future research should focus on large-scale longitudinal data collection, multimodal data integration, algorithm optimization, and interdisciplinary collaboration to drive the widespread adoption and clinical application of these technologies.
- Open Access
- 29 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 404-419
ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer's Disease
Alzheimer's Disease (AD) and related dementia are a growing global health challenge due to the aging population. In this paper, we present ADMarker, the first end-to-end system that integrates multi-modal sensors and new federated learning algorithms for detecting multidimensional AD digital biomarkers in natural living environments. ADMarker features a novel three-stage multi-modal federated learning architecture that can accurately detect digital biomarkers in a privacy-preserving manner. Our approach collectively addresses several major real-world challenges, such as limited data labels, data heterogeneity, and limited computing resources. We built a compact multi-modality hardware system and deployed it in a four-week clinical trial involving 91 elderly participants. The results indicate that ADMarker can accurately detect a comprehensive set of digital biomarkers with up to 93.8% accuracy and identify early AD with an average of 88.9% accuracy. ADMarker offers a new platform that can allow AD clinicians to characterize and track the complex correlation between multidimensional interpretable digital biomarkers, demographic factors of patients, and AD diagnosis in a longitudinal manner.
- 29 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 404-419
Open AccessADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer's Disease
Alzheimer's Disease (AD) and related dementia are a growing global health challenge due to the aging population. In this paper, we present ADMarker, the first end-to-end system that integrates multi-modal sensors and new federated learning algorithms for detecting multidimensional AD digital biomarkers in natural living environments. ADMarker features a novel three-stage multi-modal federated learning architecture that can accurately detect digital biomarkers in a privacy-preserving manner. Our approach collectively addresses several major real-world challenges, such as limited data labels, data heterogeneity, and limited computing resources. We built a compact multi-modality hardware system and deployed it in a four-week clinical trial involving 91 elderly participants. The results indicate that ADMarker can accurately detect a comprehensive set of digital biomarkers with up to 93.8% accuracy and identify early AD with an average of 88.9% accuracy. ADMarker offers a new platform that can allow AD clinicians to characterize and track the complex correlation between multidimensional interpretable digital biomarkers, demographic factors of patients, and AD diagnosis in a longitudinal manner.
- 2 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (5) , 3171-3183
Unified Multi-Modal Diagnostic Framework With Reconstruction Pre-Training and Heterogeneity-Combat Tuning
Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack high-level semantic information. Furthermore, two significant heterogeneity challenges hinder the transfer of pre-trained knowledge to downstream tasks, i.e. , the distribution heterogeneity between pre-training data and downstream data, and the modality heterogeneity within downstream data. To address these challenges, we propose a Unified Medical Multi-modal Diagnostic (UMD) framework with tailored pre-training and downstream tuning strategies. Specifically, to enhance the representation abilities of vision and language encoders, we propose the Multi-level Reconstruction Pre-training (MR-Pretrain) strategy, including a feature-level and data-level reconstruction, which guides models to capture the semantic information from masked inputs of different modalities. Moreover, to tackle two kinds of heterogeneities during the downstream tuning, we present the heterogeneity-combat downstream tuning strategy, which consists of a Task-oriented Distribution Calibration (TD-Calib) and a Gradient-guided Modality Coordination (GM-Coord). In particular, TD-Calib fine-tunes the pre-trained model regarding the distribution of downstream datasets, and GM-Coord adjusts the gradient weights according to the dynamic optimization status of different modalities. Extensive experiments on five public medical datasets demonstrate the effectiveness of our UMD framework, which remarkably outperforms existing approaches on three kinds of downstream tasks.
- 2 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 29 (5) , 3171-3183
Unified Multi-Modal Diagnostic Framework With Reconstruction Pre-Training and Heterogeneity-Combat Tuning
Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack high-level semantic information. Furthermore, two significant heterogeneity challenges hinder the transfer of pre-trained knowledge to downstream tasks, i.e. , the distribution heterogeneity between pre-training data and downstream data, and the modality heterogeneity within downstream data. To address these challenges, we propose a Unified Medical Multi-modal Diagnostic (UMD) framework with tailored pre-training and downstream tuning strategies. Specifically, to enhance the representation abilities of vision and language encoders, we propose the Multi-level Reconstruction Pre-training (MR-Pretrain) strategy, including a feature-level and data-level reconstruction, which guides models to capture the semantic information from masked inputs of different modalities. Moreover, to tackle two kinds of heterogeneities during the downstream tuning, we present the heterogeneity-combat downstream tuning strategy, which consists of a Task-oriented Distribution Calibration (TD-Calib) and a Gradient-guided Modality Coordination (GM-Coord). In particular, TD-Calib fine-tunes the pre-trained model regarding the distribution of downstream datasets, and GM-Coord adjusts the gradient weights according to the dynamic optimization status of different modalities. Extensive experiments on five public medical datasets demonstrate the effectiveness of our UMD framework, which remarkably outperforms existing approaches on three kinds of downstream tasks.
- Open Access
- 18 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 163-176
Mozart: A Mobile ToF System for Sensing in the Dark through Phase Manipulation
- 18 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 163-176
Open AccessMozart: A Mobile ToF System for Sensing in the Dark through Phase Manipulation
- Open Access
- 18 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 530-543
Harmony: Heterogeneous Multi-Modal Federated Learning through Disentangled Model Training
- 18 June 2023
- Published by Association for Computing Machinery (ACM)
- p. 530-543
Open AccessHarmony: Heterogeneous Multi-Modal Federated Learning through Disentangled Model Training