XSXingzhi Sun

Xingzhi Sun

*This is an algorithmically generated author record based on publicly available information.

Xingzhi Sun has a total of 38 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study

    by Siqi Liu, Qianyi Xu, Zhuoyang Xu, Zhuo Liu, Xingzhi Sun, Guotong Xie, Mengling Feng, Kay Choong See

    Background: One of the significant changes in intensive care medicine over the past 2 decades is the acknowledgment that improper mechanical ventilation settings substantially contribute to pulmonary injury in critically ill patients. Artificial intelligence (AI) solutions can optimize mechanical ventilation settings in intensive care units (ICUs) and improve patient outcomes. Specifically, machine learning algorithms can be trained on large datasets of patient information and mechanical ventilation settings. These algorithms can then predict patient responses to different ventilation strategies and suggest personalized ventilation settings for individual patients. Objective: In this study, we aimed to design and evaluate an AI solution that could tailor an optimal ventilator strategy for each critically ill patient who requires mechanical ventilation. Methods: We proposed a reinforcement learning–based AI solution using observational data from multiple ICUs in the United States. The primary outcome was hospital mortality. Secondary outcomes were the proportion of optimal oxygen saturation and the proportion of optimal mean arterial blood pressure. We trained our AI agent to recommend low, medium, and high levels of 3 ventilator settings—positive end-expiratory pressure, fraction of inspired oxygen, and ideal body weight–adjusted tidal volume—according to patients’ health conditions. We defined a policy as rules guiding ventilator setting changes given specific clinical scenarios. Off-policy evaluation metrics were applied to evaluate the AI policy. Results: We studied 21,595 and 5105 patients’ ICU stays from the e-Intensive Care Unit Collaborative Research (eICU) and Medical Information Mart for Intensive Care IV (MIMIC-IV) databases, respectively. Using the learned AI policy, we estimated the hospital mortality rate (eICU 12.1%, SD 3.1%; MIMIC-IV 29.1%, SD 0.9%), the proportion of optimal oxygen saturation (eICU 58.7%, SD 4.7%; MIMIC-IV 49%, SD 1%), and the proportion of optimal mean arterial blood pressure (eICU 31.1%, SD 4.5%; MIMIC-IV 41.2%, SD 1%). Based on multiple quantitative and qualitative evaluation metrics, our proposed AI solution outperformed observed clinical practice. Conclusions: Our study found that customizing ventilation settings for individual patients led to lower estimated hospital mortality rates compared to actual rates. This highlights the potential effectiveness of using reinforcement learning methodology to develop AI models that analyze complex clinical data for optimizing treatment parameters. Additionally, our findings suggest the integration of this model into a clinical decision support system for refining ventilation settings, supporting the need for prospective validation trials.


  • Open Access

    Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study (Preprint)

    by Siqi Liu, Qianyi Xu, Zhuoyang Xu, Zhuo Liu, Xingzhi Sun, Guotong Xie, Mengling Feng, Kay Choong See

    BACKGROUND One of the significant changes in intensive care medicine over the past 2 decades is the acknowledgment that improper mechanical ventilation settings substantially contribute to pulmonary injury in critically ill patients. Artificial intelligence (AI) solutions can optimize mechanical ventilation settings in intensive care units (ICUs) and improve patient outcomes. Specifically, machine learning algorithms can be trained on large datasets of patient information and mechanical ventilation settings. These algorithms can then predict patient responses to different ventilation strategies and suggest personalized ventilation settings for individual patients. OBJECTIVE In this study, we aimed to design and evaluate an AI solution that could tailor an optimal ventilator strategy for each critically ill patient who requires mechanical ventilation. METHODS We proposed a reinforcement learning–based AI solution using observational data from multiple ICUs in the United States. The primary outcome was hospital mortality. Secondary outcomes were the proportion of optimal oxygen saturation and the proportion of optimal mean arterial blood pressure. We trained our AI agent to recommend low, medium, and high levels of 3 ventilator settings—positive end-expiratory pressure, fraction of inspired oxygen, and ideal body weight–adjusted tidal volume—according to patients’ health conditions. We defined a policy as rules guiding ventilator setting changes given specific clinical scenarios. Off-policy evaluation metrics were applied to evaluate the AI policy. RESULTS We studied 21,595 and 5105 patients’ ICU stays from the e-Intensive Care Unit Collaborative Research (eICU) and Medical Information Mart for Intensive Care IV (MIMIC-IV) databases, respectively. Using the learned AI policy, we estimated the hospital mortality rate (eICU 12.1%, SD 3.1%; MIMIC-IV 29.1%, SD 0.9%), the proportion of optimal oxygen saturation (eICU 58.7%, SD 4.7%; MIMIC-IV 49%, SD 1%), and the proportion of optimal mean arterial blood pressure (eICU 31.1%, SD 4.5%; MIMIC-IV 41.2%, SD 1%). Based on multiple quantitative and qualitative evaluation metrics, our proposed AI solution outperformed observed clinical practice. CONCLUSIONS Our study found that customizing ventilation settings for individual patients led to lower estimated hospital mortality rates compared to actual rates. This highlights the potential effectiveness of using reinforcement learning methodology to develop AI models that analyze complex clinical data for optimizing treatment parameters. Additionally, our findings suggest the integration of this model into a clinical decision support system for refining ventilation settings, supporting the need for prospective validation trials.


  • Open Access

    Effective Treatment Recommendations for Type 2 Diabetes Management Using Reinforcement Learning: Treatment Recommendation Model Development and Validation

    by Xingzhi Sun, Yong Mong Bee, Shao Wei Lam, Zhuo Liu, Wei Zhao, Sing Yi Chia, Hanis Abdul Kadir, Jun Tian Wu, Boon Yew Ang, Nan Liu, et al.

    Background: Type 2 diabetes mellitus (T2DM) and its related complications represent a growing economic burden for many countries and health systems. Diabetes complications can be prevented through better disease control, but there is a large gap between the recommended treatment and the treatment that patients actually receive. The treatment of T2DM can be challenging because of different comprehensive therapeutic targets and individual variability of the patients, leading to the need for precise, personalized treatment. Objective: The aim of this study was to develop treatment recommendation models for T2DM based on deep reinforcement learning. A retrospective analysis was then performed to evaluate the reliability and effectiveness of the models. Methods: The data used in our study were collected from the Singapore Health Services Diabetes Registry, encompassing 189,520 patients with T2DM, including 6,407,958 outpatient visits from 2013 to 2018. The treatment recommendation model was built based on 80% of the dataset and its effectiveness was evaluated with the remaining 20% of data. Three treatment recommendation models were developed for antiglycemic, antihypertensive, and lipid-lowering treatments by combining a knowledge-driven model and a data-driven model. The knowledge-driven model, based on clinical guidelines and expert experiences, was first applied to select the candidate medications. The data-driven model, based on deep reinforcement learning, was used to rank the candidates according to the expected clinical outcomes. To evaluate the models, short-term outcomes were compared between the model-concordant treatments and the model-nonconcordant treatments with confounder adjustment by stratification, propensity score weighting, and multivariate regression. For long-term outcomes, model-concordant rates were included as independent variables to evaluate if the combined antiglycemic, antihypertensive, and lipid-lowering treatments had a positive impact on reduction of long-term complication occurrence or death at the patient level via multivariate logistic regression. Results: The test data consisted of 36,993 patients for evaluating the effectiveness of the three treatment recommendation models. In 43.3% of patient visits, the antiglycemic medications recommended by the model were concordant with the actual prescriptions of the physicians. The concordant rates for antihypertensive medications and lipid-lowering medications were 51.3% and 58.9%, respectively. The evaluation results also showed that model-concordant treatments were associated with better glycemic control (odds ratio [OR] 1.73, 95% CI 1.69-1.76), blood pressure control (OR 1.26, 95% CI, 1.23-1.29), and blood lipids control (OR 1.28, 95% CI 1.22-1.35). We also found that patients with more model-concordant treatments were associated with a lower risk of diabetes complications (including 3 macrovascular and 2 microvascular complications) and death, suggesting that the models have the potential of achieving better outcomes in the long term. Conclusions: Comprehensive management by combining knowledge-driven and data-driven models has good potential to help physicians improve the clinical outcomes of patients with T2DM; achieving good control on blood glucose, blood pressure, and blood lipids; and reducing the risk of diabetes complications in the long term.


  • Open Access

    Identification of 27 abnormalities from multi-lead ECG signals: an ensembled SE_ResNet framework with Sign Loss function

    by Zhaowei Zhu, Xiang Lan, Tingting Zhao, Yangming Guo, Pipin Kojodjojo, Zhuoyang Xu, Zhuo Liu, Siqi Liu, Han Wang, Xingzhi Sun, et al.

    Objective . Cardiovascular disease is a major threat to health and one of the primary causes of death globally. The 12-lead ECG is a cheap and commonly accessible tool to identify cardiac abnormalities. Early and accurate diagnosis will allow early treatment and intervention to prevent severe complications of cardiovascular disease. Our objective is to develop an algorithm that automatically identifies 27 ECG abnormalities from 12-lead ECG databases. Approach . Firstly, a series of pre-processing methods were proposed and applied on various data sources in order to mitigate the problem of data divergence. Secondly, we ensembled two SE_ResNet models and one rule-based model to enhance the performance of various ECG abnormalities’ classification. Thirdly, we introduce a Sign Loss to tackle the problem of class imbalance, and thus improve the model's generalizability. Main results . In the PhysioNet/Computing in Cardiology Challenge (2020), our proposed approach achieved a challenge validation score of 0.682, and a full test score of 0.514, placed us 3rd out of 40 in the official ranking. Significance . We proposed an accurate and robust predictive framework that combines deep neural networks and clinical knowledge to automatically classify multiple ECG abnormalities. Our framework is able to identify 27 ECG abnormalities from multi-lead ECG signals regardless of discrepancies in data sources and the imbalance of data labeling. We trained our framework on five datasets and validated it on six datasets from various countries. The outstanding performance demonstrate the effectiveness of our proposed framework.


  • Open Access

    Characteristics of Online Health Care Services From China’s Largest Online Medical Platform: Cross-sectional Survey Study

    by Xuehan Jiang, Hong Xie, Rui Tang, Yanmei Du, Tao Li, Jinsheng Gao, Xiuping Xu, Siqi Jiang, Tingting Zhao, Wei Zhao, et al.

    Background: Internet hospitals in China are in great demand due to limited and unevenly distributed health care resources, lack of family doctors, increased burdens of chronic diseases, and rapid growth of the aged population. The COVID-19 epidemic catalyzed the expansion of online health care services. In recent years, internet hospitals have been rapidly developed. Ping An Good Doctor is the largest, national online medical entry point in China and is a widely used platform providing online health care services. Objective: This study aims to give a comprehensive description of the characteristics of the online consultations and inquisitions in Ping An Good Doctor. The analyses tried to answer the following questions: (1) What are the characteristics of the consultations in Ping An Good Doctor in terms of department and disease profiles? (2) Who uses the online health services most frequently? and (3) How is the user experience of the online consultations of Ping An Good Doctor? Methods: A total of 35.3 million consultations and inquisitions over the course of 1 year were analyzed with respect to the distributions of departments and diseases, user profiles, and consulting behaviors. Results: The geographical distribution of the usage of Ping An Good Doctor showed that Shandong (18.4%), Yunnan (15.6%), Shaanxi (7.2%), and Guangdong (5.5%) were the provinces that used it the most; they accounted for 46.6% of the total consultations and inquisitions. In terms of department distribution, we found that gynecology and obstetrics (19.2%), dermatology (17.0%), and pediatrics (14.4%) were the top three departments in Ping An Good Doctor. The disease distribution analysis showed that, except for nondisease-specific consultations, acute upper respiratory infection (AURI) (4.1%), pregnancy (2.8%), and dermatitis (2.4%) were the most frequently consulted diseases. In terms of user profiles, females (60.4%) from 19 to 35 years of age were most likely to seek consultations online, in general. The user behavior analyses showed that the peak times of day for online consultations occurred at 10 AM, 3 PM, and 9 PM. Regarding user experience, 93.0% of users gave full marks following their consultations. For some disease-related health problems, such as AURI, dermatitis, and eczema, the feedback scores were above average. Conclusions: The prevalence of internet hospitals, such as Ping An Good Doctor, illustrated the great demand for online health care services that can go beyond geographical limitations. Our analyses showed that nondisease-specific issues and moderate health problems were much more frequently consulted about than severe clinical conditions. This indicated that internet hospitals played the role of the family doctor, which helped to relieve the stress placed on offline hospitals and facilitated people’s lives. In addition, good user experiences, especially regarding disease-related inquisitions, suggested that online health services can help solve health problems. With support from the government and acceptance by the public, online health care services could develop at a fast pace and greatly benefit people’s daily lives.


  • Open Access

    Effective Treatment Recommendations for Type 2 Diabetes Management Using Reinforcement Learning: Treatment Recommendation Model Development and Validation (Preprint)

    by Xingzhi Sun, Yong Mong Bee, Shao Wei Lam, Zhuo Liu, Wei Zhao, Sing Yi Chia, Hanis Abdul Kadir, Jun Tian Wu, Boon Yew Ang, Nan Liu, et al.

    BACKGROUND Type 2 diabetes mellitus (T2DM) and its related complications represent a growing economic burden for many countries and health systems. Diabetes complications can be prevented through better disease control, but there is a large gap between the recommended treatment and the treatment that patients actually receive. The treatment of T2DM can be challenging because of different comprehensive therapeutic targets and individual variability of the patients, leading to the need for precise, personalized treatment. OBJECTIVE The aim of this study was to develop treatment recommendation models for T2DM based on deep reinforcement learning. A retrospective analysis was then performed to evaluate the reliability and effectiveness of the models. METHODS The data used in our study were collected from the Singapore Health Services Diabetes Registry, encompassing 189,520 patients with T2DM, including 6,407,958 outpatient visits from 2013 to 2018. The treatment recommendation model was built based on 80% of the dataset and its effectiveness was evaluated with the remaining 20% of data. Three treatment recommendation models were developed for antiglycemic, antihypertensive, and lipid-lowering treatments by combining a knowledge-driven model and a data-driven model. The knowledge-driven model, based on clinical guidelines and expert experiences, was first applied to select the candidate medications. The data-driven model, based on deep reinforcement learning, was used to rank the candidates according to the expected clinical outcomes. To evaluate the models, short-term outcomes were compared between the model-concordant treatments and the model-nonconcordant treatments with confounder adjustment by stratification, propensity score weighting, and multivariate regression. For long-term outcomes, model-concordant rates were included as independent variables to evaluate if the combined antiglycemic, antihypertensive, and lipid-lowering treatments had a positive impact on reduction of long-term complication occurrence or death at the patient level via multivariate logistic regression. RESULTS The test data consisted of 36,993 patients for evaluating the effectiveness of the three treatment recommendation models. In 43.3% of patient visits, the antiglycemic medications recommended by the model were concordant with the actual prescriptions of the physicians. The concordant rates for antihypertensive medications and lipid-lowering medications were 51.3% and 58.9%, respectively. The evaluation results also showed that model-concordant treatments were associated with better glycemic control (odds ratio [OR] 1.73, 95% CI 1.69-1.76), blood pressure control (OR 1.26, 95% CI, 1.23-1.29), and blood lipids control (OR 1.28, 95% CI 1.22-1.35). We also found that patients with more model-concordant treatments were associated with a lower risk of diabetes complications (including 3 macrovascular and 2 microvascular complications) and death, suggesting that the models have the potential of achieving better outcomes in the long term. CONCLUSIONS Comprehensive management by combining knowledge-driven and data-driven models has good potential to help physicians improve the clinical outcomes of patients with T2DM; achieving good control on blood glucose, blood pressure, and blood lipids; and reducing the risk of diabetes complications in the long term.

  • Open Access

    Characteristics of Online Health Care Services From China’s Largest Online Medical Platform: Cross-sectional Survey Study (Preprint)

    by Xuehan Jiang, Hong Xie, Rui Tang, Yanmei Du, Tao Li, Jinsheng Gao, Xiuping Xu, Siqi Jiang, Tingting Zhao, Wei Zhao, et al.

    BACKGROUND Internet hospitals in China are in great demand due to limited and unevenly distributed health care resources, lack of family doctors, increased burdens of chronic diseases, and rapid growth of the aged population. The COVID-19 epidemic catalyzed the expansion of online health care services. In recent years, internet hospitals have been rapidly developed. Ping An Good Doctor is the largest, national online medical entry point in China and is a widely used platform providing online health care services. OBJECTIVE This study aims to give a comprehensive description of the characteristics of the online consultations and inquisitions in Ping An Good Doctor. The analyses tried to answer the following questions: (1) What are the characteristics of the consultations in Ping An Good Doctor in terms of department and disease profiles? (2) Who uses the online health services most frequently? and (3) How is the user experience of the online consultations of Ping An Good Doctor? METHODS A total of 35.3 million consultations and inquisitions over the course of 1 year were analyzed with respect to the distributions of departments and diseases, user profiles, and consulting behaviors. RESULTS The geographical distribution of the usage of Ping An Good Doctor showed that Shandong (18.4%), Yunnan (15.6%), Shaanxi (7.2%), and Guangdong (5.5%) were the provinces that used it the most; they accounted for 46.6% of the total consultations and inquisitions. In terms of department distribution, we found that gynecology and obstetrics (19.2%), dermatology (17.0%), and pediatrics (14.4%) were the top three departments in Ping An Good Doctor. The disease distribution analysis showed that, except for nondisease-specific consultations, acute upper respiratory infection (AURI) (4.1%), pregnancy (2.8%), and dermatitis (2.4%) were the most frequently consulted diseases. In terms of user profiles, females (60.4%) from 19 to 35 years of age were most likely to seek consultations online, in general. The user behavior analyses showed that the peak times of day for online consultations occurred at 10 AM, 3 PM, and 9 PM. Regarding user experience, 93.0% of users gave full marks following their consultations. For some disease-related health problems, such as AURI, dermatitis, and eczema, the feedback scores were above average. CONCLUSIONS The prevalence of internet hospitals, such as Ping An Good Doctor, illustrated the great demand for online health care services that can go beyond geographical limitations. Our analyses showed that nondisease-specific issues and moderate health problems were much more frequently consulted about than severe clinical conditions. This indicated that internet hospitals played the role of the family doctor, which helped to relieve the stress placed on offline hospitals and facilitated people’s lives. In addition, good user experiences, especially regarding disease-related inquisitions, suggested that online health services can help solve health problems. With support from the government and acceptance by the public, online health care services could develop at a fast pace and greatly benefit people’s daily lives.

  • Top Cited Papers
    Open Access

    Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review

    by Siqi Liu, Kay Choong See, Kee Yuan Ngiam, Leo Anthony Celi, Xingzhi Sun, Mengling Feng

    Background: Decision support systems based on reinforcement learning (RL) have been implemented to facilitate the delivery of personalized care. This paper aimed to provide a comprehensive review of RL applications in the critical care setting. Objective: This review aimed to survey the literature on RL applications for clinical decision support in critical care and to provide insight into the challenges of applying various RL models. Methods: We performed an extensive search of the following databases: PubMed, Google Scholar, Institute of Electrical and Electronics Engineers (IEEE), ScienceDirect, Web of Science, Medical Literature Analysis and Retrieval System Online (MEDLINE), and Excerpta Medica Database (EMBASE). Studies published over the past 10 years (2010-2019) that have applied RL for critical care were included. Results: We included 21 papers and found that RL has been used to optimize the choice of medications, drug dosing, and timing of interventions and to target personalized laboratory values. We further compared and contrasted the design of the RL models and the evaluation metrics for each application. Conclusions: RL has great potential for enhancing decision making in critical care. Challenges regarding RL system design, evaluation metrics, and model choice exist. More importantly, further work is required to validate RL in authentic clinical environments.


  • Open Access

    Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review (Preprint)

    by Siqi Liu, Kay Choong See, Kee Yuan Ngiam, Leo Anthony Celi, Xingzhi Sun, Mengling Feng

    BACKGROUND Decision support systems based on reinforcement learning (RL) have been implemented to facilitate the delivery of personalized care. This paper aimed to provide a comprehensive review of RL applications in the critical care setting. OBJECTIVE This review aimed to survey the literature on RL applications for clinical decision support in critical care and to provide insight into the challenges of applying various RL models. METHODS We performed an extensive search of the following databases: PubMed, Google Scholar, Institute of Electrical and Electronics Engineers (IEEE), ScienceDirect, Web of Science, Medical Literature Analysis and Retrieval System Online (MEDLINE), and Excerpta Medica Database (EMBASE). Studies published over the past 10 years (2010-2019) that have applied RL for critical care were included. RESULTS We included 21 papers and found that RL has been used to optimize the choice of medications, drug dosing, and timing of interventions and to target personalized laboratory values. We further compared and contrasted the design of the RL models and the evaluation metrics for each application. CONCLUSIONS RL has great potential for enhancing decision making in critical care. Challenges regarding RL system design, evaluation metrics, and model choice exist. More importantly, further work is required to validate RL in authentic clinical environments.