Aiwen Xing
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Interests
Aiwen Xing has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Zhe He
Florida State University, Tallahassee, FL, USA
8 shared publications - Daniel Citardi
School of Computer Science and Information Systems, Pace University, New York, NY, United States
3 shared publications - Xiao Luo
University of Wisconsin–Madison, Madison, WI, USA
3 shared publications - Zhan Zhang
School of Computer Science and Information Systems, Pace University, New York, New York, USA
3 shared publications - Biyang Yu
Florida State University, School of Information, Tallahassee, FL, United States
2 shared publications - Dana Hughes
College of Social Work, Florida State University, Tallahassee, FL, United States
2 shared publications
Latest Publications
- 14 October 2025
- Published by Oxford University Press (OUP) in American Journal of Epidemiology
- Vol. 195 (4) , 1175-1181
An alternative method for assessing the fragility of survival analysis results: a proof-of-concept study based on the log-rank test
Misused P values and an excessive focus on significance have prompted calls for added robustness metrics. The fragility index (FI), which quantifies how many event status changes are needed to reverse statistical significance, serves as a useful complement. Although FI has been applied in various settings such as dose-finding trials and meta-analyses, its use in survival analysis is limited due to complexities like censoring, variable follow-up, and hazard assumptions. Existing FI adaptations for survival data often reassign individuals across intervention arms in randomized controlled trials (RCTs), diverging from FI’s original philosophy and reducing clinical plausibility. We propose a modified FI for survival data (FIS) to assess the robustness of survival analysis results in RCTs. Rather than reassigning individuals between intervention and control groups, FIS preserves the foundational principles of the original FI by quantifying the minimum number of changes in outcome status, either events or censoring, needed to overturn statistical significance. To enhance flexibility and practical utility, we extend FIS to assess fragility in both directions: from statistically significant to nonsignificant results and vice versa. We demonstrate the performance of the proposed method through two real-world cases from RCTs.
- 14 October 2025
- Published by Oxford University Press (OUP) in American Journal of Epidemiology
- Vol. 195 (4) , 1175-1181
An alternative method for assessing the fragility of survival analysis results: a proof-of-concept study based on the log-rank test
Misused P values and an excessive focus on significance have prompted calls for added robustness metrics. The fragility index (FI), which quantifies how many event status changes are needed to reverse statistical significance, serves as a useful complement. Although FI has been applied in various settings such as dose-finding trials and meta-analyses, its use in survival analysis is limited due to complexities like censoring, variable follow-up, and hazard assumptions. Existing FI adaptations for survival data often reassign individuals across intervention arms in randomized controlled trials (RCTs), diverging from FI’s original philosophy and reducing clinical plausibility. We propose a modified FI for survival data (FIS) to assess the robustness of survival analysis results in RCTs. Rather than reassigning individuals between intervention and control groups, FIS preserves the foundational principles of the original FI by quantifying the minimum number of changes in outcome status, either events or censoring, needed to overturn statistical significance. To enhance flexibility and practical utility, we extend FIS to assess fragility in both directions: from statistically significant to nonsignificant results and vice versa. We demonstrate the performance of the proposed method through two real-world cases from RCTs.
- Open Access
- 18 December 2024
- Published by Wiley in Diabetes, Obesity and Metabolism
- Vol. 27 (2) , 583-594
Long‐term weight loss and cardiorenal outcomes by baseline BMI in the VERTIS CV trial
Aim: To assess weight loss and cardiorenal outcomes by baseline body mass index (BMI) in VERTIS CV. Methods: Patients with type 2 diabetes and atherosclerotic cardiovascular (CV) disease were randomized to ertugliflozin or placebo. These post hoc analyses evaluated cardiometabolic and cardiorenal outcomes (a composite of death from CV causes or hospitalization for heart failure [HHF], CV death, HHF and an exploratory composite kidney outcome including ≥40% estimated glomerular filtration rate [eGFR] decrease) by baseline BMI, using conventional clinical categories and Cox proportional hazards models. Results: In total, 8246 adults were randomized (mean age 64.4 years, diabetes duration 13.0 years, BMI 32.0 kg/m 2 , 61% with BMI >30 kg/m 2 ). Absolute body weight reduction was greater with ertugliflozin versus placebo at 3 and 5 years in the overall population ( p < 0.001) and across BMI subgroups. Ertugliflozin increased the proportion of participants achieving ≥5% and ≥10% body weight reduction (ertugliflozin 34.9% and 13.6%, placebo 19.4% and 4.1%; odds ratio [95% confident interval, CI], 2.21 [1.76–2.77] and 3.65 [2.39–5.57], respectively) at 5 years. No significant difference was observed in the effect of ertugliflozin on HHF across BMI subgroups ( P interaction = 0.61). Similarly, no significant difference was observed in the effect of ertugliflozin on the kidney composite outcome across BMI subgroups ( P interaction = 0.39). Results were similar for other CV outcomes, and safety was consistent with the known ertugliflozin profile. Conclusion: Weight loss was observed across baseline BMI and was sustained over 5 years of follow‐up. The effects of ertugliflozin on HHF and kidney composite were consistent across baseline BMI.
- 18 December 2024
- Published by Wiley in Diabetes, Obesity and Metabolism
- Vol. 27 (2) , 583-594
Open AccessLong‐term weight loss and cardiorenal outcomes by baseline BMI in the VERTIS CV trial
Aim: To assess weight loss and cardiorenal outcomes by baseline body mass index (BMI) in VERTIS CV. Methods: Patients with type 2 diabetes and atherosclerotic cardiovascular (CV) disease were randomized to ertugliflozin or placebo. These post hoc analyses evaluated cardiometabolic and cardiorenal outcomes (a composite of death from CV causes or hospitalization for heart failure [HHF], CV death, HHF and an exploratory composite kidney outcome including ≥40% estimated glomerular filtration rate [eGFR] decrease) by baseline BMI, using conventional clinical categories and Cox proportional hazards models. Results: In total, 8246 adults were randomized (mean age 64.4 years, diabetes duration 13.0 years, BMI 32.0 kg/m 2 , 61% with BMI >30 kg/m 2 ). Absolute body weight reduction was greater with ertugliflozin versus placebo at 3 and 5 years in the overall population ( p < 0.001) and across BMI subgroups. Ertugliflozin increased the proportion of participants achieving ≥5% and ≥10% body weight reduction (ertugliflozin 34.9% and 13.6%, placebo 19.4% and 4.1%; odds ratio [95% confident interval, CI], 2.21 [1.76–2.77] and 3.65 [2.39–5.57], respectively) at 5 years. No significant difference was observed in the effect of ertugliflozin on HHF across BMI subgroups ( P interaction = 0.61). Similarly, no significant difference was observed in the effect of ertugliflozin on the kidney composite outcome across BMI subgroups ( P interaction = 0.39). Results were similar for other CV outcomes, and safety was consistent with the known ertugliflozin profile. Conclusion: Weight loss was observed across baseline BMI and was sustained over 5 years of follow‐up. The effects of ertugliflozin on HHF and kidney composite were consistent across baseline BMI.
- Open Access
- 20 June 2023
- Published by JMIR Publications Inc. in JMIR Cardio
- Vol. 7, e45352
Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
Background: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. Objective: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. Methods: Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. Results: RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). Conclusions: This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.
- 20 June 2023
- Published by JMIR Publications Inc. in JMIR Cardio
- Vol. 7, e45352
Open AccessPrediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches
Background: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. Objective: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. Methods: Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. Results: RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). Conclusions: This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.
- Open Access
- 26 December 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches (Preprint)
BACKGROUND The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. OBJECTIVE The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. METHODS Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. RESULTS RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). CONCLUSIONS This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.
- 26 December 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPrediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches (Preprint)
BACKGROUND The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care. OBJECTIVE The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients. METHODS Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models—extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)—as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction. RESULTS RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705). CONCLUSIONS This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.
- Open Access
- 3 June 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (6) , e0269241
Assessing the use of prescription drugs and dietary supplements in obese respondents in the National Health and Nutrition Examination Survey
Introduction: Obesity is a common disease and a known risk factor for many other conditions such as hypertension, type 2 diabetes, and cancer. Treatment options for obesity include lifestyle changes, pharmacotherapy, and surgical interventions such as bariatric surgery. In this study, we examine the use of prescription drugs and dietary supplements by the individuals with obesity. Methods: We conducted a cross-sectional analysis of the National Health and Nutrition Examination Survey (NHANES) data 2003–2018. We used multivariate logistic regression to analyze the correlations of demographics and obesity status with the use of prescription drugs and dietary supplement use. We also built machine learning models to classify prescription drug and dietary supplement use using demographic data and obesity status. Results: Individuals with obesity are more likely to take cardiovascular agents (OR = 2.095, 95% CI 1.989–2.207) and metabolic agents (OR = 1.658, 95% CI 1.573–1.748) than individuals without obesity. Gender, age, race, poverty income ratio, and insurance status are significantly correlated with dietary supplement use. The best performing model for classifying prescription drug use had the accuracy of 74.3% and the AUROC of 0.82. The best performing model for classifying dietary supplement use had the accuracy of 65.3% and the AUROC of 0.71. Conclusions: This study can inform clinical practice and patient education of the use of prescription drugs and dietary supplements and their correlation with obesity.
- 3 June 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (6) , e0269241
Open AccessAssessing the use of prescription drugs and dietary supplements in obese respondents in the National Health and Nutrition Examination Survey
Introduction: Obesity is a common disease and a known risk factor for many other conditions such as hypertension, type 2 diabetes, and cancer. Treatment options for obesity include lifestyle changes, pharmacotherapy, and surgical interventions such as bariatric surgery. In this study, we examine the use of prescription drugs and dietary supplements by the individuals with obesity. Methods: We conducted a cross-sectional analysis of the National Health and Nutrition Examination Survey (NHANES) data 2003–2018. We used multivariate logistic regression to analyze the correlations of demographics and obesity status with the use of prescription drugs and dietary supplement use. We also built machine learning models to classify prescription drug and dietary supplement use using demographic data and obesity status. Results: Individuals with obesity are more likely to take cardiovascular agents (OR = 2.095, 95% CI 1.989–2.207) and metabolic agents (OR = 1.658, 95% CI 1.573–1.748) than individuals without obesity. Gender, age, race, poverty income ratio, and insurance status are significantly correlated with dietary supplement use. The best performing model for classifying prescription drug use had the accuracy of 74.3% and the AUROC of 0.82. The best performing model for classifying dietary supplement use had the accuracy of 65.3% and the AUROC of 0.71. Conclusions: This study can inform clinical practice and patient education of the use of prescription drugs and dietary supplements and their correlation with obesity.
- Open Access
- 7 December 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (12) , e18725
Patient Challenges and Needs in Comprehending Laboratory Test Results: Mixed Methods Study
Background: Patients are increasingly able to access their laboratory test results via patient portals. However, merely providing access does not guarantee comprehension. Patients could experience confusion when reviewing their test results. Objective: The aim of this study is to examine the challenges and needs of patients when comprehending laboratory test results. Methods: We conducted a web-based survey with 203 participants and a set of semistructured interviews with 13 participants. We assessed patients’ perceived challenges and needs (both informational and technological needs) when they attempted to comprehend test results, factors associated with patients’ perceptions, and strategies for improving the design of patient portals to communicate laboratory test results more effectively. Descriptive and correlation analysis and thematic analysis were used to analyze the survey and interview data, respectively. Results: Patients face a variety of challenges and confusion when reviewing laboratory test results. To better comprehend laboratory results, patients need different types of information, which are grouped into 2 categories—generic information (eg, reference range) and personalized or contextual information (eg, treatment options, prognosis, what to do or ask next). We also found that several intrinsic factors (eg, laboratory result normality, health literacy, and technology proficiency) significantly impact people’s perceptions of using portals to view and interpret laboratory results. The desired enhancements of patient portals include providing timely explanations and educational resources (eg, a health encyclopedia), increasing usability and accessibility, and incorporating artificial intelligence–based technology to provide personalized recommendations. Conclusions: Patients face significant challenges in interpreting the meaning of laboratory test results. Designers and developers of patient portals should employ user-centered approaches to improve the design of patient portals to present information in a more meaningful way.
- 7 December 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (12) , e18725
Open AccessPatient Challenges and Needs in Comprehending Laboratory Test Results: Mixed Methods Study
Background: Patients are increasingly able to access their laboratory test results via patient portals. However, merely providing access does not guarantee comprehension. Patients could experience confusion when reviewing their test results. Objective: The aim of this study is to examine the challenges and needs of patients when comprehending laboratory test results. Methods: We conducted a web-based survey with 203 participants and a set of semistructured interviews with 13 participants. We assessed patients’ perceived challenges and needs (both informational and technological needs) when they attempted to comprehend test results, factors associated with patients’ perceptions, and strategies for improving the design of patient portals to communicate laboratory test results more effectively. Descriptive and correlation analysis and thematic analysis were used to analyze the survey and interview data, respectively. Results: Patients face a variety of challenges and confusion when reviewing laboratory test results. To better comprehend laboratory results, patients need different types of information, which are grouped into 2 categories—generic information (eg, reference range) and personalized or contextual information (eg, treatment options, prognosis, what to do or ask next). We also found that several intrinsic factors (eg, laboratory result normality, health literacy, and technology proficiency) significantly impact people’s perceptions of using portals to view and interpret laboratory results. The desired enhancements of patient portals include providing timely explanations and educational resources (eg, a health encyclopedia), increasing usability and accessibility, and incorporating artificial intelligence–based technology to provide personalized recommendations. Conclusions: Patients face significant challenges in interpreting the meaning of laboratory test results. Designers and developers of patient portals should employ user-centered approaches to improve the design of patient portals to present information in a more meaningful way.
- Open Access
- 22 October 2020
- Published by Wiley in Proceedings of the Association for Information Science and Technology
- Vol. 57 (1)
Lay individuals' perceptions of artificial intelligence (AI)‐empowered healthcare systems
With the recent advances in Artificial Intelligence (AI) technology, patient‐facing applications have started embodying this novel technology to deliver timely healthcare information and services to the patient. However, little is known about lay individuals' perceptions and acceptance of AI‐driven, patient‐facing health systems. In this study, we conducted a survey with 203 participants to investigate their perceptions about using AI to consult information related to their diagnostic results and what factors influence their perceptions. Our results showed that despite the awareness and experience of patient‐facing AI systems being low amongst our participants, people had a generally positive attitude towards such systems. A majority of participants indicated a high level of comfortability and willingness to use health AI systems, and agreed AI could help them comprehend diagnostic results. Several intrinsic factors, such as education background and technology literacy, play an important role in people's perceptions of using AI to comprehend diagnostic results. In particular, people with high technology and health literacy, and education levels had more experiences with using AI and tended to trust AI outputs. We conclude this paper by discussing the implications of this work, with an emphasis on enhancing the trustworthiness of AI and bridging the digital divide.
- 22 October 2020
- Published by Wiley in Proceedings of the Association for Information Science and Technology
- Vol. 57 (1)
Open AccessLay individuals' perceptions of artificial intelligence (AI)‐empowered healthcare systems
With the recent advances in Artificial Intelligence (AI) technology, patient‐facing applications have started embodying this novel technology to deliver timely healthcare information and services to the patient. However, little is known about lay individuals' perceptions and acceptance of AI‐driven, patient‐facing health systems. In this study, we conducted a survey with 203 participants to investigate their perceptions about using AI to consult information related to their diagnostic results and what factors influence their perceptions. Our results showed that despite the awareness and experience of patient‐facing AI systems being low amongst our participants, people had a generally positive attitude towards such systems. A majority of participants indicated a high level of comfortability and willingness to use health AI systems, and agreed AI could help them comprehend diagnostic results. Several intrinsic factors, such as education background and technology literacy, play an important role in people's perceptions of using AI to comprehend diagnostic results. In particular, people with high technology and health literacy, and education levels had more experiences with using AI and tended to trust AI outputs. We conclude this paper by discussing the implications of this work, with an emphasis on enhancing the trustworthiness of AI and bridging the digital divide.
- Open Access
How the clinical research community responded to the COVID-19 pandemic: An analysis of the COVID-19 clinical studies in ClinicalTrials.gov
Objective: The novel coronavirus disease (COVID-19), broke out in December 2019, is a global pandemic. Rapidly in the past few months, a large number of clinical studies have been initiated worldwide to find effective therapeutics, vaccines, and preventive strategies. In this study, we aim to understand the landscape of COVID-19 clinical research and identify the gaps and issues that may cause difficulty in recruitment and the lack of population representativeness. Materials and Methods: We analyzed 2,034 COVID-19 studies registered in the largest public registry - ClinicalTrials.gov . Leveraging natural language processing, descriptive analysis, association analysis, and clustering analysis, we characterized COVID-19 clinical studies by phase and design features. Particularly, we analyzed their eligibility criteria to understand: (1) whether they considered the reported underlying health conditions that may lead to severe illnesses, and (2) if these studies excluded older adults, either explicitly or implicitly, which may reduce the generalizability of these studies in older adults. Results: The 5 most frequently tested drugs are Hydroxychloroquine (N=148), Azithromycin (N=46), Tocilizumab (N=29), Lopinavir (N=20), and Ritonavir (N=20). Most trials did not have an upper age limit and did not exclude patients with common chronic conditions such as hypertension and diabetes that are prevalent in older adults. However, known risk factors that may lead to severe illnesses have not been adequately considered by existing studies. Conclusions: A careful examination of the registered COVID-19 clinical studies can identify the research gaps and inform future COVID-19 trial design towards balanced internal validity and generalizability.
Open AccessHow the clinical research community responded to the COVID-19 pandemic: An analysis of the COVID-19 clinical studies in ClinicalTrials.gov
Objective: The novel coronavirus disease (COVID-19), broke out in December 2019, is a global pandemic. Rapidly in the past few months, a large number of clinical studies have been initiated worldwide to find effective therapeutics, vaccines, and preventive strategies. In this study, we aim to understand the landscape of COVID-19 clinical research and identify the gaps and issues that may cause difficulty in recruitment and the lack of population representativeness. Materials and Methods: We analyzed 2,034 COVID-19 studies registered in the largest public registry - ClinicalTrials.gov . Leveraging natural language processing, descriptive analysis, association analysis, and clustering analysis, we characterized COVID-19 clinical studies by phase and design features. Particularly, we analyzed their eligibility criteria to understand: (1) whether they considered the reported underlying health conditions that may lead to severe illnesses, and (2) if these studies excluded older adults, either explicitly or implicitly, which may reduce the generalizability of these studies in older adults. Results: The 5 most frequently tested drugs are Hydroxychloroquine (N=148), Azithromycin (N=46), Tocilizumab (N=29), Lopinavir (N=20), and Ritonavir (N=20). Most trials did not have an upper age limit and did not exclude patients with common chronic conditions such as hypertension and diabetes that are prevalent in older adults. However, known risk factors that may lead to severe illnesses have not been adequately considered by existing studies. Conclusions: A careful examination of the registered COVID-19 clinical studies can identify the research gaps and inform future COVID-19 trial design towards balanced internal validity and generalizability.
- Open Access
- 21 May 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (5) , e16795
An Informatics Framework to Assess Consumer Health Language Complexity Differences: Proof-of-Concept Study
Background: The language gap between health consumers and health professionals has been long recognized as the main hindrance to effective health information comprehension. Although providing health information access in consumer health language (CHL) is widely accepted as the solution to the problem, health consumers are found to have varying health language preferences and proficiencies. To simplify health documents for heterogeneous consumer groups, it is important to quantify how CHLs are different in terms of complexity among various consumer groups. Objective: This study aimed to propose an informatics framework (consumer health language complexity [CHELC]) to assess the complexity differences of CHL using syntax-level, text-level, term-level, and semantic-level complexity metrics. Specifically, we identified 8 language complexity metrics validated in previous literature and combined them into a 4-faceted framework. Through a rank-based algorithm, we developed unifying scores (CHELC scores [CHELCS]) to quantify syntax-level, text-level, term-level, semantic-level, and overall CHL complexity. We applied CHELCS to compare posts of each individual on online health forums designed for (1) the general public, (2) deaf and hearing-impaired people, and (3) people with autism spectrum disorder (ASD). Methods: We examined posts with more than 4 sentences of each user from 3 health forums to understand CHL complexity differences among these groups: 12,560 posts from 3756 users in Yahoo! Answers, 25,545 posts from 1623 users in AllDeaf, and 26,484 posts from 2751 users in Wrong Planet. We calculated CHELCS for each user and compared the scores of 3 user groups (ie, deaf and hearing-impaired people, people with ASD, and the public) through 2-sample Kolmogorov-Smirnov tests and analysis of covariance tests. Results: The results suggest that users in the public forum used more complex CHL, particularly more diverse semantics and more complex health terms compared with users in the ASD and deaf and hearing-impaired user forums. However, between the latter 2 groups, people with ASD used more complex words, and deaf and hearing-impaired users used more complex syntax. Conclusions: Our results show that the users in 3 online forums had significantly different CHL complexities in different facets. The proposed framework and detailed measurements help to quantify these CHL complexity differences comprehensively. The results emphasize the importance of tailoring health-related content for different consumer groups with varying CHL complexities.
- 21 May 2020
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 22 (5) , e16795
Open AccessAn Informatics Framework to Assess Consumer Health Language Complexity Differences: Proof-of-Concept Study
Background: The language gap between health consumers and health professionals has been long recognized as the main hindrance to effective health information comprehension. Although providing health information access in consumer health language (CHL) is widely accepted as the solution to the problem, health consumers are found to have varying health language preferences and proficiencies. To simplify health documents for heterogeneous consumer groups, it is important to quantify how CHLs are different in terms of complexity among various consumer groups. Objective: This study aimed to propose an informatics framework (consumer health language complexity [CHELC]) to assess the complexity differences of CHL using syntax-level, text-level, term-level, and semantic-level complexity metrics. Specifically, we identified 8 language complexity metrics validated in previous literature and combined them into a 4-faceted framework. Through a rank-based algorithm, we developed unifying scores (CHELC scores [CHELCS]) to quantify syntax-level, text-level, term-level, semantic-level, and overall CHL complexity. We applied CHELCS to compare posts of each individual on online health forums designed for (1) the general public, (2) deaf and hearing-impaired people, and (3) people with autism spectrum disorder (ASD). Methods: We examined posts with more than 4 sentences of each user from 3 health forums to understand CHL complexity differences among these groups: 12,560 posts from 3756 users in Yahoo! Answers, 25,545 posts from 1623 users in AllDeaf, and 26,484 posts from 2751 users in Wrong Planet. We calculated CHELCS for each user and compared the scores of 3 user groups (ie, deaf and hearing-impaired people, people with ASD, and the public) through 2-sample Kolmogorov-Smirnov tests and analysis of covariance tests. Results: The results suggest that users in the public forum used more complex CHL, particularly more diverse semantics and more complex health terms compared with users in the ASD and deaf and hearing-impaired user forums. However, between the latter 2 groups, people with ASD used more complex words, and deaf and hearing-impaired users used more complex syntax. Conclusions: Our results show that the users in 3 online forums had significantly different CHL complexities in different facets. The proposed framework and detailed measurements help to quantify these CHL complexity differences comprehensively. The results emphasize the importance of tailoring health-related content for different consumer groups with varying CHL complexities.
- Open Access
- 14 March 2020
- Published by JMIR Publications Inc. in JMIR Preprints
Patient Challenges and Needs in Comprehending Laboratory Test Results: Mixed Methods Study (Preprint)
BACKGROUND Patients are increasingly able to access their laboratory test results via patient portals. However, merely providing access does not guarantee comprehension. Patients could experience confusion when reviewing their test results. OBJECTIVE The aim of this study is to examine the challenges and needs of patients when comprehending laboratory test results. METHODS We conducted a web-based survey with 203 participants and a set of semistructured interviews with 13 participants. We assessed patients’ perceived challenges and needs (both informational and technological needs) when they attempted to comprehend test results, factors associated with patients’ perceptions, and strategies for improving the design of patient portals to communicate laboratory test results more effectively. Descriptive and correlation analysis and thematic analysis were used to analyze the survey and interview data, respectively. RESULTS Patients face a variety of challenges and confusion when reviewing laboratory test results. To better comprehend laboratory results, patients need different types of information, which are grouped into 2 categories—generic information (eg, reference range) and personalized or contextual information (eg, treatment options, prognosis, what to do or ask next). We also found that several intrinsic factors (eg, laboratory result normality, health literacy, and technology proficiency) significantly impact people’s perceptions of using portals to view and interpret laboratory results. The desired enhancements of patient portals include providing timely explanations and educational resources (eg, a health encyclopedia), increasing usability and accessibility, and incorporating artificial intelligence–based technology to provide personalized recommendations. CONCLUSIONS Patients face significant challenges in interpreting the meaning of laboratory test results. Designers and developers of patient portals should employ user-centered approaches to improve the design of patient portals to present information in a more meaningful way.
- 14 March 2020
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPatient Challenges and Needs in Comprehending Laboratory Test Results: Mixed Methods Study (Preprint)
BACKGROUND Patients are increasingly able to access their laboratory test results via patient portals. However, merely providing access does not guarantee comprehension. Patients could experience confusion when reviewing their test results. OBJECTIVE The aim of this study is to examine the challenges and needs of patients when comprehending laboratory test results. METHODS We conducted a web-based survey with 203 participants and a set of semistructured interviews with 13 participants. We assessed patients’ perceived challenges and needs (both informational and technological needs) when they attempted to comprehend test results, factors associated with patients’ perceptions, and strategies for improving the design of patient portals to communicate laboratory test results more effectively. Descriptive and correlation analysis and thematic analysis were used to analyze the survey and interview data, respectively. RESULTS Patients face a variety of challenges and confusion when reviewing laboratory test results. To better comprehend laboratory results, patients need different types of information, which are grouped into 2 categories—generic information (eg, reference range) and personalized or contextual information (eg, treatment options, prognosis, what to do or ask next). We also found that several intrinsic factors (eg, laboratory result normality, health literacy, and technology proficiency) significantly impact people’s perceptions of using portals to view and interpret laboratory results. The desired enhancements of patient portals include providing timely explanations and educational resources (eg, a health encyclopedia), increasing usability and accessibility, and incorporating artificial intelligence–based technology to provide personalized recommendations. CONCLUSIONS Patients face significant challenges in interpreting the meaning of laboratory test results. Designers and developers of patient portals should employ user-centered approaches to improve the design of patient portals to present information in a more meaningful way.