Yuchun Zhou
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Yuchun Zhou has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Xia Jing
Department of Public Health, College of Behavioral, Social and Health Sciences, Clemson University, Clemson, SC 29634, USA
12 shared publications - Chang Liu
Ohio University, Athens, Ohio, USA
9 shared publications - James J. Cimino
Department of Biomedical Informatics, University of Alabama at Birmingham , Birmingham, AL 35233
9 shared publications - Jay H. Shubrook
College of Osteopathic Medicine, Touro University California, Vallejo, CA
9 shared publications - Sonsoles De Lacalle
Department of Health Science, California State University Channel Islands
9 shared publications - Vimla Lodhia Patel
The New York Academy of Medicine
9 shared publications
Latest Publications
- Open Access
- 8 September 2025
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 11 (1) , e65616
Health Indicators as Measures of Individual Health Status, Their Perceived Importance, and Associated Factors: Cross-Sectional Observational Study
Background: Health indicators can facilitate the assessment of individual and population health status and are valuable in health care and public health settings. However, it is challenging to collect all measures at once. There is no single, objective, comprehensive, accurate, easy-to-use measure for individual health status yet, and we aim to develop one. We identified 29 health indicators via literature review and ranked their importance through public ratings to start the effort. Objective: This study aims to explore the effects of 4 demographic variables (age, sex, professional group, and educational level) on the importance ratings of the 29 indicators. Methods: This was a cross-sectional study. Online surveys were administered on 2 US college campuses and through ResearchMatch, an online platform specialized in finding clinical research participants. Only individuals 18 years or older were considered for inclusion as respondents. A 4-way multivariate analysis of variance (MANOVA) with post hoc testing was conducted to determine the effects of 4 demographic factors on the 29 health indicators. Descriptive statistics and bivariate correlation analysis were reported, along with the results of MANOVA with post hoc testing. Results: The study included 1153 participants from the United States of America with 1144 complete responses. Our study found significant correlations among the 29 health indicators. Age, education, sex, and professional groups showed correlations with multiple health indicators. Correlation analysis indicated that age was correlated with 16 of the 29 health indicators, followed by education (9 indicators), sex (8 indicators), and professional group (7 indicators). MANOVA modeling revealed that age (partial eta squared=0.058; P<.001), sex (partial eta squared=0.05; P<.001), professional group (partial eta squared=0.049; P<.001), and educational levels (partial eta squared=0.047; P<.001), as well as the interactions between sex and professional group (partial eta squared=0.044; P<.001) and sex and age (partial eta squared=0.041; P<.001), showed significant effects on the combination of the 29 health indicators. In general, female participants provided significantly higher ratings on 10 health indicators than male participants (P<.05), whereas older participants provided significantly higher ratings on 20 health indicators than younger participants (P<.05). Conclusions: Age emerged as a critical factor influencing the ratings of the 29 health indicators and showed the largest effect size along with sex, professional group, and educational level. These findings can be used as a quantitative foundation for the development of an objective measure for individual health status, for grouping health indicators, for conducting demographic factor adjustments during data analysis, for designing customized behavioral intervention studies based on demographic factors, or for health policy-making or program development.
- 8 September 2025
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 11 (1) , e65616
Open AccessHealth Indicators as Measures of Individual Health Status, Their Perceived Importance, and Associated Factors: Cross-Sectional Observational Study
Background: Health indicators can facilitate the assessment of individual and population health status and are valuable in health care and public health settings. However, it is challenging to collect all measures at once. There is no single, objective, comprehensive, accurate, easy-to-use measure for individual health status yet, and we aim to develop one. We identified 29 health indicators via literature review and ranked their importance through public ratings to start the effort. Objective: This study aims to explore the effects of 4 demographic variables (age, sex, professional group, and educational level) on the importance ratings of the 29 indicators. Methods: This was a cross-sectional study. Online surveys were administered on 2 US college campuses and through ResearchMatch, an online platform specialized in finding clinical research participants. Only individuals 18 years or older were considered for inclusion as respondents. A 4-way multivariate analysis of variance (MANOVA) with post hoc testing was conducted to determine the effects of 4 demographic factors on the 29 health indicators. Descriptive statistics and bivariate correlation analysis were reported, along with the results of MANOVA with post hoc testing. Results: The study included 1153 participants from the United States of America with 1144 complete responses. Our study found significant correlations among the 29 health indicators. Age, education, sex, and professional groups showed correlations with multiple health indicators. Correlation analysis indicated that age was correlated with 16 of the 29 health indicators, followed by education (9 indicators), sex (8 indicators), and professional group (7 indicators). MANOVA modeling revealed that age (partial eta squared=0.058; P<.001), sex (partial eta squared=0.05; P<.001), professional group (partial eta squared=0.049; P<.001), and educational levels (partial eta squared=0.047; P<.001), as well as the interactions between sex and professional group (partial eta squared=0.044; P<.001) and sex and age (partial eta squared=0.041; P<.001), showed significant effects on the combination of the 29 health indicators. In general, female participants provided significantly higher ratings on 10 health indicators than male participants (P<.05), whereas older participants provided significantly higher ratings on 20 health indicators than younger participants (P<.05). Conclusions: Age emerged as a critical factor influencing the ratings of the 29 health indicators and showed the largest effect size along with sex, professional group, and educational level. These findings can be used as a quantitative foundation for the development of an objective measure for individual health status, for grouping health indicators, for conducting demographic factor adjustments during data analysis, for designing customized behavioral intervention studies based on demographic factors, or for health policy-making or program development.
- Open Access
- 8 March 2025
- Published by Springer Nature in Education and Information Technologies
- Vol. 30 (12) , 17191-17206
Strengthening teachers’ STEM preparedness through a technology integration online course
The importance of technology education during teacher preparation and in-service professional development is paramount as it faces the challenge of adequately equipping teachers with sufficient level of STEM preparedness so they would be able to educate our next generation of students effectively in the subject areas of science, technology, engineering, and mathematics. In this quantitative survey study, 59 in-service teachers enrolled in an online summer technology integration course completed a pre and post survey. Finding of the study revealed that after course-taking, no gender difference was found and participating teachers’ perceived value of implementing STEM education for K-3 grades increased, teachers’ self-efficacy on teaching STEM courses in K-3 grades improved, and teachers’ STEM pedagogical knowledge was strengthened. Overall, these teachers’ confidence in teaching STEM areas trended upward after taking the online course, rendering them more STEM preparedness in future teaching of these subject areas. Implication of the study included the need for implementing early STEM education in K-3 grades and the continuing necessity to upholster teachers’ STEM preparedness through venues of in-service professional development.
- 8 March 2025
- Published by Springer Nature in Education and Information Technologies
- Vol. 30 (12) , 17191-17206
Open AccessStrengthening teachers’ STEM preparedness through a technology integration online course
The importance of technology education during teacher preparation and in-service professional development is paramount as it faces the challenge of adequately equipping teachers with sufficient level of STEM preparedness so they would be able to educate our next generation of students effectively in the subject areas of science, technology, engineering, and mathematics. In this quantitative survey study, 59 in-service teachers enrolled in an online summer technology integration course completed a pre and post survey. Finding of the study revealed that after course-taking, no gender difference was found and participating teachers’ perceived value of implementing STEM education for K-3 grades increased, teachers’ self-efficacy on teaching STEM courses in K-3 grades improved, and teachers’ STEM pedagogical knowledge was strengthened. Overall, these teachers’ confidence in teaching STEM areas trended upward after taking the online course, rendering them more STEM preparedness in future teaching of these subject areas. Implication of the study included the need for implementing early STEM education in K-3 grades and the continuing necessity to upholster teachers’ STEM preparedness through venues of in-service professional development.
- Open Access
The quality of data-driven hypotheses generated by inexperienced clinical researchers: A case study
Objectives We invited inexperienced clinical researchers to analyze coded health datasets and develop hypotheses. We recorded and analyzed their hypothesis generation process. All the hypotheses generated in the process were rated by the same group of seven experts by using the same metrics. This case study examines the higher quality (i.e., higher ratings) and lower quality of hypotheses and participants who generated them. We characterized the contextual factors associated with the quality of hypotheses. Methods All participants (i.e., clinical researchers) completed a 2-hour study session to analyze data and generate scientific hypotheses using the think-aloud method. Participants’ screen activity and audio were recorded and transcribed. These transcriptions were used to measure the time used to generate each hypothesis and to code cognitive events (i.e., cognitive activities used when generating hypotheses, for example, “Seeking for Connection” describes an attempt to draw connections between data points). The hypothesis ratings by the expert panel were used as the quality of the hypotheses during the analysis. We analyzed the factors associated with (1) the five highest and (2) five lowest rated hypotheses and (3) the participants who generated them, including the number of hypotheses per participant, the validity of those hypotheses, the number of cognitive events used for each hypothesis, as well as the participant’s research experience and basic demographics. Results Participants who generated the five highest-rated hypotheses used similar lengths of time (difference 3:03), whereas those who generated the five lowest-rated hypotheses used more varying lengths of time (difference 7:13). Participants who generated the five highest-rated hypotheses also utilized slightly fewer cognitive events on average compared to the five lowest-rated hypotheses (4 per hypothesis vs. 4.8 per hypothesis). When we examine the participants (who generated the five highest and five lowest hypotheses) and their total hypotheses generated during the 2-hour study sessions, the participants with the five highest-rated hypotheses again had a shorter range of time per hypothesis on average (0:03:34 vs. 0:07:17). They (with the five highest ratings) used fewer cognitive events per hypothesis (3.498 vs. 4.626). They (with the five highest ratings) also had a higher percentage of valid rate (75.51% vs. 63.63%) and generally had more experience with clinical research. Conclusion The quality of the hypotheses was shown to be associated with the time taken to generate them, where too long or too short time to generate hypotheses appears to be negatively associated with the hypotheses’ quality ratings. Also, having more experience seems to positively correlate with higher ratings of hypotheses and higher valid rates. Validity is a quality dimension used by the expert panel during rating. However, we acknowledge that our results are anecdotal. The effect may not be simply linear, and future research is necessary. These results underscore the multi-factor nature of hypothesis generation.
Open AccessThe quality of data-driven hypotheses generated by inexperienced clinical researchers: A case study
Objectives We invited inexperienced clinical researchers to analyze coded health datasets and develop hypotheses. We recorded and analyzed their hypothesis generation process. All the hypotheses generated in the process were rated by the same group of seven experts by using the same metrics. This case study examines the higher quality (i.e., higher ratings) and lower quality of hypotheses and participants who generated them. We characterized the contextual factors associated with the quality of hypotheses. Methods All participants (i.e., clinical researchers) completed a 2-hour study session to analyze data and generate scientific hypotheses using the think-aloud method. Participants’ screen activity and audio were recorded and transcribed. These transcriptions were used to measure the time used to generate each hypothesis and to code cognitive events (i.e., cognitive activities used when generating hypotheses, for example, “Seeking for Connection” describes an attempt to draw connections between data points). The hypothesis ratings by the expert panel were used as the quality of the hypotheses during the analysis. We analyzed the factors associated with (1) the five highest and (2) five lowest rated hypotheses and (3) the participants who generated them, including the number of hypotheses per participant, the validity of those hypotheses, the number of cognitive events used for each hypothesis, as well as the participant’s research experience and basic demographics. Results Participants who generated the five highest-rated hypotheses used similar lengths of time (difference 3:03), whereas those who generated the five lowest-rated hypotheses used more varying lengths of time (difference 7:13). Participants who generated the five highest-rated hypotheses also utilized slightly fewer cognitive events on average compared to the five lowest-rated hypotheses (4 per hypothesis vs. 4.8 per hypothesis). When we examine the participants (who generated the five highest and five lowest hypotheses) and their total hypotheses generated during the 2-hour study sessions, the participants with the five highest-rated hypotheses again had a shorter range of time per hypothesis on average (0:03:34 vs. 0:07:17). They (with the five highest ratings) used fewer cognitive events per hypothesis (3.498 vs. 4.626). They (with the five highest ratings) also had a higher percentage of valid rate (75.51% vs. 63.63%) and generally had more experience with clinical research. Conclusion The quality of the hypotheses was shown to be associated with the time taken to generate them, where too long or too short time to generate hypotheses appears to be negatively associated with the hypotheses’ quality ratings. Also, having more experience seems to positively correlate with higher ratings of hypotheses and higher valid rates. Validity is a quality dimension used by the expert panel during rating. However, we acknowledge that our results are anecdotal. The effect may not be simply linear, and future research is necessary. These results underscore the multi-factor nature of hypothesis generation.
- Open Access
- 4 January 2024
- Published by Cambridge University Press (CUP) in Journal of Clinical and Translational Science
- Vol. 8 (1) , e13
Data-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools
Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a visual interactive analysis tool for filtering and summarizing large datasets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into “experienced” and “inexperienced” groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 s versus 379 s, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.
- 4 January 2024
- Published by Cambridge University Press (CUP) in Journal of Clinical and Translational Science
- Vol. 8 (1) , e13
Open AccessData-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools
Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a visual interactive analysis tool for filtering and summarizing large datasets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into “experienced” and “inexperienced” groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 s versus 379 s, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.
- Open Access
- 25 December 2023
- Published by SAGE Publications in Methodological Innovations
- Vol. 17 (1) , 41-49
Mixed methods integration strategies used in education: A systematic review
Mixed methods research (MMR) has been widely adopted in a plethora of disciplines. Integration is the pressing issue regarding the legitimation, the added value, and the quality of using MMR, though inadequate literature has discussed effective strategies used in the field of education, including school psychology, counseling, and teacher education. This study reviewed 119 recently published MMR articles in education using a four-dimension codebook with the goal to explore generic integration strategies and innovative strategies used by educational researchers in practice. As a result, three most commonly used generic integration strategies were identified, including (1) using a good mixed methods (MM) research question to guide research design, (2) using appropriate MM sampling strategy to obtain good data for achieving integration, and (3) using multiple MM data mixing strategies to facilitate integration. Moreover, five creative integration strategies were found at the method level: (1) using an innovative survey to collect both qualitative and quantitative data, (2) using visual support to collect data, (3) using high-tech methods to facilitate data collection, (4) using data visualization in mixing, and (5) quantitizing categorized QUAL data. This review summarizes and analyzes the effective integration strategies commonly used at the research design level and at the method level. It also provides valuable recommendations for educational researchers to explore creative strategies to achieve efficient integration when they conduct mixed methods research.
- 25 December 2023
- Published by SAGE Publications in Methodological Innovations
- Vol. 17 (1) , 41-49
Open AccessMixed methods integration strategies used in education: A systematic review
Mixed methods research (MMR) has been widely adopted in a plethora of disciplines. Integration is the pressing issue regarding the legitimation, the added value, and the quality of using MMR, though inadequate literature has discussed effective strategies used in the field of education, including school psychology, counseling, and teacher education. This study reviewed 119 recently published MMR articles in education using a four-dimension codebook with the goal to explore generic integration strategies and innovative strategies used by educational researchers in practice. As a result, three most commonly used generic integration strategies were identified, including (1) using a good mixed methods (MM) research question to guide research design, (2) using appropriate MM sampling strategy to obtain good data for achieving integration, and (3) using multiple MM data mixing strategies to facilitate integration. Moreover, five creative integration strategies were found at the method level: (1) using an innovative survey to collect both qualitative and quantitative data, (2) using visual support to collect data, (3) using high-tech methods to facilitate data collection, (4) using data visualization in mixing, and (5) quantitizing categorized QUAL data. This review summarizes and analyzes the effective integration strategies commonly used at the research design level and at the method level. It also provides valuable recommendations for educational researchers to explore creative strategies to achieve efficient integration when they conduct mixed methods research.
- Open Access
How do clinical researchers generate data-driven scientific hypotheses? Cognitive events using think-aloud protocol
Objectives This study aims to identify the cognitive events related to information use (e.g., “Analyze data”, “Seek connection”) during hypothesis generation among clinical researchers. Specifically, we describe hypothesis generation using cognitive event counts and compare them between groups. Methods The participants used the same datasets, followed the same scripts, used VIADS (a visual interactive analysis tool for filtering and summarizing large data sets coded with hierarchical terminologies) or other analytical tools (as control) to analyze the datasets, and came up with hypotheses while following the think-aloud protocol. Their screen activities and audio were recorded and then transcribed and coded for cognitive events. Results The VIADS group exhibited the lowest mean number of cognitive events per hypothesis and the smallest standard deviation. The experienced clinical researchers had approximately 10% more valid hypotheses than the inexperienced group. The VIADS users among the inexperienced clinical researchers exhibit a similar trend as the experienced clinical researchers in terms of the number of cognitive events and their respective percentages out of all the cognitive events. The highest percentages of cognitive events in hypothesis generation were “Using analysis results” (30%) and “Seeking connections” (23%). Conclusion VIADS helped inexperienced clinical researchers use fewer cognitive events to generate hypotheses than the control group. This suggests that VIADS may guide participants to be more structured during hypothesis generation compared with the control group. The results provide evidence to explain the shorter average time needed by the VIADS group in generating each hypothesis. What is already known on this topic how hypotheses were generated when solving a puzzle or a medical case and the reasoning differences between experienced and inexperienced physicians. What this study adds Our study facilitates our understanding of how clinical researchers generate hypotheses with secondary data analytical tools and datasets, the cognitive events used during hypothesis generation in an open discovery context. How this study might affect research, practice, or policy Our work suggests secondary data analytical tools and visualization may facilitate hypothesis generation among inexperienced clinical researchers regarding the number of hypotheses, average time, and the cognitive events needed per hypothesis.
Open AccessHow do clinical researchers generate data-driven scientific hypotheses? Cognitive events using think-aloud protocol
Objectives This study aims to identify the cognitive events related to information use (e.g., “Analyze data”, “Seek connection”) during hypothesis generation among clinical researchers. Specifically, we describe hypothesis generation using cognitive event counts and compare them between groups. Methods The participants used the same datasets, followed the same scripts, used VIADS (a visual interactive analysis tool for filtering and summarizing large data sets coded with hierarchical terminologies) or other analytical tools (as control) to analyze the datasets, and came up with hypotheses while following the think-aloud protocol. Their screen activities and audio were recorded and then transcribed and coded for cognitive events. Results The VIADS group exhibited the lowest mean number of cognitive events per hypothesis and the smallest standard deviation. The experienced clinical researchers had approximately 10% more valid hypotheses than the inexperienced group. The VIADS users among the inexperienced clinical researchers exhibit a similar trend as the experienced clinical researchers in terms of the number of cognitive events and their respective percentages out of all the cognitive events. The highest percentages of cognitive events in hypothesis generation were “Using analysis results” (30%) and “Seeking connections” (23%). Conclusion VIADS helped inexperienced clinical researchers use fewer cognitive events to generate hypotheses than the control group. This suggests that VIADS may guide participants to be more structured during hypothesis generation compared with the control group. The results provide evidence to explain the shorter average time needed by the VIADS group in generating each hypothesis. What is already known on this topic how hypotheses were generated when solving a puzzle or a medical case and the reasoning differences between experienced and inexperienced physicians. What this study adds Our study facilitates our understanding of how clinical researchers generate hypotheses with secondary data analytical tools and datasets, the cognitive events used during hypothesis generation in an open discovery context. How this study might affect research, practice, or policy Our work suggests secondary data analytical tools and visualization may facilitate hypothesis generation among inexperienced clinical researchers regarding the number of hypotheses, average time, and the cognitive events needed per hypothesis.
- Open Access
Data-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools
Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a v isual interactive a nalysis tool for filtering and summarizing large d ata s ets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into “experienced” and “inexperienced” groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 seconds versus 379 seconds, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.
Open AccessData-driven hypothesis generation among inexperienced clinical researchers: A comparison of secondary data analyses with visualization (VIADS) and other tools
Objectives: To compare how clinical researchers generate data-driven hypotheses with a visual interactive analytic tool (VIADS, a v isual interactive a nalysis tool for filtering and summarizing large d ata s ets coded with hierarchical terminologies) or other tools. Methods: We recruited clinical researchers and separated them into “experienced” and “inexperienced” groups. Participants were randomly assigned to a VIADS or control group within the groups. Each participant conducted a remote 2-hour study session for hypothesis generation with the same study facilitator on the same datasets by following a think-aloud protocol. Screen activities and audio were recorded, transcribed, coded, and analyzed. Hypotheses were evaluated by seven experts on their validity, significance, and feasibility. We conducted multilevel random effect modeling for statistical tests. Results: Eighteen participants generated 227 hypotheses, of which 147 (65%) were valid. The VIADS and control groups generated a similar number of hypotheses. The VIADS group took a significantly shorter time to generate one hypothesis (e.g., among inexperienced clinical researchers, 258 seconds versus 379 seconds, p = 0.046, power = 0.437, ICC = 0.15). The VIADS group received significantly lower ratings than the control group on feasibility and the combination rating of validity, significance, and feasibility. Conclusion: The role of VIADS in hypothesis generation seems inconclusive. The VIADS group took a significantly shorter time to generate each hypothesis. However, the combined validity, significance, and feasibility ratings of their hypotheses were significantly lower. Further characterization of hypotheses, including specifics on how they might be improved, could guide future tool development.
- Open Access
- 27 April 2023
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 10 (1) , e44644
A Visual Analytic Tool (VIADS) to Assist the Hypothesis Generation Process in Clinical Research: Mixed Methods Usability Study
Background: Visualization can be a powerful tool to comprehend data sets, especially when they can be represented via hierarchical structures. Enhanced comprehension can facilitate the development of scientific hypotheses. However, the inclusion of excessive data can make visualizations overwhelming. Objective: We developed a visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS). In this study, we evaluated the usability of VIADS for visualizing data sets of patient diagnoses and procedures coded in the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM). Methods: We used mixed methods in the study. A group of 12 clinical researchers participated in the generation of data-driven hypotheses using the same data sets and time frame (a 1-hour training session and a 2-hour study session) utilizing VIADS via the think-aloud protocol. The audio and screen activities were recorded remotely. A modified version of the System Usability Scale (SUS) survey and a brief survey with open-ended questions were administered after the study to assess the usability of VIADS and verify their intense usage experience with VIADS. Results: The range of SUS scores was 37.5 to 87.5. The mean SUS score for VIADS was 71.88 (out of a possible 100, SD 14.62), and the median SUS was 75. The participants unanimously agreed that VIADS offers new perspectives on data sets (12/12, 100%), while 75% (8/12) agreed that VIADS facilitates understanding, presentation, and interpretation of underlying data sets. The comments on the utility of VIADS were positive and aligned well with the design objectives of VIADS. The answers to the open-ended questions in the modified SUS provided specific suggestions regarding potential improvements for VIADS, and the identified problems with usability were used to update the tool. Conclusions: This usability study demonstrates that VIADS is a usable tool for analyzing secondary data sets with good average usability, good SUS score, and favorable utility. Currently, VIADS accepts data sets with hierarchical codes and their corresponding frequencies. Consequently, only specific types of use cases are supported by the analytical results. Participants agreed, however, that VIADS provides new perspectives on data sets and is relatively easy to use. The VIADS functionalities most appreciated by participants were the ability to filter, summarize, compare, and visualize data. International Registered Report Identifier (IRRID): RR2-10.2196/39414
- 27 April 2023
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 10 (1) , e44644
Open AccessA Visual Analytic Tool (VIADS) to Assist the Hypothesis Generation Process in Clinical Research: Mixed Methods Usability Study
Background: Visualization can be a powerful tool to comprehend data sets, especially when they can be represented via hierarchical structures. Enhanced comprehension can facilitate the development of scientific hypotheses. However, the inclusion of excessive data can make visualizations overwhelming. Objective: We developed a visual interactive analytic tool for filtering and summarizing large health data sets coded with hierarchical terminologies (VIADS). In this study, we evaluated the usability of VIADS for visualizing data sets of patient diagnoses and procedures coded in the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM). Methods: We used mixed methods in the study. A group of 12 clinical researchers participated in the generation of data-driven hypotheses using the same data sets and time frame (a 1-hour training session and a 2-hour study session) utilizing VIADS via the think-aloud protocol. The audio and screen activities were recorded remotely. A modified version of the System Usability Scale (SUS) survey and a brief survey with open-ended questions were administered after the study to assess the usability of VIADS and verify their intense usage experience with VIADS. Results: The range of SUS scores was 37.5 to 87.5. The mean SUS score for VIADS was 71.88 (out of a possible 100, SD 14.62), and the median SUS was 75. The participants unanimously agreed that VIADS offers new perspectives on data sets (12/12, 100%), while 75% (8/12) agreed that VIADS facilitates understanding, presentation, and interpretation of underlying data sets. The comments on the utility of VIADS were positive and aligned well with the design objectives of VIADS. The answers to the open-ended questions in the modified SUS provided specific suggestions regarding potential improvements for VIADS, and the identified problems with usability were used to update the tool. Conclusions: This usability study demonstrates that VIADS is a usable tool for analyzing secondary data sets with good average usability, good SUS score, and favorable utility. Currently, VIADS accepts data sets with hierarchical codes and their corresponding frequencies. Consequently, only specific types of use cases are supported by the analytical results. Participants agreed, however, that VIADS provides new perspectives on data sets and is relatively easy to use. The VIADS functionalities most appreciated by participants were the ability to filter, summarize, compare, and visualize data. International Registered Report Identifier (IRRID): RR2-10.2196/39414
- 18 March 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 28 (10) , 12903-12918
The effects of a gamified online course on pre-service teachers’ confidence, intention, and motivation in integrating technology into teaching
Teachers are gatekeepers of technology integration in the classroom. Pre-service teachers’ attitudes, confidence, and competence in exploring emerging technologies play a critical role in teachers’ adoption of technology in teaching. This study examined the effects of a gamified technology course on pre-service teachers’ confidence, intention, and motivation in integrating technology into teaching. A sample of pre-service teachers (N = 84) at a Midwestern university in the United States in the academic year of 2021–22 was surveyed. The regression results revealed that the gamified course significantly and positively influenced pre-service teachers’ confidence in using technology in education, intention to adopt gamification, and motivation to explore more emerging technologies for teaching, after controlling for gender. In contrast, gender did not affect pre-service teachers’ confidence, intention, and motivation in integrating technology into instruction after controlling for the gamified course effects. Suggestions on gamifying course design while leveraging quest-based learning and active learning principles to enhance student positive attitudes and motivation to explore technology integration are discussed.
- 18 March 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 28 (10) , 12903-12918
The effects of a gamified online course on pre-service teachers’ confidence, intention, and motivation in integrating technology into teaching
Teachers are gatekeepers of technology integration in the classroom. Pre-service teachers’ attitudes, confidence, and competence in exploring emerging technologies play a critical role in teachers’ adoption of technology in teaching. This study examined the effects of a gamified technology course on pre-service teachers’ confidence, intention, and motivation in integrating technology into teaching. A sample of pre-service teachers (N = 84) at a Midwestern university in the United States in the academic year of 2021–22 was surveyed. The regression results revealed that the gamified course significantly and positively influenced pre-service teachers’ confidence in using technology in education, intention to adopt gamification, and motivation to explore more emerging technologies for teaching, after controlling for gender. In contrast, gender did not affect pre-service teachers’ confidence, intention, and motivation in integrating technology into instruction after controlling for the gamified course effects. Suggestions on gamifying course design while leveraging quest-based learning and active learning principles to enhance student positive attitudes and motivation to explore technology integration are discussed.
- 1 January 2023
- Published by American Educational Research Association (AERA)
Integration Considerations in the Data Collection Phase of Convergent Designs
AERA Online Paper Repository Viewer
- 1 January 2023
- Published by American Educational Research Association (AERA)
Integration Considerations in the Data Collection Phase of Convergent Designs
AERA Online Paper Repository Viewer