Ying Cui
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Ying Cui has a total of 40 co-authors. Here are the top co-authors by number of shared publications:
- Surina He
University of Alberta
4 shared publications - Okan Bulut
Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, AB T6G 2G5, Canada
3 shared publications - Carrie Demmans Epp
University of Alberta
2 shared publications - Fu Chen
Faculty of Education University of Macau Macau China
2 shared publications - Jacqueline P. Leighton
University of Alberta, Edmonton, AB, Canada
2 shared publications Johnson Li
University of Manitoba, Winnipeg, Canada
2 shared publications
Latest Publications
- Open Access
- 15 December 2025
- Published by SAGE Publications in Journal of Pacific Rim Psychology
- Vol. 19
Evaluating the Critical Thinking of Large Language Models: Insights and Limitations
Integrating artificial intelligence, particularly large language models, in academic writing has significantly enhanced productivity and content quality. However, effective academic writing fundamentally relies on critical thinking, which is essential for constructing persuasive arguments and identifying flaws. This study assessed the critical thinking abilities of GPT-3.5, GPT-4, LLaMA-4, and DeepSeek-R1 by using two primary tests—the multiple-choice Thinking Skills Assessment and the open-ended Ennis–Weir Critical Thinking Essay Test—and comparing their performance with 194 undergraduate students in China. The results showed that while LLaMA-4 and DeepSeek-R1 consistently outperformed students on both assessments, GPT-4 excelled only in the Thinking Skills Assessment and GPT-3.5 underperformed across both tests. These findings indicate that current large language models can excel not only in tasks targeting the specific cognitive skills of critical thinking but also in applying various skills in real-world contexts. However, detailed analysis revealed the tendency of large language models to miss key details, overlook multiple argumentative flaws, and show weakness in tasks demanding abstract reasoning, underscoring the need for human oversight and guidance when using artificial intelligence in academic writing. These results offer valuable insights for optimizing human–AI collaboration in academic writing.
- 15 December 2025
- Published by SAGE Publications in Journal of Pacific Rim Psychology
- Vol. 19
Open AccessEvaluating the Critical Thinking of Large Language Models: Insights and Limitations
Integrating artificial intelligence, particularly large language models, in academic writing has significantly enhanced productivity and content quality. However, effective academic writing fundamentally relies on critical thinking, which is essential for constructing persuasive arguments and identifying flaws. This study assessed the critical thinking abilities of GPT-3.5, GPT-4, LLaMA-4, and DeepSeek-R1 by using two primary tests—the multiple-choice Thinking Skills Assessment and the open-ended Ennis–Weir Critical Thinking Essay Test—and comparing their performance with 194 undergraduate students in China. The results showed that while LLaMA-4 and DeepSeek-R1 consistently outperformed students on both assessments, GPT-4 excelled only in the Thinking Skills Assessment and GPT-3.5 underperformed across both tests. These findings indicate that current large language models can excel not only in tasks targeting the specific cognitive skills of critical thinking but also in applying various skills in real-world contexts. However, detailed analysis revealed the tendency of large language models to miss key details, overlook multiple argumentative flaws, and show weakness in tasks demanding abstract reasoning, underscoring the need for human oversight and guidance when using artificial intelligence in academic writing. These results offer valuable insights for optimizing human–AI collaboration in academic writing.
- 26 June 2025
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 34 (3) , 1452-1466
Preschoolers’ initial planning time on problem-solving performance across task difficulties: insights from intelligent tutoring mobile application log data
- 26 June 2025
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 34 (3) , 1452-1466
Preschoolers’ initial planning time on problem-solving performance across task difficulties: insights from intelligent tutoring mobile application log data
- 1 June 2025
- Published by Springer Nature in Canadian Journal of Science, Mathematics and Technology Education
- Vol. 25 (2) , 251-270
Investigating Predictors of Student Performance in STEM Using Educational Data Mining Techniques
- 1 June 2025
- Published by Springer Nature in Canadian Journal of Science, Mathematics and Technology Education
- Vol. 25 (2) , 251-270
Investigating Predictors of Student Performance in STEM Using Educational Data Mining Techniques
- Open Access
- 12 April 2025
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 9 (4) , 99
Predicting College Enrollment for Low-Socioeconomic-Status Students Using Machine Learning Approaches
College enrollment has long been recognized as a critical pathway to better employment prospects and improved economic outcomes. However, the overall enrollment rates have declined in recent years, and students with a lower socioeconomic status (SES) or those from disadvantaged backgrounds remain significantly underrepresented in higher education. To investigate the factors influencing college enrollment among low-SES high school students, this study analyzed data from the High School Longitudinal Study of 2009 (HSLS:09) using five widely used machine learning algorithms. The sample included 5223 ninth-grade students from lower socioeconomic backgrounds (51% female; Mage = 14.59) whose biological parents or stepparents completed a parental questionnaire. The results showed that, among all five classifiers, the random forest algorithm achieved the highest classification accuracy at 67.73%. Additionally, the top three predictors of enrollment in 2-year or 4-year colleges were students’ overall high school GPA, parental educational expectations, and the number of close friends planning to attend a 4-year college. Conversely, the most important predictors of non-enrollment were high school GPA, parental educational expectations, and the number of close friends who had dropped out of high school. These findings advance our understanding of the factors shaping college enrollment for low-SES students and highlight two important factors for intervention: improving students’ academic performance and fostering future-oriented goals among their peers and parents.
- 12 April 2025
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 9 (4) , 99
Open AccessPredicting College Enrollment for Low-Socioeconomic-Status Students Using Machine Learning Approaches
College enrollment has long been recognized as a critical pathway to better employment prospects and improved economic outcomes. However, the overall enrollment rates have declined in recent years, and students with a lower socioeconomic status (SES) or those from disadvantaged backgrounds remain significantly underrepresented in higher education. To investigate the factors influencing college enrollment among low-SES high school students, this study analyzed data from the High School Longitudinal Study of 2009 (HSLS:09) using five widely used machine learning algorithms. The sample included 5223 ninth-grade students from lower socioeconomic backgrounds (51% female; Mage = 14.59) whose biological parents or stepparents completed a parental questionnaire. The results showed that, among all five classifiers, the random forest algorithm achieved the highest classification accuracy at 67.73%. Additionally, the top three predictors of enrollment in 2-year or 4-year colleges were students’ overall high school GPA, parental educational expectations, and the number of close friends planning to attend a 4-year college. Conversely, the most important predictors of non-enrollment were high school GPA, parental educational expectations, and the number of close friends who had dropped out of high school. These findings advance our understanding of the factors shaping college enrollment for low-SES students and highlight two important factors for intervention: improving students’ academic performance and fostering future-oriented goals among their peers and parents.
- 28 February 2025
- Published by Springer Nature in Educational Technology Research and Development
- Vol. 73 (3) , 1811-1834
Advancing higher education students’ assessment experiences with conversational agents
- 28 February 2025
- Published by Springer Nature in Educational Technology Research and Development
- Vol. 73 (3) , 1811-1834
Advancing higher education students’ assessment experiences with conversational agents
- 1 June 2024
- Published by Springer Nature in International Review of Education
- Vol. 70 (3) , 477-496
Predicting teachers’ research reading: A machine learning approach
- 1 June 2024
- Published by Springer Nature in International Review of Education
- Vol. 70 (3) , 477-496
Predicting teachers’ research reading: A machine learning approach
- 1 December 2023
- Published by Elsevier in Computers in Human Behavior
- Vol. 152, 108061
Examining change in students’ self-regulated learning patterns after a formative assessment using process mining techniques
- 1 December 2023
- Published by Elsevier in Computers in Human Behavior
- Vol. 152, 108061
Examining change in students’ self-regulated learning patterns after a formative assessment using process mining techniques
- Top Cited Papers
- 2 January 2023
- Published by Taylor & Francis in Assessment in Education: Principles, Policy & Practice
- Vol. 30 (1) , 76-96
Data literacy assessments: a systematic literature review
With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning.
- 2 January 2023
- Published by Taylor & Francis in Assessment in Education: Principles, Policy & Practice
- Vol. 30 (1) , 76-96
Top Cited PapersData literacy assessments: a systematic literature review
With the exponential increase in the volume of data available in the 21st century, data literacy skills have become vitally important in work places and everyday life. This paper provides a systematic review of available data literacy assessments targeted at different audiences and educational levels. The results can help researchers and practitioners better understand the current state of data literacy assessments in terms of issues related to 1) educational levels and audiences; 2) data literacy definitions and competencies; 3) assessment types and item formats; and 4) reliability and validity evidence. The results from the present review led us to conclude that teaching and assessing data literacy is still an emerging field in education. Therefore, high-quality assessment tools are greatly needed to provide valuable insights for students and instructors to monitor progress as well as facilitate and support teaching and learning.
- Open Access
- 30 June 2022
- Published by MDPI AG in Journal of Intelligence
- Vol. 10 (3) , 38
Examining Humans’ Problem-Solving Styles in Technology-Rich Environments Using Log File Data
This study investigated how one’s problem-solving style impacts his/her problem-solving performance in technology-rich environments. Drawing upon experiential learning theory, we extracted two behavioral indicators (i.e., planning duration for problem solving and human–computer interaction frequency) to model problem-solving styles in technology-rich environments. We employed an existing data set in which 7516 participants responded to 14 technology-based tasks of the Programme for the International Assessment of Adult Competencies (PIAAC) 2012. Clustering analyses revealed three problem-solving styles: Acting indicates a preference for active explorations; Reflecting represents a tendency to observe; and Shirking shows an inclination toward scarce tryouts and few observations. Explanatory item response modeling analyses disclosed that individuals with the Acting style outperformed those with the Reflecting or the Shirking style, and this superiority persisted across tasks with different difficulties.
- 30 June 2022
- Published by MDPI AG in Journal of Intelligence
- Vol. 10 (3) , 38
Open AccessExamining Humans’ Problem-Solving Styles in Technology-Rich Environments Using Log File Data
This study investigated how one’s problem-solving style impacts his/her problem-solving performance in technology-rich environments. Drawing upon experiential learning theory, we extracted two behavioral indicators (i.e., planning duration for problem solving and human–computer interaction frequency) to model problem-solving styles in technology-rich environments. We employed an existing data set in which 7516 participants responded to 14 technology-based tasks of the Programme for the International Assessment of Adult Competencies (PIAAC) 2012. Clustering analyses revealed three problem-solving styles: Acting indicates a preference for active explorations; Reflecting represents a tendency to observe; and Shirking shows an inclination toward scarce tryouts and few observations. Explanatory item response modeling analyses disclosed that individuals with the Acting style outperformed those with the Reflecting or the Shirking style, and this superiority persisted across tasks with different difficulties.
- Open Access
- 9 November 2020
- Published by MDPI AG in Education Sciences
- Vol. 10 (11) , 324
The Effect of Person Misfit on Item Parameter Estimation and Classification Accuracy: A Simulation Study
Often, important decisions regarding accountability and placement of students in performance categories are made on the basis of test scores generated from tests, therefore, it is important to evaluate the validity of the inferences derived from test results. One of the threats to the validity of such inferences is aberrant responding. Several person fit indices were developed to detect aberrant responding on educational and psychological tests. The majority of the person fit literature has been focused on creating and evaluating new indices. The aim of this study was to assess the effect of aberrant responding on the accuracy of estimated item parameters and refining estimations by using person fit statistics by means of simulation. Our results showed that the presence of aberrant response patterns created bias in the both b and a parameters at the item level and affected the classification of students, particularly high-performing students, into performance categories regardless of whether aberrant response patterns were present in the data or were removed. The results differed by test length and the percentage of students with aberrant response patterns. Practical and theoretical implications are discussed.
- 9 November 2020
- Published by MDPI AG in Education Sciences
- Vol. 10 (11) , 324
Open AccessThe Effect of Person Misfit on Item Parameter Estimation and Classification Accuracy: A Simulation Study
Often, important decisions regarding accountability and placement of students in performance categories are made on the basis of test scores generated from tests, therefore, it is important to evaluate the validity of the inferences derived from test results. One of the threats to the validity of such inferences is aberrant responding. Several person fit indices were developed to detect aberrant responding on educational and psychological tests. The majority of the person fit literature has been focused on creating and evaluating new indices. The aim of this study was to assess the effect of aberrant responding on the accuracy of estimated item parameters and refining estimations by using person fit statistics by means of simulation. Our results showed that the presence of aberrant response patterns created bias in the both b and a parameters at the item level and affected the classification of students, particularly high-performing students, into performance categories regardless of whether aberrant response patterns were present in the data or were removed. The results differed by test length and the percentage of students with aberrant response patterns. Practical and theoretical implications are discussed.