Katrina Crotts Roohr
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Katrina Crotts Roohr has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
Ou Lydia Liu
Educational Testing Service University of Iowa
6 shared publicationsHuili Liu
Insight Policy Research, Inc
2 shared publicationsCalifornia State University Channel Islands
1 shared publicationChristopher Kitchen
Educational Testing Service Princeton NJ
1 shared publicationDaniel Fishtein
Educational Testing Service University of Iowa
1 shared publicationDessi Kirova
Educational Testing Service, Princeton, NJ, USA
1 shared publication
Latest Publications
- 1 January 2024
- Published by Elsevier in Thinking Skills and Creativity
- Vol. 51, 101460
Exploring approaches for developing and evaluating workplace critical thinking skills
- 1 January 2024
- Published by Elsevier in Thinking Skills and Creativity
- Vol. 51, 101460
Exploring approaches for developing and evaluating workplace critical thinking skills
- Open Access
- 17 January 2022
- Published by Wiley in ETS Research Report Series
- Vol. 2022 (1) , 1-27
Exploring GRE ® and TOEFL ® Score Profiles of International Students Intending to Pursue a Graduate Degree in the United States
- 17 January 2022
- Published by Wiley in ETS Research Report Series
- Vol. 2022 (1) , 1-27
Open AccessExploring GRE ® and TOEFL ® Score Profiles of International Students Intending to Pursue a Graduate Degree in the United States
- 24 May 2021
- Published by Wiley in Educational Measurement: Issues and Practice
- Vol. 41 (1) , 64-79
Are Fourth‐Year College Students Better Critical Thinkers than Their First‐Year Peers? Not So Much, and College Major and Ethnicity Matter
- 24 May 2021
- Published by Wiley in Educational Measurement: Issues and Practice
- Vol. 41 (1) , 64-79
Are Fourth‐Year College Students Better Critical Thinkers than Their First‐Year Peers? Not So Much, and College Major and Ethnicity Matter
- 5 June 2020
- Published by SAGE Publications in Community College Review
- Vol. 48 (3) , 330-351
Exploring Critical Thinking as an Outcome for Students Enrolled in Community Colleges
Objective: Using data from HEIghten® Critical Thinking, a student learning outcomes assessment, the purpose of this study was to evaluate what variables are associated with higher critical thinking performance for students enrolled in various community college programs and to evaluate performance differences across demographic and college-level subgroups as well as student perceptions. Method: With data from 1,307 students enrolled across 34 U.S. and Canadian higher education institutions (72% enrolled in 2-year institutions), we utilized a hierarchical regression to identify variables associated with critical thinking performance. Critical thinking performance differences were evaluated using analyses of variance (ANOVAs) and t-tests across student demographic and college experience subgroups and across student perceptions. Results: Results of this study showed (a) consistent significant predictors associated with higher critical thinking performance; (b) a positive relationship between critical thinking performance and the frequency of using critical thinking in college courses; (c) significant, but relatively small performance differences across demographic and college experience subgroups; and (d) positive relationships between student perceptions and critical thinking performance. Conclusion: This study added to the limited literature evaluating critical thinking skills for community college students. Overall, results suggest that institutions should focus attention to the frequency at which students are using critical thinking throughout their courses, which could increase student performance in this particular area, especially if critical thinking is an explicit outcome within the course. Results also suggested the need to emphasize critical thinking skills more across various community college programs and across non-STEM-focused programs. Suggestions for future research are discussed.
- 5 June 2020
- Published by SAGE Publications in Community College Review
- Vol. 48 (3) , 330-351
Exploring Critical Thinking as an Outcome for Students Enrolled in Community Colleges
Objective: Using data from HEIghten® Critical Thinking, a student learning outcomes assessment, the purpose of this study was to evaluate what variables are associated with higher critical thinking performance for students enrolled in various community college programs and to evaluate performance differences across demographic and college-level subgroups as well as student perceptions. Method: With data from 1,307 students enrolled across 34 U.S. and Canadian higher education institutions (72% enrolled in 2-year institutions), we utilized a hierarchical regression to identify variables associated with critical thinking performance. Critical thinking performance differences were evaluated using analyses of variance (ANOVAs) and t-tests across student demographic and college experience subgroups and across student perceptions. Results: Results of this study showed (a) consistent significant predictors associated with higher critical thinking performance; (b) a positive relationship between critical thinking performance and the frequency of using critical thinking in college courses; (c) significant, but relatively small performance differences across demographic and college experience subgroups; and (d) positive relationships between student perceptions and critical thinking performance. Conclusion: This study added to the limited literature evaluating critical thinking skills for community college students. Overall, results suggest that institutions should focus attention to the frequency at which students are using critical thinking throughout their courses, which could increase student performance in this particular area, especially if critical thinking is an explicit outcome within the course. Results also suggested the need to emphasize critical thinking skills more across various community college programs and across non-STEM-focused programs. Suggestions for future research are discussed.
- Open Access
- 13 May 2019
- Published by Wiley in ETS Research Report Series
- Vol. 2019 (1) , 1-28
A Proof‐of‐Concept Study on Scoring Oral Presentation Videos in Higher Education
- 13 May 2019
- Published by Wiley in ETS Research Report Series
- Vol. 2019 (1) , 1-28
Open AccessA Proof‐of‐Concept Study on Scoring Oral Presentation Videos in Higher Education
- 29 December 2018
- Published by Taylor & Francis in Assessment & Evaluation in Higher Education
- Vol. 44 (6) , 946-960
A multi-level modeling approach to investigating students’ critical thinking at higher education institutions
Twenty-first century and higher-learning skills such as critical thinking are highly desired for new college graduates entering the workplace, especially with rapid changing technology and a more globalized economy. As a result, the importance of critical thinking development at higher education institutions has increased. The purpose of this study was to examine the effect of student and institutional variables on the difference in critical thinking scores between first-year and third/fourth-year students at higher education institutions. We examined the extent to which institutional variables moderate the relationship between student variables and the critical thinking score difference. We used a multi-level modeling approach to account for the clustering of students in institutions. Results of this study showed that: (a) institutional variability accounted for 15% of the variance in estimated critical thinking scores, (b) third/fourth-year students had higher critical thinking scores as compared to their first-year peers even when controlling for college admissions score, and (c) in the final model, the main effects of college admission scores, student-faculty ratio, and percent Black/African American were statistically significant; however, retention was the only significant moderator of the relationship between critical thinking scores and class level. Implications and future research are discussed.
- 29 December 2018
- Published by Taylor & Francis in Assessment & Evaluation in Higher Education
- Vol. 44 (6) , 946-960
A multi-level modeling approach to investigating students’ critical thinking at higher education institutions
Twenty-first century and higher-learning skills such as critical thinking are highly desired for new college graduates entering the workplace, especially with rapid changing technology and a more globalized economy. As a result, the importance of critical thinking development at higher education institutions has increased. The purpose of this study was to examine the effect of student and institutional variables on the difference in critical thinking scores between first-year and third/fourth-year students at higher education institutions. We examined the extent to which institutional variables moderate the relationship between student variables and the critical thinking score difference. We used a multi-level modeling approach to account for the clustering of students in institutions. Results of this study showed that: (a) institutional variability accounted for 15% of the variance in estimated critical thinking scores, (b) third/fourth-year students had higher critical thinking scores as compared to their first-year peers even when controlling for college admissions score, and (c) in the final model, the main effects of college admission scores, student-faculty ratio, and percent Black/African American were statistically significant; however, retention was the only significant moderator of the relationship between critical thinking scores and class level. Implications and future research are discussed.
- Open Access
- 2 July 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-18
Assessing Civic and Intercultural Competency in Higher Education: The ETS HEIghten® Approach
- 2 July 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-18
Open AccessAssessing Civic and Intercultural Competency in Higher Education: The ETS HEIghten® Approach
- 28 February 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-21
A Preliminary Investigation of the Factors Related to the Design and Scoring of Video‐Based Oral Communication Performance Tasks in Higher Education
- 28 February 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-21
A Preliminary Investigation of the Factors Related to the Design and Scoring of Video‐Based Oral Communication Performance Tasks in Higher Education
- Open Access
- 1 July 2017
- Published by University of South Florida Libraries in Numeracy
- Vol. 10 (2) , 3
Preliminary Evaluation of the Psychometric Quality of HEIghtenTM Quantitative Literacy
Quantitative literacy has been identified as an important student learning outcome (SLO) by both the higher education and workforce communities. This paper aims to provide preliminary evidence of the psychometric quality of the pilot forms for HEIghten quantitative literacy, a next-generation SLO assessment for students in higher education. We evaluated the psychometric quality of the test items (e.g., item analyses), individual- and group-level reliability, the relationship with student performance and related variables (e.g., grade point average) as well as student perceptions, and differences across college-related and demographic subgroups. Our study used data from a pilot test administered to over 1,500 students at 23 higher education institutions in the United States. Results showed that (a) overall, items were functioning well, but a small portion of items should be dropped due to unsatisfactory performance; (b) correlations across sub-areas of the assessment were very high indicating that the assessment may be unidimensional; (c) reliability estimates similar to existing SLO assessments were found at both individual and group levels; (d) assessment scores correlated positively with high school and college GPA, number of math college courses, self-rated quantitative literacy skills, and college admissions scores; (e) students had positive perceptions about the assessment; and (f) performance differences were found across institution type, college majors, gender, racial/ethnic groups, and language groups, but not across credit-hour categories. Implications for operational test development and understanding of quantitative literacy performance are discussed.\u
- 1 July 2017
- Published by University of South Florida Libraries in Numeracy
- Vol. 10 (2) , 3
Open AccessPreliminary Evaluation of the Psychometric Quality of HEIghtenTM Quantitative Literacy
Quantitative literacy has been identified as an important student learning outcome (SLO) by both the higher education and workforce communities. This paper aims to provide preliminary evidence of the psychometric quality of the pilot forms for HEIghten quantitative literacy, a next-generation SLO assessment for students in higher education. We evaluated the psychometric quality of the test items (e.g., item analyses), individual- and group-level reliability, the relationship with student performance and related variables (e.g., grade point average) as well as student perceptions, and differences across college-related and demographic subgroups. Our study used data from a pilot test administered to over 1,500 students at 23 higher education institutions in the United States. Results showed that (a) overall, items were functioning well, but a small portion of items should be dropped due to unsatisfactory performance; (b) correlations across sub-areas of the assessment were very high indicating that the assessment may be unidimensional; (c) reliability estimates similar to existing SLO assessments were found at both individual and group levels; (d) assessment scores correlated positively with high school and college GPA, number of math college courses, self-rated quantitative literacy skills, and college admissions scores; (e) students had positive perceptions about the assessment; and (f) performance differences were found across institution type, college majors, gender, racial/ethnic groups, and language groups, but not across credit-hour categories. Implications for operational test development and understanding of quantitative literacy performance are discussed.\u
- 1 February 2017
- Published by Wiley in ETS Research Report Series
- Vol. 2017 (1) , 1-14
Investigating Validity Evidence for theETS®Proficiency Profile
- 1 February 2017
- Published by Wiley in ETS Research Report Series
- Vol. 2017 (1) , 1-14
Investigating Validity Evidence for theETS®Proficiency Profile