What influences students’ abilities to critically evaluate scientific investigations?
Open Access
- 30 August 2022
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (8) , e0273337
Abstract
Critical thinking is the process by which people make decisions about what to trust and what to do. Many undergraduate courses, such as those in biology and physics, include critical thinking as an important learning goal. Assessing critical thinking, however, is non-trivial, with mixed recommendations for how to assess critical thinking as part of instruction. Here we evaluate the efficacy of assessment questions to probe students’ critical thinking skills in the context of biology and physics. We use two research-based standardized critical thinking instruments known as the Biology Lab Inventory of Critical Thinking in Ecology (Eco-BLIC) and Physics Lab Inventory of Critical Thinking (PLIC). These instruments provide experimental scenarios and pose questions asking students to evaluate what to trust and what to do regarding the quality of experimental designs and data. Using more than 3000 student responses from over 20 institutions, we sought to understand what features of the assessment questions elicit student critical thinking. Specifically, we investigated (a) how students critically evaluate aspects of research studies in biology and physics when they are individually evaluating one study at a time versus comparing and contrasting two and (b) whether individual evaluation questions are needed to encourage students to engage in critical thinking when comparing and contrasting. We found that students are more critical when making comparisons between two studies than when evaluating each study individually. Also, compare-and-contrast questions are sufficient for eliciting critical thinking, with students providing similar answers regardless of if the individual evaluation questions are included. This research offers new insight on the types of assessment questions that elicit critical thinking at the introductory undergraduate level; specifically, we recommend instructors incorporate more compare-and-contrast questions related to experimental design in their courses and assessments.Keywords
Funding Information
- National Science Foundation (DUE-1909602)
- National Science Foundation (DUE-1611482)
This publication has 32 references indexed in Scilit:
- Developing a Test of Scientific Literacy Skills (TOSLS): Measuring Undergraduates’ Evaluation of Scientific Information and ArgumentsCBE—Life Sciences Education, 2012
- Diagnostic tests for the physical sciences: A brief reviewNew Directions, 2010
- Instructional Interventions Affecting Critical Thinking Skills and Dispositions: A Stage 1 Meta-AnalysisReview of Educational Research, 2008
- Critical Thinking: Why Is It So Hard to Teach?Arts Education Policy Review, 2008
- Infusing critical thinking skills into content of AI courseACM SIGCSE Bulletin, 2005
- A Time For TellingCognition and Instruction, 1998
- First‐year physics students’ perceptions of the quality of experimental measurementsInternational Journal of Science Education, 1998
- Critical Thinking and Subject Specificity: Clarification and Needed ResearchEducational Researcher, 1989
- Critical thinking and science educationStudies in Higher Education, 1987
- The development and validation of a classroom test of formal reasoningJournal of Research in Science Teaching, 1978