Thematic analysis of 18 years of physics education research conference proceedings using natural language processing
Open Access
- 29 June 2020
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review Physics Education Research
- Vol. 16 (1) , 010142
Abstract
We have used an unsupervised machine learning method called latent Dirichlet allocation (LDA) to thematically analyze all papers published in the Physics Education Research Conference Proceedings between 2001 and 2018. By looking at co-occurrences of words across the data corpus, this technique has allowed us to identify ten distinct themes or “topics” that have seen varying levels of prevalence in physics education research (PER) over time and to rate the distribution of these topics within each paper. Our analysis suggests that although all identified topics have seen sustained interest over time, PER has also seen several waves of increased interest in certain topics, beginning with initial interest in qualitative, theory-building studies of student understanding, which gave way to a focus on problem solving in the late 2000s. Since 2010 the field has seen a shift toward more sociocultural views of teaching and learning with a particular focus on communities of practice, student identities, and institutional change. Based on these results, we suggest that unsupervised text analysis techniques like LDA may hold promise for providing quantitative, independent, and replicable analyses of educational research literature.Keywords
Funding Information
- Norges Forskningsråd (288125)
- Norwegian Agency for Quality Assurance in Education
- Center for Computing in Science Education
This publication has 30 references indexed in Scilit:
- A brief history of physics education in the United StatesAmerican Journal of Physics, 2015
- Synthesis of discipline-based education research in physicsPhysical Review Special Topics - Physics Education Research, 2014
- Mining Marketing Meaning from Online Chatter: Strategic Brand Analysis of Big Data Using Latent Dirichlet AllocationJournal of Marketing Research, 2014
- Oersted Lecture 2013: How should we think about how our students think?American Journal of Physics, 2014
- Integrating Numerical Computation into the Modeling Instruction CurriculumThe Physics Teacher, 2014
- Investigating the quality of mental models deployed by undergraduate engineering students in creating explanations: The case of thermally activated phenomenaPhysical Review Special Topics - Physics Education Research, 2013
- Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political TextsPolitical Analysis, 2013
- The shifting sands of disciplinary development: Analyzing North American Library and Information Science dissertations using latent Dirichlet allocationJournal of the American Society for Information Science and Technology, 2010
- Finding scientific topicsProceedings of the National Academy of Sciences, 2004
- The Jackknife Estimate of VarianceThe Annals of Statistics, 1981