Using Text Analytics on Reflective Journaling to Identify Cultural Capitals for STEM Students
Authors:
- 1 December 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 797-804
Abstract
Alma project focuses on retention of Historically Underrepresented (HU) students in STEM fields by affirming their cultural capitals (skills, knowledge, communities, and abilities that students possess). Students are asked to write reflective journals on prompts such as `Why am I here?' to reminds them of their cultural capitals, and career aspirations. These essays are then analyzed by the Alma team to identify mentions of cultural capital themes (CCT) such as Attainment (describes a tangible goal), or First Generation (identifies student being first in family to attend college). However, detecting these CCTs in student essays is a labor intensive task. Our work offers a computational solution that is scalable and effective for this problem. We propose TACCTI (pronounced as Tacit), Text analysis and mAchine learning for Cultural Capital Theme Identification - a computational framework that employs latest developments in natural language processing and machine learning to identify instances of cultural capital themes in student essays. An empirical evaluation using Logistic Regression, Random Forest, LSTM, and BERT algorithms for the task of detecting presence (or absence) of Attainment CCT provides F1 scores of 0.82, 0.81, 0.84, and 0.92, respectively. Classification models for detecting First Generation CCT demonstrate that when limited training data is available, the traditional classification algorithms outperform deep learning based approaches - Logistic Regression and BERT models offer effectiveness of 0.91 and 0.83, respectively. Additional analysis demonstrates that word embeddings and named entity type of features (signals) have the highest influence on the performance of the classification models.Keywords
Funding Information
- Common Fund
This publication has 11 references indexed in Scilit:
- The Influence of Affirming Kindness and Community on Broadening Participation in STEM Career PathwaysSocial Issues and Policy Review, 2018
- Improving Underrepresented Minority Student Persistence in STEMCBE—Life Sciences Education, 2016
- The Stanford CoreNLP Natural Language Processing Toolkit2014
- Glove: Global Vectors for Word Representation2014
- Whose culture has capital? A critical race theory discussion of community cultural wealthRace Ethnicity and Education, 2005
- Learning and living pedagogies of the home: The mestiza consciousness of Chicana studentsInternational Journal of Qualitative Studies in Education, 2001
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997
- Long Short-Term MemoryNeural Computation, 1997
- WordNetCommunications of the ACM, 1995
- Funds of knowledge for teaching: Using a qualitative approach to connect homes and classroomsTheory Into Practice, 1992