Psychometric and Validity Issues in Machine Learning Approaches to Personality Assessment: A Focus on Social Media Text Mining
Authors:
- 16 July 2020
- journal article
- research article
- Published by SAGE Publications in European Journal of Personality
- Vol. 34 (5) , 826-844
Abstract
In the age of big data, substantial research is now moving toward using digital footprints like social media text data to assess personality. Nevertheless, there are concerns and questions regarding the psychometric and validity evidence of such approaches. We seek to address this issue by focusing on social media text data and (i) conducting a review of psychometric validation efforts in social media text mining (SMTM) for personality assessment and discussing additional work that needs to be done; (ii) considering additional validity issues from the standpoint of reference (i.e. ‘ground truth’) and causality (i.e. how personality determines variations in scores derived from SMTM); and (iii) discussing the unique issues of generalizability when validating SMTM for personality assessment across different social media platforms and populations. In doing so, we explicate the key validity and validation issues that need to be considered as a field to advance SMTM for personality assessment, and, more generally, machine learning personality assessment methods. © 2020 European Association of Personality PsychologyKeywords
This publication has 76 references indexed in Scilit:
- Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary ApproachPLOS ONE, 2013
- Private traits and attributes are predictable from digital records of human behaviorProceedings of the National Academy of Sciences, 2013
- A tale of two sites: Twitter vs. Facebook and the personality predictors of social media usageComputers in Human Behavior, 2012
- Manifestations of Personality in Online Social Networks: Self-Reported Facebook-Related Behaviors and Observable Profile InformationCyberpsychology, Behavior, and Social Networking, 2011
- Internal Consistency, Retest Reliability, and Their Implications for Personality Scale ValidityPersonality and Social Psychology Review, 2010
- Social Interaction and Co-Viewing With YouTube: Blending Mass Communication Reception and Social ConnectionJournal of Broadcasting & Electronic Media, 2009
- Reporting standards for research in psychology: Why do we need them? What might they be?American Psychologist, 2008
- Testing the measurement equivalence of personality adjective items across culturesJournal of Research in Personality, 2008
- Mechanisms by which childhood personality traits influence adult health status: Educational attainment and healthy behaviors.Health Psychology, 2007
- Situation Trait Relevance, Trait Expression, and Cross-Situational Consistency: Testing a Principle of Trait ActivationJournal of Research in Personality, 2000