Is ChatGPT a Good Personality Recognizer? A Preliminary Study
Authors:
- Yu JiYu Ji
- Wen WuWWWen Wu
- Liang HeLHLiang He
Preprint
Abstract
In recent years, personality has been regarded as a valuable personal factor being incorporated into numerous tasks such as sentiment analysis and product recommendation. This has led to widespread attention to text-based personality recognition task, which aims to identify an individual's personality based on given text. Considering that ChatGPT has recently exhibited remarkable abilities on various natural language processing tasks, we provide a preliminary evaluation of ChatGPT on text-based personality recognition task for generating effective personality data. Concretely, we employ a variety of prompting strategies to explore ChatGPT's ability in recognizing personality from given text, especially the level-oriented prompting strategy we designed for guiding ChatGPT in analyzing given text at a specified level. The experimental results on two representative real-world datasets reveal that ChatGPT with zero-shot chain-of-thought prompting exhibits impressive personality recognition ability and is capable to provide natural language explanations through text-based logical reasoning. Furthermore, by employing the level-oriented prompting strategy to optimize zero-shot chain-of-thought prompting, the performance gap between ChatGPT and corresponding state-of-the-art model has been narrowed even more. However, we observe that ChatGPT shows unfairness towards certain sensitive demographic attributes such as gender and age. Additionally, we discover that eliciting the personality recognition ability of ChatGPT helps improve its performance on personality-related downstream tasks such as sentiment classification and stress prediction.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- An emotion-based personalized music recommendation framework for emotion improvementInformation Processing & Management, 2022
- An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysisKnowledge-Based Systems, 2022
- “Knowing me, knowing you”: personalized explanations for a music recommender systemUser Modeling and User-Adapted Interaction, 2022
- Automatic children’s personality assessment from emotional speechExpert Systems with Applications, 2022
- A sentiment-aware deep learning approach for personality detection from textInformation Processing & Management, 2021
- Knowledge of words: An interpretable approach for personality recognition from social mediaKnowledge-Based Systems, 2020
- Personalizing recommendation diversity based on user personalityUser Modeling and User-Adapted Interaction, 2018
- Deep learning-based personality recognition from text posts of online social networksApplied Intelligence, 2018
- Personality-based refinement for sentiment classification in microblogKnowledge-Based Systems, 2017
- Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and GermanJournal of Research in Personality, 2007