Exploratory Experiments in Generating Bag of Word Dictionaries Using Word2Vec and ChatGPT
- 8 September 2025
- journal article
- Published by American Accounting Association in Journal of Emerging Technologies in Accounting
- Vol. 22 (2) , 125-147
Abstract
This paper investigates the use of machine learning as a means of generating “bag of words” using text corpora from accounting applications. We use Word2Vec to generate words/dictionaries, that are “similar” to a seed word that captures a concept. As part of our analysis, we perform several experiments using text from Form 10Ks and earnings calls. We investigate several activities including choice of the seed word(s), choosing word sources (corpora), analysis of resulting word lists, and other concerns. We also examine the notion of “human-in-the-loop” and the roles that a person would need to perform while generating a dictionary. Further, we investigate the impact of using accounting and financial corpuses on the different semantic and syntactic relationships, in contrast to Wikipedia. We then extend the analysis to compare those findings to ChatGPT another source of words and investigate some of the advantages and disadvantages of that approach. Data Availability: Data are available from the authors. JEL Classifications: M4.Keywords
This publication has 31 references indexed in Scilit:
- AI for Good: History, Open Data and Some ESG-based ApplicationsJournal of Decision Systems, 2025
- Stock market reactions to the COVID-19 pandemic: The moderating role of corporate big data strategies based on Word2VecPacific-Basin Finance Journal, 2021
- Measuring Corporate Culture Using Machine LearningThe Review of Financial Studies, 2020
- Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political TextsPolitical Analysis, 2013
- Annual report readability, current earnings, and earnings persistenceJournal of Accounting and Economics, 2008
- Supporting decisions in real-time enterprises: autonomic supply chain systemsInformation Systems and e-Business Management, 2008
- Auditor environmental assessmentsInternational Journal of Accounting Information Systems, 2003
- A translation approach to portable ontology specificationsKnowledge Acquisition, 1993
- Verification and validation of case-based systemsExpert Systems with Applications, 1993
- The magical number seven, plus or minus two: Some limits on our capacity for processing information.Psychological Review, 1956