Who knows it better? Reassessing human qualitative analysis with text mining
- 30 May 2023
- journal article
- research article
- Published by Emerald Publishing in Qualitative Research in Organizations and Management: An International Journal
- Vol. 18 (2) , 181-198
Abstract
Purpose: In a context where human–machine interaction is growing, understanding the limits between automated and human-based methods may leverage qualitative research. This paper aims to compare human and machine analyses, highlighting the challenges and opportunities of both approaches.Design/methodology/approach: This study applied qualitative secondary analysis (QSA) with machine learning-based text mining on qualitative data from 25 interviews previously analyzed with traditional qualitative content analysis.Findings: By analyzing both techniques' strengths and weaknesses, this study complements the results from the original research work. The previous human model failed to point to a particular aspect of the case, while the machine analysis did not recognize the sequence of time in the interviewee's discourse.Originality/value: This study demonstrates that combining content analysis with text mining techniques improves the quality of the research output. Researchers may, therefore, better handle biases from humans and machines in traditional qualitative and quantitative research.Keywords
This publication has 29 references indexed in Scilit:
- Strategic opportunities (and challenges) of algorithmic decision-making: A call for action on the long-term societal effects of ‘datification’The Journal of Strategic Information Systems, 2015
- Data reuse and the open data citation advantagePeerJ, 2013
- Extending monitoring methods to textual data: a research agendaQuality & Quantity, 2013
- Probabilistic topic modelsCommunications of the ACM, 2012
- Dimensionality Reduction and Topic Modeling: From Latent Semantic Indexing to Latent Dirichlet Allocation and Beyond2012
- Defining qualitative management research: an empirical investigationQualitative Research in Organizations and Management: An International Journal, 2007
- The qualitative interview in IS research: Examining the craftInformation and Organization, 2007
- NVivo 2.0 and ATLAS.ti 5.0: A Comparative Review of Two Popular Qualitative Data-Analysis ProgramsField Methods, 2004
- Systematic combining: an abductive approach to case researchJournal of Business Research, 2002
- The materials of college reading instruction: A critical and historical perspective from 50 years of content analysis researchReading Research and Instruction, 1988