Comparing representations of a discipline derived through LDA vs. intellectual content analysis: the case of information science
Open Access
- 28 July 2025
- journal article
- research article
- Published by Springer Nature in Scientometrics
- Vol. 130 (8) , 4309-4337
Abstract
The paper looks at the methodology of empirical analyses of the content and structure of Information Science (IS). The traditional approach in empirical analysis is intellectual content analysis (ICA) of a representative data set. The high labor cost prohibits the analysis of massive data sets. A recent alternative is based on data mining/machine learning. Its strength is the capability of analyzing massive datasets efficiently. However, a significant issue is the quality of content analysis. The paper compares latent Dirichlet allocation/topic modeling (LDA/TM) based statistical analysis to ICA using the same data set, 1514 scholarly articles from the year 2015 volumes of 30 IS journals. The intellectual analysis provides the mirror for reflecting the TM results. LDA/TM is strong in identifying new directions of a discipline and processing masses of text. Its weaknesses include semantic haziness of topics due to bag-of-words article representation, text pre-processing, tuning of parameters, and being unanalytic in composing topics from words belonging to different categories.Keywords
Funding Information
- Tampere University
This publication has 27 references indexed in Scilit:
- The association of disciplinary background with the evolution of topics and methods in Library and Information Science research 1995–2015Journal of the Association for Information Science and Technology, 2023
- Disciplinary contributions to research topics and methodology in Library and Information Science—Leading to fragmentation?Journal of the Association for Information Science and Technology, 2022
- The evolution and shift of research topics and methods in library and information scienceJournal of the Association for Information Science and Technology, 2021
- Cross-disciplinary collaboration versus coexistence in LIS serials: analysis of authorship affiliations in four European countriesScientometrics, 2020
- Examining interdisciplinarity of library and information science (LIS) based on LIS articles contributed by non-LIS authorsScientometrics, 2018
- Text Preparation and Similarity Computation2018
- Mapping the evolution of library and information science (1978–2014) using topic modeling on LISAScientometrics, 2017
- Evolution of research subjects in library and information science based on keyword, bibliographical coupling, and co-citation analysesScientometrics, 2015
- The shifting sands of disciplinary development: Analyzing North American Library and Information Science dissertations using latent Dirichlet allocationJournal of the American Society for Information Science and Technology, 2010
- Bibliometric overview of Library and Information Science Research in SpainJournal of the American Society for Information Science, 1999