Bert-Based Latent Semantic Analysis (Bert-LSA): A Case Study on Geospatial Data Technology and Application Trend Analysis
Open Access
- 14 December 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (24) , 11897
Abstract
Geospatial data is an indispensable data resource for research and applications in many fields. The technologies and applications related to geospatial data are constantly advancing and updating, so identifying the technologies and applications among them will help foster and fund further innovation. Through topic analysis, new research hotspots can be discovered by understanding the whole development process of a topic. At present, the main methods to determine topics are peer review and bibliometrics, however they just review relevant literature or perform simple frequency analysis. This paper proposes a new topic discovery method, which combines a word embedding method, based on a pre-trained model, Bert, and a spherical k-means clustering algorithm, and applies the similarity between literature and topics to assign literature to different topics. The proposed method was applied to 266 pieces of literature related to geospatial data over the past five years. First, according to the number of publications, the trend analysis of technologies and applications related to geospatial data in several leading countries was conducted. Then, the consistency of the proposed method and the existing method PLSA (Probabilistic Latent Semantic Analysis) was evaluated by using two similar consistency evaluation indicators (i.e., U-Mass and NMPI). The results show that the method proposed in this paper can well reveal text content, determine development trends, and produce more coherent topics, and that the overall performance of Bert-LSA is better than PLSA using NPMI and U-Mass. This method is not limited to trend analysis using the data in this paper; it can also be used for the topic analysis of other types of texts.Keywords
Funding Information
- National Natural Science Foundation of China (42050101, 41771430, 41631177)
- Strategic Priority Research Program of the Chinese Academy of Sciences (XDA23100100)
This publication has 40 references indexed in Scilit:
- An analysis of the coherence of descriptors in topic modelingExpert Systems with Applications, 2015
- Text Mining-Based Emerging Trend Analysis for the Aviation IndustryJournal of Intelligence and Information Systems, 2015
- Mapping Publication Trends and Identifying Hot Spots of Research on Internet Health Information Seeking Behavior: A Quantitative and Co-Word Biclustering AnalysisJournal of Medical Internet Research, 2015
- A bibliometric analysis of research on Antarctica during 1993–2012Scientometrics, 2014
- Community detection: Topological vs. topicalJournal of Informetrics, 2011
- Examining mobile learning trends 2003–2008: a categorical meta-trend analysis using text mining techniquesJournal of Computing in Higher Education, 2011
- Text mining techniques for patent analysisInformation Processing & Management, 2007
- Probabilistic topic decomposition of an eighteenth‐century American newspaperJournal of the American Society for Information Science and Technology, 2006
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987