Automatic Concept Extraction Based on Semantic Graphs From Big Data in Smart City
- 25 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 7 (1) , 225-233
Abstract
With the rapid development of smart cities, various types of sensors can rapidly collect a large amount of data, and it becomes increasingly important to discover effective knowledge and process information from massive amounts of data. Currently, in the field of knowledge engineering, knowledge graphs, especially domain knowledge graphs, play important roles and become the infrastructure of Internet knowledge-driven intelligent applications. Domain concept extraction is critical to the construction of domain knowledge graphs. Although there have been some works that have extracted concepts, semantic information has not been fully used. However, the excellent concept extraction results can be obtained by making full use of semantic information. In this article, a novel concept extraction method, Semantic Graph-Based Concept Extraction (SGCCE), is proposed. First, the similarities between terms are calculated using the word co-occurrence, the LDA topic model and Word2Vec. Then, a semantic graph of terms is constructed based on the similarities between the terms. Finally, according to the semantic graph of the terms, community detection algorithms are used to divide the terms into different communities where each community acts as a concept. In the experiments, we compare the concept extraction results that are obtained by different community detection algorithms to analyze the different semantic graphs. The experimental results show the effectiveness of our proposed method. This method can effectively use semantic information, and the results of the concept extraction are better from domain big data in smart cities.Keywords
Funding Information
- National Key Research and Development Plan (2018YFB0803504, 2018YEB1004003)
- Guangdong Province Key Research and Development Plan (2019B010137004)
- National Natural Science Foundation of China (61871140, 61872100, 61572153, U1636215)
- Peng Cheng Laboratory Project of Guangdong Province (PCL2018KP004)
This publication has 32 references indexed in Scilit:
- Towards open ontology learning and filteringInformation Systems, 2011
- GRAONTO: A graph-based approach for automatic construction of domain ontologyExpert Systems with Applications, 2011
- Enabling the development of base domain ontology through extraction of knowledge from engineering domain handbooksAdvanced Engineering Informatics, 2011
- CRCTOL: A semantic‐based domain ontology learning systemJournal of the American Society for Information Science and Technology, 2009
- Fast unfolding of communities in large networksJournal of Statistical Mechanics: Theory and Experiment, 2008
- Using recursive ART network to construction domain ontology based on term frequency and inverse document frequencyExpert Systems with Applications, 2008
- An effective key management scheme for heterogeneous sensor networksAd Hoc Networks, 2007
- Modularity and community structure in networksProceedings of the National Academy of Sciences, 2006
- Fast algorithm for detecting community structure in networksPhysical Review E, 2004
- The limitations of term co-occurrence data for query expansion in document retrieval systemsJournal of the American Society for Information Science, 1991