Discovering Latent Semantics in Web Documents Using Fuzzy Clustering
Authors:
- 16 February 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Fuzzy Systems
- Vol. 23 (6) , 2122-2134
Abstract
Web documents are heterogeneous and complex. There exists complicated associations within one web document and linking to the others. The high interactions between terms in documents demonstrate vague and ambiguous meanings. Efficient and effective clustering methods to discover latent and coherent meanings in context are necessary. This paper presents a fuzzy linguistic topological space along with a fuzzy clustering algorithm to discover the contextual meaning in the web documents. The proposed algorithm extracts features from the web documents using conditional random field methods and builds a fuzzy linguistic topological space based on the associations of features. The associations of cooccurring features organize a hierarchy of connected semantic complexes called “CONCEPTS,” wherein a fuzzy linguistic measure is applied on each complex to evaluate 1) the relevance of a document belonging to a topic, and 2) the difference between the other topics. Web contents are able to be clustered into topics in the hierarchy depending on their fuzzy linguistic measures; web users can further explore the CONCEPTS of web contents accordingly. Besides the algorithm applicability in web text domains, it can be extended to other applications, such as data mining, bioinformatics, content-based, or collaborative information filtering, etc.Keywords
Funding Information
- National Science Foundation (98-2221-E-038-012)
This publication has 39 references indexed in Scilit:
- Fuzzy Document Clustering using Weighted Conceptual ModelInformation Technology Journal, 2011
- Information Theoretic Hierarchical ClusteringEntropy, 2011
- Clustering web people search results using fuzzy antsInformation Sciences, 2010
- Uncovering the overlapping community structure of complex networks in nature and societyNature, 2005
- ABNER: an open source tool for automatically tagging genes, proteins and other entity names in textBioinformatics, 2005
- Machine learning in automated text categorizationACM Computing Surveys, 2002
- Web mining researchACM SIGKDD Explorations Newsletter, 2000
- Searching the World Wide WebScience, 1998
- Multiple Comparisons among MeansJournal of the American Statistical Association, 1961
- Use of Ranks in One-Criterion Variance AnalysisJournal of the American Statistical Association, 1952