Evaluation of Folksonomy Induction Algorithms
Authors:
Open Access
- 1 September 2012
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 3 (4) , 1-22
Abstract
Algorithms for constructing hierarchical structures from user-generated metadata have caught the interest of the academic community in recent years. In social tagging systems, the output of these algorithms is usually referred to as folksonomies (from folk-generated taxonomies). Evaluation of folksonomies and folksonomy induction algorithms is a challenging issue complicated by the lack of golden standards, lack of comprehensive methods and tools as well as a lack of research and empirical/simulation studies applying these methods. In this article, we report results from a broad comparative study of state-of-the-art folksonomy induction algorithms that we have applied and evaluated in the context of five social tagging systems. In addition to adopting semantic evaluation techniques, we present and adopt a new technique that can be used to evaluate the usefulness of folksonomies for navigation . Our work sheds new light on the properties and characteristics of state-of-the-art folksonomy induction algorithms and introduces a new pragmatic approach to folksonomy evaluation, while at the same time identifying some important limitations and challenges of folksonomy evaluation. Our results show that folksonomy induction algorithms specifically developed to capture intuitions of social tagging systems outperform traditional hierarchical clustering techniques. To the best of our knowledge, this work represents the largest and most comprehensive evaluation study of state-of-the-art folksonomy induction algorithms to date.Keywords
Funding Information
- Austrian Science Fund (P20269)
This publication has 29 references indexed in Scilit:
- Building directories for social tagging systems2011
- Sustaining the Internet with hyperbolic mappingNature Communications, 2010
- Contextualising tags in collaborative tagging systems2009
- Navigability of complex networksNature Physics, 2008
- Semantic Grounding of Tag Relatedness in Social Bookmarking Systems2008
- Clustering by Passing Messages Between Data PointsScience, 2007
- On How to Perform a Gold Standard Based Evaluation of Ontology Learning2006
- How to search a social networkSocial Networks, 2005
- Search in power-law networksPhysical Review E, 2001
- Efficient Clustering of Very Large Document Collections2001