Self-emergence of knowledge trees: Extraction of the Wikipedia hierarchies
- 13 July 2007
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 76 (1) , 016106
Abstract
The rapid accumulation of knowledge and the recent emergence of new dynamic and practically unmoderated information repositories have rendered the classical concept of the hierarchal knowledge structure irrelevant and impossible to impose manually. This led to modern methods of data location, such as browsing or searching, which conceal the underlying information structure. We here propose methods designed to automatically construct a hierarchy from a network of related terms. We apply these methods to Wikipedia and compare the hierarchy obtained from the article network to the complementary acyclic category layer of the Wikipedia and show an excellent fit. We verify our methods in two networks with no a priori hierarchy (the E. Coli genetic regulatory network and the C. Elegans neural network) and a network of function libraries of modern computer operating systems that are intrinsically hierarchical and reproduce a known functional order.Keywords
This publication has 14 references indexed in Scilit:
- Preferential attachment in the growth of social networks: The internet encyclopedia WikipediaPhysical Review E, 2006
- Wikipedias: Collaborative web-based encyclopedias as complex networksPhysical Review E, 2006
- A faster algorithm for betweenness centrality*The Journal of Mathematical Sociology, 2001
- Classes of small-world networksProceedings of the National Academy of Sciences, 2000
- Emergence of Scaling in Random NetworksScience, 1999
- Growth dynamics of the World-Wide WebNature, 1999
- On power-law relationships of the Internet topologyACM SIGCOMM Computer Communication Review, 1999
- Collective dynamics of ‘small-world’ networksNature, 1998
- The World-Wide WebCommunications of the ACM, 1994
- A Set of Measures of Centrality Based on BetweennessSociometry, 1977