HiGitClass: Keyword-Driven Hierarchical Classification of GitHub Repositories
Authors:
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 876-885
Abstract
GitHub has become an important platform for code sharing and scientific exchange. With the massive number of repositories available, there is a pressing need for topic-based search. Even though the topic label functionality has been introduced, the majority of GitHub repositories do not have any labels, impeding the utility of search and topic-based analysis. This work targets the automatic repository classification problem as keyword-driven hierarchical classification. Specifically, users only need to provide a label hierarchy with keywords to supply as supervision. This setting is flexible, adaptive to the users' needs, accounts for the different granularity of topic labels and requires minimal human effort. We identify three key challenges of this problem, namely (1) the presence of multi-modal signals; (2) supervision scarcity and bias; (3) supervision format mismatch. In recognition of these challenges, we propose the HiGitClass framework, comprising of three modules: heterogeneous information network embedding; keyword enrichment; topic modeling and pseudo document generation. Experimental results on two GitHub repository collections confirm that HiGitClass is superior to existing weakly-supervised and dataless hierarchical classification methods, especially in its ability to integrate both structured and unstructured data for repository classification. Code and datasets related to this paper are available at https://github.com/yuzhimanhua/HiGitClass.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- PTE2015
- DeepWalk2014
- The promises and perils of mining GitHub2014
- Convolutional Neural Networks for Sentence Classification2014
- Mining Heterogeneous Information Networks: Principles and MethodologiesSynthesis Lectures on Data Mining and Knowledge Discovery, 2012
- Social media and success in open source projects2012
- Social coding in GitHub2012
- Opinion integration through semi-supervised topic modeling2008
- Support vector machines classification with a very large-scale taxonomyACM SIGKDD Explorations Newsletter, 2005
- Hierarchical classification of Web content2000