A Curated Set of Labeled Code Tutorial Images for Deep Learning
- 1 December 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1276-1280
Abstract
As more work is conducted in mining software repositories at a large scale, aggregating data from multiple modalities beyond textual representations will prove beneficial. Online video content related to software engineering offers another, thus far largely untapped, venue for source code. In this paper, we present a novel dataset comprised of 111,229 frames extracted from a sample of 100 technology-related YouTube tutorials, taught in the Java and Python programming languages. These videos span a diverse range of Integrated Development Environments (IDEs) and modes of information presentation, lending heterogeneity of image features to our dataset. Hand-labeled for the presence, or lack thereof, of typeset, partially visible typeset, or handwritten code, the dataset provides a uniquely consistent and accurate data source for supervised machine learning ventures in extracting and processing code from images.Keywords
This publication has 6 references indexed in Scilit:
- Accurately Predicting the Location of Code Fragments in Programming Video Tutorials Using Deep Learning2018
- Learning lexical features of programming languages from imagery using convolutional neural networks2018
- A gold standard for emotion annotation in stack overflow2018
- Learning Deep Features for Discriminative Localization2016
- Exploring Java software vocabulary: A search and mining perspective2009
- Labeling images with a computer game2004