Semi-Automatic Crowdsourcing Tool for Online Food Image Collection and Annotation
Authors:
- 1 December 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5186-5189
Abstract
Assessing dietary intake accurately remains an open and challenging research problem. In recent years, image-based approaches have been developed to automatically estimate food intake by capturing eat occasions with mobile devices and wearable cameras. To build a reliable machine-learning models that can automatically map pixels to calories, successful image-based systems need large collections of food images with high quality groundtruth labels to improve the learned models. In this paper, we introduce a semi-automatic system for online food image collection and annotation. Our system consists of a web crawler, an automatic food detection method and a web-based crowdsoucing tool. The web crawler is used to download large sets of online food images based on the given food labels. Since not all retrieved images contain foods, we introduce an automatic food detection method to remove irrelevant images. We designed a web-based crowdsourcing tool to assist the crowd or human annotators to locate and label all the foods in the images. The proposed semi-automatic online food image collection system can be used to build large food image datasets with groundtruth labels efficiently from scratch.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- The Dietary Patterns Methods Project: Synthesis of Findings across Cohorts and Relevance to Dietary GuidanceThe Journal of Nutrition, 2015
- Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recallThe American Journal of Clinical Nutrition, 2014
- Online Dietary Intake Estimation: The Food4Me Food Frequency QuestionnaireJournal of Medical Internet Research, 2014
- Higher Diet Quality Is Associated with Decreased Risk of All-Cause, Cardiovascular Disease, and Cancer Mortality among Older AdultsThe Journal of Nutrition, 2014
- Evaluation of Web-Based, Self-Administered, Graphical Food Frequency QuestionnaireJournal of the Academy of Nutrition and Dietetics, 2014
- Children’s Healthy Living (CHL) Program for remote underserved minority populations in the Pacific region: rationale and design of a community randomized trial to prevent early childhood obesityBMC Public Health, 2013
- DietCam: Automatic dietary assessment with mobile camera phonesPervasive and Mobile Computing, 2012
- Evaluation of a Computerized Food Frequency Questionnaire to Estimate Calcium Intake of Asian, Hispanic, and Non-Hispanic White YouthJournal of the American Dietetic Association, 2008
- Children's estimates of food portion size: the effect of timing of dietary interview on the accuracy of children's portion size estimatesBritish Journal of Nutrition, 2007
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998