Muti-Stage Hierarchical Food Classification
Open Access
- 29 October 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 79-87
Abstract
Food image classification serves as a fundamental and critical step in image-based dietary assessment, facilitating nutrient intake analysis from captured food images. However, existing works in food classification predominantly focuses on predicting 'food types', which do not contain direct nutritional composition information.This limitation arises from the inherent discrepancies in nutrition databases, which are tasked with associating each 'food item' with its respective information. Therefore, in this work we aim to classify food items to align with nutrition database. To this end, we first introduce VFN-nutrient dataset by annotating each food image in VFN with a food item that includes nutritional composition information. Such annotation of food items, being more discriminative than food types, creates a hierarchical structure within the dataset. However, since the food item annotations are solely based on nutritional composition information, they do not always show visual relations with each other, which poses significant challenges when applying deep learning-based techniques for classification.To address this issue, we then propose a multi-stage hierarchical framework for food item classification by iteratively clustering and merging food items during the training process, which allows the deep model to extract image features that are discriminative across labels. Our method is evaluated on VFN-nutrient dataset and achieve promising results compared with existing work in terms of both food type and food item classification.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Clustering Evaluation by Davies-Bouldin Index(DBI) in Cereal data using K-Means2020
- Personalized Classifier for Food Image RecognitionIEEE Transactions on Multimedia, 2018
- Understanding of a convolutional neural network2017
- New mobile methods for dietary assessment: review of image-assisted and image-based dietary assessment methodsProceedings of the Nutrition Society, 2016
- Deep Residual Learning for Image Recognition2016
- Wide Residual Networks2016
- Going deeper with convolutions2015
- Food image classification using local appearance and global structural informationNeurocomputing, 2014
- Food-101 – Mining Discriminative Components with Random Forests2014
- ImageNet: A large-scale hierarchical image database2009