Capturing Fine-Grained Food Image Features Through Iterative Clustering and Attention Mechanisms
Open Access
- 16 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 69888-69897
Abstract
Food image recognition is a crucial initial step for food detection, nutritional analysis, and dietary recommendations. However, it is highly challenging due to the diverse appearance of food, which includes variations in color, texture, and presentation. We believe that effective food image recognition requires exploiting the characteristics of food images, with color playing a dominant role in feature extraction. This paper proposes a novel color-cluster attention network model for food recognition, which integrates Kohonen networks-based clustering methods with iterative feature refinement. First, the model leverages Kohonen networks-based clustering methods to effectively group similar features, which helps in capturing the complex compositions of food ingredients. Then, we apply an iterative strategy to the feature extraction module to gradually capture finer image details, and utilize a self-attention mechanism for weighting to further enhance feature representation. Extensive experiments conducted on various food image datasets, including ETH Food-101, Food11, Food new and CAFD to evaluate the effectiveness of the proposed model. The results show that the proposed model significantly improves the recognition accuracy and validate the generalization ability of the method on multiple food datasets.Keywords
This publication has 32 references indexed in Scilit:
- A review on vision-based analysis for automatic dietary assessmentTrends in Food Science & Technology, 2022
- Nutritional Monitoring in Older People Prevention Services2021
- A comprehensive survey of image segmentation: clustering methods, performance parameters, and benchmark datasetsMultimedia Tools and Applications, 2021
- Disruptive technologies in agricultural operations: a systematic review of AI-driven AgriTech researchAnnals of Operations Research, 2021
- A machine learning workflow for raw food spectroscopic classification in a future industryScientific Reports, 2020
- Deep Clustering for Unsupervised Learning of Visual Features2018
- Automatic Expansion of a Food Image Dataset Leveraging Existing Categories with Domain Adaptation2015
- A mobile, lightweight, poll-based food identification systemPattern Recognition, 2014
- Food-101 – Mining Discriminative Components with Random Forests2014
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982