Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment
Open Access
- 30 November 2023
- Vol. 15 (23) , 4972
Abstract
Photo-based dietary assessment is becoming more feasible as artificial intelligence methods improve. However, advancement of these methods for dietary assessment in research settings has been hindered by the lack of an appropriate dataset against which to benchmark algorithm performance. We conducted the Surveying Nutrient Assessment with Photographs of Meals (SNAPMe) study (ClinicalTrials ID: NCT05008653) to pair meal photographs with traditional food records. Participants were recruited nationally, and 110 enrollment meetings were completed via web-based video conferencing. Participants uploaded and annotated their meal photos using a mobile phone app called Bitesnap and completed food records using the Automated Self-Administered 24-h Dietary Assessment Tool (ASA24®) version 2020. Participants included photos before and after eating non-packaged and multi-serving packaged meals, as well as photos of the front and ingredient labels for single-serving packaged foods. The SNAPMe Database (DB) contains 3311 unique food photos linked with 275 ASA24 food records from 95 participants who photographed all foods consumed and recorded food records in parallel for up to 3 study days each. The use of the SNAPMe DB to evaluate ingredient prediction demonstrated that the publicly available algorithms FB Inverse Cooking and Im2Recipe performed poorly, especially for single-ingredient foods and beverages. Correlations between nutrient estimates common to the Bitesnap and ASA24 dietary assessment tools indicated a range in predictive capacity across nutrients (cholesterol, adjusted R2 = 0.85, p < 0.0001; food folate, adjusted R2 = 0.21, p < 0.05). SNAPMe DB is a publicly available benchmark for photo-based dietary assessment in nutrition research. Its demonstrated utility suggested areas of needed improvement, especially the prediction of single-ingredient foods and beverages.Keywords
Funding Information
- U.S. Department of Agriculture (2020-67021-32855, 2032-51530-026-000-D, 0201-88888-003-000D, 0201-88888-002-000D)
- U.S. Department of Agriculture (2020-67021-32855, 2032-51530-026-000-D, 0201-88888-003-000D, 0201-88888-002-000D)
- U.S. Department of Agriculture (2020-67021-32855, 2032-51530-026-000-D, 0201-88888-003-000D, 0201-88888-002-000D)
- U.S. Department of Agriculture (2020-67021-32855, 2032-51530-026-000-D, 0201-88888-003-000D, 0201-88888-002-000D)
This publication has 43 references indexed in Scilit:
- Food Image Recognition Using Very Deep Convolutional Networks2016
- Electronic Dietary Intake Assessment (e-DIA): relative validity of a mobile phone application to measure intake of food groupsBritish Journal of Nutrition, 2016
- Im2Calories: Towards an Automated Mobile Vision Food Diary2015
- The National Cancer Institute’s Dietary Assessment Primer: A Resource for Diet ResearchJournal of the Academy of Nutrition and Dietetics, 2015
- Electronic Dietary Intake Assessment (e-DIA): Comparison of a Mobile Phone Digital Entry App for Dietary Data Collection With 24-Hour Dietary RecallsJMIR mHealth and uHealth, 2015
- Evaluation of a Mobile Phone Image-Based Dietary Assessment Method in Adults with Type 2 DiabetesNutrients, 2015
- An Overview of the Technology Assisted Dietary Assessment Project at Purdue University2010
- The Use of Mobile Devices in Aiding Dietary Assessment and EvaluationIEEE Journal of Selected Topics in Signal Processing, 2010
- A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography methodBritish Journal of Nutrition, 2008
- Development of a New Instrument for Evaluating Individuals’ Dietary IntakesJournal of the American Dietetic Association, 2006