Real-Time Food Intake Monitoring Using Wearable Egocnetric Camera
Authors:
- 1 July 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2020, 4191-4195
Abstract
With technological advancement, wearable egocentric camera systems have extensively been studied to develop food intake monitoring devices for the assessment of eating behavior. This paper provides a detailed description of the implementation of CNN based image classifier in the Cortex-M7 microcontroller. The proposed network classifies the captured images by the wearable egocentric camera as food and no food images in real-time. This real-time food image detection can potentially lead the monitoring devices to consume less power, less storage, and more user-friendly in terms of privacy by saving only images that are detected as food images. A derivative of pre-trained MobileNet is trained to detect food images from camera captured images. The proposed network needs 761.99KB of flash and 501.76KB of RAM to implement which is built for an optimal trade-off between accuracy, computational cost, and memory footprint considering implementation on a Cortex-M7 microcontroller. The image classifier achieved an average precision of 82%±3% and an average F-score of 74%±2% while testing on 15343 (2127 food images and 13216 no food images) images of five full days collected from five participants.Keywords
This publication has 26 references indexed in Scilit:
- Wearable Cameras in HealthAmerican Journal of Preventive Medicine, 2013
- New technology in dietary assessment: a review of digital methods in improving food record accuracyProceedings of the Nutrition Society, 2013
- Food intake monitoring: an acoustical approach to automated food intake activity detection and classification of consumed foodPhysiological Measurement, 2012
- A New Method for Measuring Meal Intake in Humans via Automated Wrist Motion TrackingApplied Psychophysiology and Biofeedback, 2012
- DietCam: Automatic dietary assessment with mobile camera phonesPervasive and Mobile Computing, 2012
- Slowing Bite-Rate Reduces Energy Intake: An Application of the Bite Counter DeviceJournal of the American Dietetic Association, 2011
- Automated Camera-Phone Experience with the Frequency of Imaging Necessary to Capture DietJournal of the American Dietetic Association, 2010
- Accuracy of Energy Intake Data Estimated by a Multiplepass, 24-hour Dietary Recall TechniqueJournal of the American Dietetic Association, 2000
- Methodology, Correlational Analysis, and Interpretation of Diet Diary Records of the Food and Fluid Intake of Free-living HumansAppetite, 1994
- Inaccuracies in self-reported intake identified by comparison with the doubly labelled water methodCanadian Journal of Physiology and Pharmacology, 1990