Development of a Non-Contact Sensor System for Converting 2D Images into 3D Body Data: A Deep Learning Approach to Monitor Obesity and Body Shape in Individuals in Their 20s and 30s
Open Access
Abstract
This study demonstrates how to generate a three-dimensional (3D) body model through a small number of images and derive body values similar to the actual values using generated 3D body data. In this study, a 3D body model that can be used for body type diagnosis was developed using two full-body pictures of the front and side taken with a mobile phone. For data training, 400 3D body datasets (male: 200, female: 200) provided by Size Korea were used, and four models, i.e., 3D recurrent reconstruction neural network, point cloud generative adversarial network, skinned multi-person linear model, and pixel-aligned impact function for high-resolution 3D human digitization, were used. The models proposed in this study were analyzed and compared. A total of 10 men and women were analyzed, and their corresponding 3D models were verified by comparing 3D body data derived from 2D image inputs with those obtained using a body scanner. The model was verified through the difference between 3D data derived from the 2D image and those derived using an actual body scanner. Unlike the 3D generation models that could not be used to derive the body values in this study, the proposed model was successfully used to derive various body values, indicating that this model can be implemented to identify various body types and monitor obesity in the future.Keywords
Funding Information
- National Research Foundation of Korea (NRF) (2022RIS-005)
- Ministry of Education (MOE) (2022RIS-005)
This publication has 30 references indexed in Scilit:
- Capturing Human Motion in Natural EnvironmentsProcedia Manufacturing, 2015
- Beyond PASCAL: A benchmark for 3D object detection in the wild2014
- Modeling perspective projections in 3-dimensions by rotations in 4-dimensionsGraphical Models, 2013
- Scanning 3D Full Human Bodies Using KinectsIEEE Transactions on Visualization and Computer Graphics, 2012
- Validity of self‐reported height and weight and derived body mass index in middle‐aged and elderly individuals in AustraliaAustralian and New Zealand Journal of Public Health, 2011
- INTEGRAL Spectrometer SPI's GRB detection capabilitiesAstronomy & Astrophysics, 2003
- Shape matching and object recognition using shape contextsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Human body 3D imaging by speckle texture projection photogrammetrySensor Review, 2000
- Use of image-based information in judgments of surface-reflectance propertiesJournal of the Optical Society of America A, 1998
- Body Size and Fat Distribution as Predictors of Coronary Heart Disease among Middle-aged and Older US MenAmerican Journal of Epidemiology, 1995