Colors Matter: AI-Driven Exploration of Human Feature Colors
Preprint
Abstract
This study presents a robust framework that leverages advanced imaging techniques and machine learning for feature extraction and classification of key human attributes-namely skin tone, hair color, iris color, and vein-based undertones. The system employs a multi-stage pipeline involving face detection, region segmentation, and dominant color extraction to isolate and analyze these features. Techniques such as X-means clustering, alongside perceptually uniform distance metrics like Delta E (CIEDE2000), are applied within both LAB and HSV color spaces to enhance the accuracy of color differentiation. For classification, the dominant tones of the skin, hair, and iris are extracted and matched to a custom tone scale, while vein analysis from wrist images enables undertone classification into "Warm" or "Cool" based on LAB differences. Each module uses targeted segmentation and color space transformations to ensure perceptual precision. The system achieves up to 80% accuracy in tone classification using the Delta E-HSV method with Gaussian blur, demonstrating reliable performance across varied lighting and image conditions. This work highlights the potential of AI-powered color analysis and feature extraction for delivering inclusive, precise, and nuanced classification, supporting applications in beauty technology, digital personalization, and visual analytics.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Method and analysis of color changes of facial skin after applying skin makeupVision Research, 2023
- Facial skin colour classification using machine learning and hyperspectral imaging dataIET Image Processing, 2021
- Is a Picture Worth A Thousand Words? An Experiment Comparing Observer-Based Skin Tone MeasuresRace and Social Problems, 2020
- A Style-Based Generator Architecture for Generative Adversarial NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- A systematic review: machine learning based recommendation systems for e-learningEducation and Information Technologies, 2019
- Recommendation Systems: Techniques, Challenges, Application, and Evaluation2018
- Facial Landmark Detection: A Literature SurveyInternational Journal of Computer Vision, 2018
- Skin color modeling for face detection and segmentation: a review and a new approachMultimedia Tools and Applications, 2014
- Learning effective color features for content based image retrieval in dermatologyPattern Recognition, 2010
- The Coming Age of Calm Technology1997