Colorimetric skin tone scale for improved accuracy of human skin tone annotations
Open Access
- 30 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Journal on Responsible Computing
- Vol. 2 (2) , 1-23
Abstract
Human image datasets used to develop and evaluate technology should represent the variation in human phenotypes, including skin tone. Datasets that include skin tone information frequently rely on manual skin tone ratings based on the Fitzpatrick Skin Type (FST) or the Monk Skin Tone (MST) scales in lieu of the actual measured skin tone of the image dataset subjects. However, perceived skin tone is subject to known perceptual errors and skin tone appearance in digital images can vary substantially depending on the capture camera and environment, confounding manual ratings. Surprisingly, the relationship between skin tone ratings and measured skin tone has not been explored. To close this research gap, we measured the relationship between skin tone ratings from existing scales (FST, MST) and skin tone values measured by a calibrated colorimeter. We also propose and assess a novel Colorimetric Skin Tone (CST) scale developed based on prior colorimetric measurements. Using experiments requiring humans to rate their own skin tone and the skin tone of subjects in images, we show that the new CST scale is more sensitive, consistent, and colorimetrically accurate. While skin tone ratings appeared to correct for some color variation across images, they introduced perceptual errors related to race and other factors. These perceptual errors must be considered before using manual skin-tone ratings in technology evaluations or for engineering decisions.Keywords
Funding Information
- United States Department of Homeland Security's Science and Technology Directorate (70RSAT18CB00000034 and 70RSAT23CB00000003)
This publication has 27 references indexed in Scilit:
- Is a Picture Worth A Thousand Words? An Experiment Comparing Observer-Based Skin Tone MeasuresRace and Social Problems, 2020
- Mechanisms underlying simultaneous brightness contrast: Early and innateVision Research, 2020
- Research Techniques Made Simple: Cutaneous Colorimetry: A Reliable Technique for Objective Skin Color MeasurementJournal of Investigative Dermatology, 2020
- Individual differences and their implications for color perceptionCurrent Opinion in Behavioral Sciences, 2019
- Striking individual differences in color perception uncovered by ‘the dress’ photographCurrent Biology, 2015
- Accuracy of Self-report in Assessing Fitzpatrick Skin Phototypes I Through VIJAMA Dermatology, 2013
- A rationale for the structure of color spaceTrends in Neurosciences, 2002
- Skin color measurements: comparison between three instruments: the Chromameter®, the DermaSpectrometer® and the Mexameter®Skin Research and Technology, 2000
- Color appearance depends on the variance of surround colorsCurrent Biology, 1997
- The Validity and Practicality of Sun-Reactive Skin Types I Through VIArchives of Dermatology, 1988