The role of texture summary statistics in material recognition from drawings and photographs
Open Access
- 4 December 2023
- journal article
- research article
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 23 (14) , 3
Abstract
Material depictions in artwork are useful tools for revealing image features that support material categorization. For example, artistic recipes for drawing specific materials make explicit the critical information leading to recognizable material properties (Di Cicco, Wjintjes, & Pont, 2020) and investigating the recognizability of material renderings as a function of their visual features supports conclusions about the vocabulary of material perception. Here, we examined how the recognition of materials from photographs and drawings was affected by the application of the Portilla–Simoncelli texture synthesis model. This manipulation allowed us to examine how categorization may be affected differently across materials and image formats when only summary statistic information about appearance was retained. Further, we compared human performance to the categorization accuracy obtained from a pretrained deep convolutional neural network to determine if observers’ performance was reflected in the network. Although we found some similarities between human and network performance for photographic images, the results obtained from drawings differed substantially. Our results demonstrate that texture statistics play a variable role in material categorization across rendering formats and material categories and that the human perception of material drawings is not effectively captured by deep convolutional neural networks trained for object recognition.Keywords
This publication has 29 references indexed in Scilit:
- Accuracy and speed of material categorization in real-world imagesJournal of Vision, 2014
- A summary statistic representation in peripheral vision explains visual searchJournal of Vision, 2012
- What Line Drawings Reveal About the Visual BrainFrontiers in Human Neuroscience, 2011
- A summary-statistic representation in peripheral vision explains visual crowdingJournal of Vision, 2009
- Image statistics do not explain the perception of gloss and lightnessJournal of Vision, 2009
- The nonlinear structure of motion perception during smooth eye movementsJournal of Vision, 2009
- Conjoint Measurement of Gloss and Surface TexturePsychological Science, 2008
- Image statistics and the perception of surface qualitiesNature, 2007
- Texture synthesis and perception: Using computational models to study texture representations in the human visual systemVision Research, 2006
- Low-Level Image Cues in the Perception of Translucent MaterialsACM Transactions on Applied Perception, 2005