Scene memorability reflects representational distinctiveness within visual categories
Preprint
Abstract
Some images are consistently remembered better than others, suggesting that memorability reflects intrinsic image properties. We tested whether within-category distinctiveness underlies this effect. Across three experiments ( N = 477), participants categorized indoor scenes previously rated for subjective typicality and then completed recognition memory tests. Typical scenes were categorized faster and more accurately, but were remembered worse and showed a more liberal response bias than atypical scenes. These opposing effects were robust across categories. To link subjective typicality to visual representations, we quantified image distinctiveness using a convolutional neural network (CNN). Across layers, CNN-derived distinctiveness closely tracked human typicality judgments and predicted both categorization speed and memorability, with strongest effects in higher, semantic layers. Critically, the memory advantage for atypical scenes persisted even when most images were atypical, ruling out rarity within the experimental context. Together, the results show that intrinsic scene memorability reflects an image’s position within a category-specific representational space.Keywords
This publication has 49 references indexed in Scilit:
- Embracing New Techniques in Deep Learning for Estimating Image MemorabilityComputational Brain & Behavior, 2022
- Memorability: An Image-Computable Measure of Information Utility2021
- Seeing it all: Convolutional network layers map the function of the human visual systemNeuroImage, 2017
- Intrinsic and extrinsic effects on image memorabilityVision Research, 2015
- Visualizing and Understanding Convolutional Networks2014
- Structural bases of typicality effects.Journal of Experimental Psychology: Human Perception and Performance, 1976
- Semantic distance and the verification of semantic relationsJournal of Verbal Learning and Verbal Behavior, 1973
- ON THE INTERNAL STRUCTURE OF PERCEPTUAL AND SEMANTIC CATEGORIES11This research was supported in part by a grant to the author (under her former name, Eleanor Rosch Heider) from the Foundations Fund for Research in Psychiatry # G67-392, in part by funds made available to the Child Study Center of Brown University from the Grant Foundation and from the National Institute of Neurological Diseases and Blindness, National Collaborative Project (Ph-43-68-13), and in part by research funds made available by the University of California at Berkeley (220 Grant #K9PF-429). I wish to thank Karl G. Heider for his help in the field in West Irian (Indonesian New Guinea), Dr. Robert Olton for assistance in carrying out Experiment 3, and Keith Burton, Randy Street, and Peter Lewitt who assisted with Experiment 4. Experiment 4 was performed with Dr. Richard Millward while the author was a research associate at Brown University.1973
- Pattern recognition and categorizationCognitive Psychology, 1972
- Über die Wirkung von Bereichsbildungen im SpurenfeldPsychological Research, 1933