Marianne Maertens
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Marianne Maertens has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Felix A. Wichmann
Neural Information Processing Group, University of Tübingen, Tübingen, Germany
6 shared publications - Guillermo Aguilar
Technische Universität Berlin
3 shared publications - Robert Shapley
Center for Neural Science, NYU, USA
3 shared publications - Guillermo Aguilar
Technische Universität Berlin
2 shared publications - Lynn Schmittwilken
Centre for Cognitive Science, Institute for Psychology, TU Darmstadt, Darmstadt, Germany
2 shared publications - Manish Singh
Rutgers University
2 shared publications
Latest Publications
- Open Access
- 1 December 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (14) , 22
Line drawings as a tool to probe edge sensitivity in natural scenes
To interact with the world effectively, the human visual system must extract meaningful features from visual scenes. One key feature are edges, luminance or texture discontinuities in two-dimensional (2D) images that often correspond to object boundaries in three-dimensional scenes. Edge sensitivity has traditionally been studied with well-controlled stimuli and binary choice tasks, but it is unclear how well these insights transfer to real-world behavior. Recent studies have extended this approach using natural images but typically retained binary button presses. In this study, we extend the approach further and ask observers (N = 20) to trace edges in natural scenes, presented with or without 2D visual noise. To quantify edge detection performance, we use a signal detection theory-inspired approach. Participants' edge traces in the noise-free condition serve as an individualized "ground-truth" or signal, used to categorize edge traces from noise conditions into hits, false alarms, misses, and correct rejections. Observers produce remarkably consistent edge traces across conditions. Noise interference patterns mirror results from traditional edge sensitivity studies, especially for edges with spectral properties similar to natural scenes. This suggests that insights from controlled paradigms can transfer to naturalistic ones. We also examined edge traces to identify which image features drive edge perception, using interindividual variability as a pointer to relevant features. We conclude that line drawings are a powerful tool to investigate edge sensitivity and potentially other aspects of visual perception, enabling nuanced exploration of real-world visual behavior with few experimental trials.
- 1 December 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (14) , 22
Open AccessLine drawings as a tool to probe edge sensitivity in natural scenes
To interact with the world effectively, the human visual system must extract meaningful features from visual scenes. One key feature are edges, luminance or texture discontinuities in two-dimensional (2D) images that often correspond to object boundaries in three-dimensional scenes. Edge sensitivity has traditionally been studied with well-controlled stimuli and binary choice tasks, but it is unclear how well these insights transfer to real-world behavior. Recent studies have extended this approach using natural images but typically retained binary button presses. In this study, we extend the approach further and ask observers (N = 20) to trace edges in natural scenes, presented with or without 2D visual noise. To quantify edge detection performance, we use a signal detection theory-inspired approach. Participants' edge traces in the noise-free condition serve as an individualized "ground-truth" or signal, used to categorize edge traces from noise conditions into hits, false alarms, misses, and correct rejections. Observers produce remarkably consistent edge traces across conditions. Noise interference patterns mirror results from traditional edge sensitivity studies, especially for edges with spectral properties similar to natural scenes. This suggests that insights from controlled paradigms can transfer to naturalistic ones. We also examined edge traces to identify which image features drive edge perception, using interindividual variability as a pointer to relevant features. We conclude that line drawings are a powerful tool to investigate edge sensitivity and potentially other aspects of visual perception, enabling nuanced exploration of real-world visual behavior with few experimental trials.
- Open Access
- 1 July 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (8) , 17
Ocular drift shakes the stationary view on pattern vision
The mechanisms by which the visual system extracts key features (i.e., edges) from the visual input remain not fully understood. As reflected in the term spatial vision, pattern vision is traditionally assumed to operate on stationary visual inputs. However, our eyes are never truly still. Involuntary eye movements, specifically ocular drift, continuously alter the visual input during fixations and redistribute its power, emphasizing high spatial frequency contents. In this study, we examine the role of ocular drift on edge sensitivity in noise. We show that drift-induced shifts in stimulus power lead to better predictions of the empirical data, consistent with the human contrast sensitivity function. We then incorporate drift into a mechanistic model of spatial vision to test whether this further improves model predictions. Surprisingly, the original spatial model outperforms the drift-enhanced version. It does so in an interesting way: It artificially compensates for the absence of drift by redistributing the activity across its spatial frequency channels in later processing stages, effectively mimicking the effect of a dynamic input without explicitly modeling it. By contrast, a simpler model with a single spatial frequency channel benefits from drift but performs poorly when drift is removed. These findings suggest that standard model architectures inherently favor a stationary view of visual processing, which could result in self-confirming theories. Incorporating the dynamic nature of the visual input may offer a more accurate model of how the brain processes key features of natural scenes. However, doing so requires a critical reassessment of long-standing frameworks in visual neuroscience.
- 1 July 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (8) , 17
Open AccessOcular drift shakes the stationary view on pattern vision
The mechanisms by which the visual system extracts key features (i.e., edges) from the visual input remain not fully understood. As reflected in the term spatial vision, pattern vision is traditionally assumed to operate on stationary visual inputs. However, our eyes are never truly still. Involuntary eye movements, specifically ocular drift, continuously alter the visual input during fixations and redistribute its power, emphasizing high spatial frequency contents. In this study, we examine the role of ocular drift on edge sensitivity in noise. We show that drift-induced shifts in stimulus power lead to better predictions of the empirical data, consistent with the human contrast sensitivity function. We then incorporate drift into a mechanistic model of spatial vision to test whether this further improves model predictions. Surprisingly, the original spatial model outperforms the drift-enhanced version. It does so in an interesting way: It artificially compensates for the absence of drift by redistributing the activity across its spatial frequency channels in later processing stages, effectively mimicking the effect of a dynamic input without explicitly modeling it. By contrast, a simpler model with a single spatial frequency channel benefits from drift but performs poorly when drift is removed. These findings suggest that standard model architectures inherently favor a stationary view of visual processing, which could result in self-confirming theories. Incorporating the dynamic nature of the visual input may offer a more accurate model of how the brain processes key features of natural scenes. However, doing so requires a critical reassessment of long-standing frameworks in visual neuroscience.
- Open Access
- 2 January 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (1) , 12
Estimating the contribution of early and late noise in vision from psychophysical data
Human performance in psychophysical detection and discrimination tasks is limited by inner noise. It is unclear to what extent this inner noise arises from early noise (e.g., in the photoreceptors) or from late noise (at or immediately prior to the decision stage, presumably in cortex). Very likely, the behaviorally limiting inner noise is a nontrivial combination of both early and late noise. Here we propose a method to quantify the contributions of early and late noise purely from psychophysical data. Our approach generalizes classical results for linear systems by combining the theory of noise propagation through a nonlinear network with expressions to obtain a perceptual metric through a nonlinear network. We show that from threshold-only data, the relative contributions of early and late noise can only be disentangled when the experiments include substantial external noise. When full psychometric functions are available, early and late noise sources can be quantified even in the absence of external noise. Our psychophysical estimate of the magnitude of early noise—assuming a standard cascade of linear and nonlinear model stages—is substantially lower than the noise in cone photocurrents computed via an accurate model of retinal physiology, the ISETBio. This is consistent with the idea that one of the fundamental tasks of early vision is to reduce the comparatively large retinal noise.
- 2 January 2025
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 25 (1) , 12
Open AccessEstimating the contribution of early and late noise in vision from psychophysical data
Human performance in psychophysical detection and discrimination tasks is limited by inner noise. It is unclear to what extent this inner noise arises from early noise (e.g., in the photoreceptors) or from late noise (at or immediately prior to the decision stage, presumably in cortex). Very likely, the behaviorally limiting inner noise is a nontrivial combination of both early and late noise. Here we propose a method to quantify the contributions of early and late noise purely from psychophysical data. Our approach generalizes classical results for linear systems by combining the theory of noise propagation through a nonlinear network with expressions to obtain a perceptual metric through a nonlinear network. We show that from threshold-only data, the relative contributions of early and late noise can only be disentangled when the experiments include substantial external noise. When full psychometric functions are available, early and late noise sources can be quantified even in the absence of external noise. Our psychophysical estimate of the magnitude of early noise—assuming a standard cascade of linear and nonlinear model stages—is substantially lower than the noise in cone photocurrents computed via an accurate model of retinal physiology, the ISETBio. This is consistent with the idea that one of the fundamental tasks of early vision is to reduce the comparatively large retinal noise.
- Open Access
- 1 May 2024
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 24 (5) , 5
What Fechner could not do: Separating perceptual encoding and decoding with difference scaling
A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White’s effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.
- 1 May 2024
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 24 (5) , 5
Open AccessWhat Fechner could not do: Separating perceptual encoding and decoding with difference scaling
A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White’s effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.
- Open Access
- 11 July 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22 (8) , 5
Fixational eye movements enable robust edge detection
Human vision relies on mechanisms that respond to luminance edges in space and time. Most edge models use orientation-selective mechanisms on multiple spatial scales and operate on static inputs assuming that edge processing occurs within a single fixational instance. Recent studies, however, demonstrate functionally relevant temporal modulations of the sensory input due to fixational eye movements. Here we propose a spatiotemporal model of human edge detection that combines elements of spatial and active vision. The model augments a spatial vision model by temporal filtering and shifts the input images over time, mimicking an active sampling scheme via fixational eye movements. The first model test was White’s illusion, a lightness effect that has been shown to depend on edges. The model reproduced the spatial-frequency-specific interference with the edges by superimposing narrowband noise (1–5 cpd), similar to the psychophysical interference observed in White’s effect. Second, we compare the model’s edge detection performance in natural images in the presence and absence of Gaussian white noise with human-labeled contours for the same (noise-free) images. Notably, the model detects edges robustly against noise in both test cases without relying on orientation-selective processes. Eliminating model components, we demonstrate the relevance of multiscale spatiotemporal filtering and scale-specific normalization for edge detection. The proposed model facilitates efficient edge detection in (artificial) vision systems and challenges the notion that orientation-selective mechanisms are required for edge detection.
- 11 July 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22 (8) , 5
Open AccessFixational eye movements enable robust edge detection
Human vision relies on mechanisms that respond to luminance edges in space and time. Most edge models use orientation-selective mechanisms on multiple spatial scales and operate on static inputs assuming that edge processing occurs within a single fixational instance. Recent studies, however, demonstrate functionally relevant temporal modulations of the sensory input due to fixational eye movements. Here we propose a spatiotemporal model of human edge detection that combines elements of spatial and active vision. The model augments a spatial vision model by temporal filtering and shifts the input images over time, mimicking an active sampling scheme via fixational eye movements. The first model test was White’s illusion, a lightness effect that has been shown to depend on edges. The model reproduced the spatial-frequency-specific interference with the edges by superimposing narrowband noise (1–5 cpd), similar to the psychophysical interference observed in White’s effect. Second, we compare the model’s edge detection performance in natural images in the presence and absence of Gaussian white noise with human-labeled contours for the same (noise-free) images. Notably, the model detects edges robustly against noise in both test cases without relying on orientation-selective processes. Eliminating model components, we demonstrate the relevance of multiscale spatiotemporal filtering and scale-specific normalization for edge detection. The proposed model facilitates efficient edge detection in (artificial) vision systems and challenges the notion that orientation-selective mechanisms are required for edge detection.
- Open Access
- 1 February 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22 (2) , 2
Conjoint measurement of perceived transparency and perceived contrast in variegated checkerboards
One fundamental question in vision research is how the retinal input is segmented into perceptually relevant variables. A striking example of this segmentation process is transparency perception, in which luminance information in one location contributes to two perceptual variables: the properties of the transparent medium itself and of what is being seen in the background. Previous work by Robilotto et al. (2002, 2004) suggested that perceived transparency is closely related to perceived contrast, but how these two relate to retinal luminance has not been established. Here we studied the relationship between perceived transparency, perceived contrast, and image luminance using maximum likelihood conjoint measurement (MLCM). Stimuli were rendered images of variegated checkerboards that were composed of multiple reflectances and partially covered by a transparent overlay. We systematically varied the transmittance and reflectance of the transparent medium and measured perceptual scales of perceived transparency. We also measured scales of perceived contrast using cut-outs of the transparency stimuli that did not contain any geometrical cues to transparency. Perceptual scales for perceived transparency and contrast followed a remarkably similar pattern across observers. We tested the empirically observed scales against predictions from various contrast metrics and found that perceived transparency and perceived contrast were equally well predicted by a metric based on the logarithm of Michelson or Whittle contrast. We conclude that judgments of perceived transparency and perceived contrast are likely to be supported by a common mechanism, which can be computationally captured as a logarithmic contrast.
- 1 February 2022
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 22 (2) , 2
Open AccessConjoint measurement of perceived transparency and perceived contrast in variegated checkerboards
One fundamental question in vision research is how the retinal input is segmented into perceptually relevant variables. A striking example of this segmentation process is transparency perception, in which luminance information in one location contributes to two perceptual variables: the properties of the transparent medium itself and of what is being seen in the background. Previous work by Robilotto et al. (2002, 2004) suggested that perceived transparency is closely related to perceived contrast, but how these two relate to retinal luminance has not been established. Here we studied the relationship between perceived transparency, perceived contrast, and image luminance using maximum likelihood conjoint measurement (MLCM). Stimuli were rendered images of variegated checkerboards that were composed of multiple reflectances and partially covered by a transparent overlay. We systematically varied the transmittance and reflectance of the transparent medium and measured perceptual scales of perceived transparency. We also measured scales of perceived contrast using cut-outs of the transparency stimuli that did not contain any geometrical cues to transparency. Perceptual scales for perceived transparency and contrast followed a remarkably similar pattern across observers. We tested the empirically observed scales against predictions from various contrast metrics and found that perceived transparency and perceived contrast were equally well predicted by a metric based on the logarithm of Michelson or Whittle contrast. We conclude that judgments of perceived transparency and perceived contrast are likely to be supported by a common mechanism, which can be computationally captured as a logarithmic contrast.
- Open Access
- 9 April 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (4) , 19
Toward reliable measurements of perceptual scales in multiple contexts
A central question in psychophysical research is how perceptual differences between stimuli translate into physical differences and vice versa. Characterizing such a psychophysical scale would reveal how a stimulus is converted into a perceptual event, particularly under changes in viewing conditions (e.g., illumination). Various methods exist to derive perceptual scales, but in practice, scale estimation is often bypassed by assessing appearance matches. Matches, however, only reflect the underlying perceptual scales but do not reveal them directly. Two recently developed methods, MLDS (Maximum Likelihood Difference Scaling) and MLCM (Maximum Likelihood Conjoint Measurement), promise to reliably estimate perceptual scales. Here we compared both methods in their ability to estimate perceptual scales across context changes in the domain of lightness perception. In simulations, we adopted a lightness constant, a contrast, and a luminance-based observer model to generate differential patterns of perceptual scales. MLCM correctly recovered all models. MLDS correctly recovered only the lightness constant observer model. We also empirically probed both methods with two types of stimuli: (a) variegated checkerboards that support lightness constancy and (b) center-surround stimuli that do not support lightness constancy. Consistent with the simulations, MLDS and MLCM provided similar scale estimates in the first case and divergent estimates in the second. In addition, scales from MLCM–and not from MLDS–accurately predicted asymmetric matches for both types of stimuli. Taking experimental and simulation results together, MLCM seems more apt to provide a valid estimate of the perceptual scales underlying judgments of lightness across viewing conditions.
- 9 April 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (4) , 19
Open AccessToward reliable measurements of perceptual scales in multiple contexts
A central question in psychophysical research is how perceptual differences between stimuli translate into physical differences and vice versa. Characterizing such a psychophysical scale would reveal how a stimulus is converted into a perceptual event, particularly under changes in viewing conditions (e.g., illumination). Various methods exist to derive perceptual scales, but in practice, scale estimation is often bypassed by assessing appearance matches. Matches, however, only reflect the underlying perceptual scales but do not reveal them directly. Two recently developed methods, MLDS (Maximum Likelihood Difference Scaling) and MLCM (Maximum Likelihood Conjoint Measurement), promise to reliably estimate perceptual scales. Here we compared both methods in their ability to estimate perceptual scales across context changes in the domain of lightness perception. In simulations, we adopted a lightness constant, a contrast, and a luminance-based observer model to generate differential patterns of perceptual scales. MLCM correctly recovered all models. MLDS correctly recovered only the lightness constant observer model. We also empirically probed both methods with two types of stimuli: (a) variegated checkerboards that support lightness constancy and (b) center-surround stimuli that do not support lightness constancy. Consistent with the simulations, MLDS and MLCM provided similar scale estimates in the first case and divergent estimates in the second. In addition, scales from MLCM–and not from MLDS–accurately predicted asymmetric matches for both types of stimuli. Taking experimental and simulation results together, MLCM seems more apt to provide a valid estimate of the perceptual scales underlying judgments of lightness across viewing conditions.
- Open Access
- 6 September 2019
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 19 (10) , 242a
Perceived transmittance and perceived contrast in variegated checkerboards
We examine the question whether physically different transparent media can be meaningfully mapped onto one perceptual dimension of perceived transmittance (Robilotto and Zaidi, 2004). We rendered images of variegated checkerboards that are composed of checks of varying reflectances. Part of the checkerboard was covered by a transparent medium that varied in reflectance and transmittance. We used Maximum Likelihood Conjoint Measurement (MLCM) to derive perceptual scales of perceived transmittance for different transparent media. In a single trial we presented two checkerboards next to each other that were identical except for the region covered by the transparent medium. Observers’ task was to judge which of the two media was more transparent. We estimated four scales of perceived transmittance for four different transmittance values. The scale values of each scale decreased monotonically with increasing reflectance of the transparent medium. All observers show a perceptual trade-off between the two physical parameters indicating perceptual equality of transparent media with different transmittance and reflectance. Scales in different conditions were captured surprisingly well by the logarithm of the root-mean-square contrast of luminances within the area of transparency. In a second part of the experiment we presented observers with the same stimuli but reduced to the area of transparency. These stimuli varied in mean luminance and in contrast, but all cues to transparent overlay were eliminated. Observers judged which of the two stimuli had higher perceived contrast. The scales derived for the reduced stimuli were identical to those observed with the full stimuli, indicating that perceptual judgments of perceived transparency and perceived contrast rely on the same mechanism also in more complex images such as the ones used here.
- 6 September 2019
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 19 (10) , 242a
Open AccessPerceived transmittance and perceived contrast in variegated checkerboards
We examine the question whether physically different transparent media can be meaningfully mapped onto one perceptual dimension of perceived transmittance (Robilotto and Zaidi, 2004). We rendered images of variegated checkerboards that are composed of checks of varying reflectances. Part of the checkerboard was covered by a transparent medium that varied in reflectance and transmittance. We used Maximum Likelihood Conjoint Measurement (MLCM) to derive perceptual scales of perceived transmittance for different transparent media. In a single trial we presented two checkerboards next to each other that were identical except for the region covered by the transparent medium. Observers’ task was to judge which of the two media was more transparent. We estimated four scales of perceived transmittance for four different transmittance values. The scale values of each scale decreased monotonically with increasing reflectance of the transparent medium. All observers show a perceptual trade-off between the two physical parameters indicating perceptual equality of transparent media with different transmittance and reflectance. Scales in different conditions were captured surprisingly well by the logarithm of the root-mean-square contrast of luminances within the area of transparency. In a second part of the experiment we presented observers with the same stimuli but reduced to the area of transparency. These stimuli varied in mean luminance and in contrast, but all cues to transparent overlay were eliminated. Observers judged which of the two stimuli had higher perceived contrast. The scales derived for the reduced stimuli were identical to those observed with the full stimuli, indicating that perceptual judgments of perceived transparency and perceived contrast rely on the same mechanism also in more complex images such as the ones used here.
- 29 January 2017
- Published by Society for Imaging Science & Technology in Electronic Imaging
- Vol. 29 (14) , 36-45
Methods and measurements to compare men against machines
Recent advances in computational models in vision science have considerably furthered our understanding of human visual perception. At the same time, rapid advances in convolutional deep neural networks (DNNs) have resulted in computer vision models of object recognition which, for the first time, rival human object recognition. Furthermore, it has been suggested that DNNs may not only be successful models for computer vision, but may also be good computational models of the monkey and human visual systems. The advances in computational models in both vision science and computer vision pose two challenges in two different and independent domains: First, because the latest computational models have much higher predictive accuracy, and competing models may make similar predictions, we require more human data to be able to statistically distinguish between different models. Thus we would like to have methods to acquire trustworthy human behavioural data fast and easy. Second, we need challenging experiments to ascertain whether models show similar input-output behaviour only near "ceiling" performance, or whether their performance degrades similar to human performance: only then do we have strong evidence that models and human observers may be using similar features and processing strategies. In this paper we address both challenges.
- 29 January 2017
- Published by Society for Imaging Science & Technology in Electronic Imaging
- Vol. 29 (14) , 36-45
Methods and measurements to compare men against machines
Recent advances in computational models in vision science have considerably furthered our understanding of human visual perception. At the same time, rapid advances in convolutional deep neural networks (DNNs) have resulted in computer vision models of object recognition which, for the first time, rival human object recognition. Furthermore, it has been suggested that DNNs may not only be successful models for computer vision, but may also be good computational models of the monkey and human visual systems. The advances in computational models in both vision science and computer vision pose two challenges in two different and independent domains: First, because the latest computational models have much higher predictive accuracy, and competing models may make similar predictions, we require more human data to be able to statistically distinguish between different models. Thus we would like to have methods to acquire trustworthy human behavioural data fast and easy. Second, we need challenging experiments to ascertain whether models show similar input-output behaviour only near "ceiling" performance, or whether their performance degrades similar to human performance: only then do we have strong evidence that models and human observers may be using similar features and processing strategies. In this paper we address both challenges.
- Open Access
- 1 September 2016
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 16 (11) , 17
Testing the role of Michelson contrast for the perception of surface lightness
It is still an unresolved question how the visual system perceives surface lightness given the ambiguity of the sensory input signal. We studied lightness perception using two-dimensional images of variegated checkerboards shown as perspective projections of three-dimensional objects. We manipulated the contrast of a target check relative to its surround either by rendering the image under different viewing conditions or by introducing noncoincidental changes of the reflectance of the surfaces adjacent to the target. We examined the predictive power of the normalized contrast model (Zeiner & Maertens, 2014) for the different viewing conditions (plain view vs. dark and light transparency) as well as for the noncoincidental surround changes (only high or only low reflectances in the surround). The model accounted for lightness matches across different viewing conditions but not for the surround changes. The observed simultaneous contrast effects were smaller than what would be predicted by the model. We evaluated two model extensions that—both relying on contrast—predicted the observed data well. Both model extensions point to the importance of contrast statistics across space and/or time for the computation of lightness, but it awaits future testing to evaluate whether and how the visual system could represent such statistics.
- 1 September 2016
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 16 (11) , 17
Open AccessTesting the role of Michelson contrast for the perception of surface lightness
It is still an unresolved question how the visual system perceives surface lightness given the ambiguity of the sensory input signal. We studied lightness perception using two-dimensional images of variegated checkerboards shown as perspective projections of three-dimensional objects. We manipulated the contrast of a target check relative to its surround either by rendering the image under different viewing conditions or by introducing noncoincidental changes of the reflectance of the surfaces adjacent to the target. We examined the predictive power of the normalized contrast model (Zeiner & Maertens, 2014) for the different viewing conditions (plain view vs. dark and light transparency) as well as for the noncoincidental surround changes (only high or only low reflectances in the surround). The model accounted for lightness matches across different viewing conditions but not for the surround changes. The observed simultaneous contrast effects were smaller than what would be predicted by the model. We evaluated two model extensions that—both relying on contrast—predicted the observed data well. Both model extensions point to the importance of contrast statistics across space and/or time for the computation of lightness, but it awaits future testing to evaluate whether and how the visual system could represent such statistics.