JWJohn Wilder

John Wilder

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


John Wilder has a total of 24 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Shape-Based Measures Improve Scene Categorization

    by Morteza Rezanejad, John Wilder, Dirk B. Walther, Allan D. Jepson, Sven Dickinson, Kaleem Siddiqi

    Converging evidence indicates that deep neural network models that are trained on large datasets are biased toward color and texture information. Humans, on the other hand, can easily recognize objects and scenes from images as well as from bounding contours. Mid-level vision is characterized by the recombination and organization of simple primary features into more complex ones by a set of so-called Gestalt grouping rules. While described qualitatively in the human literature, a computational implementation of these perceptual grouping rules is so far missing. In this article, we contribute a novel set of algorithms for the detection of contour-based cues in complex scenes. We use the medial axis transform (MAT) to locally score contours according to these grouping rules. We demonstrate the benefit of these cues for scene categorization in two ways: (i) Both human observers and CNN models categorize scenes most accurately when perceptual grouping information is emphasized. (ii) Weighting the contours with these measures boosts performance of a CNN model significantly compared to the use of unweighted contours. Our work suggests that, even though these measures are computed directly from contours in the image, current CNN models do not appear to extract or utilize these grouping cues.


  • Open Access

    Neural correlates of local parallelism during naturalistic vision

    by John Wilder, Morteza Rezanejad, Sven Dickinson, Kaleem Siddiqi, Allan Jepson, Dirk B. Walther

    Human observers can rapidly perceive complex real-world scenes. Grouping visual elements into meaningful units is an integral part of this process. Yet, so far, the neural underpinnings of perceptual grouping have only been studied with simple lab stimuli. We here uncover the neural mechanisms of one important perceptual grouping cue, local parallelism. Using a new, image-computable algorithm for detecting local symmetry in line drawings and photographs, we manipulated the local parallelism content of real-world scenes. We decoded scene categories from patterns of brain activity obtained via functional magnetic resonance imaging (fMRI) in 38 human observers while they viewed the manipulated scenes. Decoding was significantly more accurate for scenes containing strong local parallelism compared to weak local parallelism in the parahippocampal place area (PPA), indicating a central role of parallelism in scene perception. To investigate the origin of the parallelism signal we performed a model-based fMRI analysis of the public BOLD5000 dataset, looking for voxels whose activation time course matches that of the locally parallel content of the 4916 photographs viewed by the participants in the experiment. We found a strong relationship with average local symmetry in visual areas V1-4, PPA, and retrosplenial cortex (RSC). Notably, the parallelism-related signal peaked first in V4, suggesting V4 as the site for extracting paralleism from the visual input. We conclude that local parallelism is a perceptual grouping cue that influences neuronal activity throughout the visual hierarchy, presumably starting at V4. Parallelism plays a key role in the representation of scene categories in PPA.


  • Open Access

    Effects of Spatial Frequency Filtering Choices on the Perception of Filtered Images

    by Sabrina Perfetto, John Wilder, Dirk B. Walther

    The early visual system is composed of spatial frequency-tuned channels that break an image into its individual frequency components. Therefore, researchers commonly filter images for spatial frequencies to arrive at conclusions about the differential importance of high versus and low spatial frequency image content. Here, we show how simple decisions about the filtering of the images, and how they are displayed on the screen, can result in drastically different behavioral outcomes. We show that jointly normalizing the contrast of the stimuli is critical in order to draw accurate conclusions about the influence of the different spatial frequencies, as images of the real world naturally have higher contrast energy at low than high spatial frequencies. Furthermore, the specific choice of filter shape can result in contradictory results about whether high or low spatial frequencies are more useful for understanding image content. Finally, we show that the manner in which the high spatial frequency content is displayed on the screen influences how recognizable an image is. Previous findings that make claims about the visual system’s use of certain spatial frequency bands should be revisited, especially if their methods sections do not make clear what filtering choices were made.


  • Open Access

    The neural basis of local contour symmetry in scene perception

    by John D Wilder, Morteza Rezanejad, Kaleem Siddiqi, Allan Jepson, Sven Dickinson, Dirk B Walther

    The visual system is tasked with turning light impinging onto our retinas into meaningful percepts. Providing a strong cue to the presence of objects and surfaces, symmetry is one of the Gestalt principles underlying the grouping of visual information in mid-level vision. In fact, it has recently been demonstrated that there is a perceptual advantage for symmetry for the perception of complex real-world scenes. Here we uncover the neural basis of the perceptual advantage of symmetry. Specifically, we show how local contour symmetry modulates neural activity patterns elicited by complex scenes throughout visual cortex. Participants were shown full, intact line drawings of scenes as well as line drawings containing the most symmetric/asymmetric half of the contour pixels. We decoded scene categories from the voxel activity in early visual cortex as well as high-level, scene-selective brain regions. Decoding of scene categories was more accurate in the symmetric than the asymmetric condition in PPA, OPA, and LOC. In areas V1–4, on the other hand, scene categories were more accurately decoded in the asymmetric than the symmetric condition. A searchlight analysis yielded consistent results, showing that mid- and high-level areas show higher decoding accuracy in the symmetric condition, while the opposite is true for early visual cortex. Our results indicate a crucial role for symmetry in grouping visual information into meaningful units for high-level processing. In fact, our findings in high-level regions mirror the perceptual advantage of symmetry in behavioral categorization performance. Early visual cortex, on the other hand, does not appear to benefit from local symmetry as a grouping cue. On the contrary, the information redundancy inherent to symmetry leads to lower fidelity of the category-specific signal in V1–4. In summary, we here demonstrate the emergence of symmetry as a mid-level grouping cue for real-world scenes along the visual processing hierarchy.

  • Open Access

    Shape from shading under inconsistent illumination

    by John D. Wilder, Wendy J. Adams, Richard F. Murray

    People are able to perceive the 3D shape of illuminated surfaces using image shading cues. Theories about how we accomplish this often assume that the human visual system estimates a single lighting direction and interprets shading cues in accord with that estimate. In natural scenes, however, lighting can be much more complex than this, with multiple nearby light sources. Here we show that the human visual system can successfully judge 3D surface shape even when the lighting direction varies from place to place over a surface, provided the scale at which these lighting changes occur is similar to, or larger than, the size of the shape features being judged. Furthermore, we show that despite being able to accommodate rapid changes in lighting direction when judging shape, observers are generally unable to detect these changes. We conclude that, rather than relying on a single estimated illumination direction, the human visual system can accommodate illumination that varies substantially and rapidly across a surface.


  • Local contour symmetry facilitates scene categorization

    by John Wilder, Morteza Rezanejad, Sven Dickinson, Kaleem Siddiqi, Allan Jepson, Dirk B. Walther


  • Open Access

    Category-specific guidance of gaze in photographs and line drawings

    by Claudia Damiano, John Wilder, Dirk Walther

    Our group has previously shown that scene content can be predicted from eye movements observers make when viewing colour photographs. The time course of category predictions reveals differential contributions of bottom-up and top-down processes at different viewing times. Here, we use these known differences in order to determine when and to what extent image features at different representational levels contribute toward guiding gaze in a content-specific manner. 77 participants viewed grayscale photographs and line drawings of real-world scenes. In a leave-one-subject-out cross validation analysis, scene categories were predicted from gaze patterns over a 2-second time course. Scene categories could be predicted from gaze at all times in both photographs (average accuracy = 31.4%, chance = 16.7%, p < 0.0001) and line drawings (30.0%, p < 0.0001). We also replicate the time course, with an initial steep decrease in prediction accuracy from 300ms to 500ms, representing the contribution of bottom-up information, followed by a steady increase, representing top-down knowledge of category-specific information. Using DeepGaze II as the leading model of salience, we reconfirm a strong early contribution of bottom-up effects in grayscale photographs. We computed the low-level (luminance contrasts and orientation statistics) and mid-level features (local symmetry and contour junctions) from the images in order assess their differential contributions to content-specific guidance of gaze. For photographs, we find qualitatively similar contributions of these representational levels, contributing mostly to the initial bottom-up peak. For line drawings of the same scenes, we observe that mid-level features that describe scene structure (symmetry and junctions) play a more prominent role in the top-down guidance of gaze. Thus, we show that bottom-up information contributes less to gaze behaviour for line drawings than for photographs, and that structural features increasingly guide category-specific gaze when images are reduced to line drawings. Meeting abstract presented at VSS 2018

  • Open Access

    Nonlinear visual mechanisms for 2D shape discrimination with pose uncertainty

    by Ingo Fruend, John Wilder, James Elder

    Humans are very good at recognizing objects from just their 2D outlines. Previous work has modeled discrimination as correlation, using linear systems identification methods to identify internal shape templates (Kurki et al, 2014, JOV; Wilder et al, 2015, Perception). However, Wilder et al. also noted evidence for nonlinearities in human shape discrimination that are not accounted for by the linear correlation model. One function of these nonlinearities may be to extract high-frequency shape information despite pose uncertainty. To test this hypothesis, we reconsider the experiment conducted by Wilder et al. in which human observers discriminated between shapes corrupted with additive Gaussian coordinate noise. A linear model that assumes no internal pose uncertainty can be estimated from these data and 56% of the variance of human responses. If the linear model is forced to account for a large degree of internal pose uncertainty (up to 40% in-plane rotation), explained variance drops to 36% and is only marginally better than chance. However, a deep neural network (DNN) model trained on the human responses completely recovers this lost variance. By analyzing the gradient of the DNN output with respect to the input, we show that the DNN model achieves this by undoing these random internal pose variations to yield a shape representation that is roughly pose invariant. Most importantly, these gradients also show a sensitivity to higher shape frequencies that is not revealed by linear systems identification methods. A DNN model reveals nonlinearities in human shape discrimination. These nonlinearities allow higher shape frequencies to be used for shape discrimination despite substantial amounts of internal pose uncertainty. Meeting abstract presented at VSS 2018