Frank Schumann

Processing differences between foveal and peripheral vision mean that the location of objects in the visual field can strongly influence the way we experience them. The contents of visual awareness are believed to arise from interactions between sensory stimulation and context (e.g., expectations formed by recent experience), but the effect of visual field location on these interactions remains unclear. Here, we compared the effects of recent experience on awareness at fixation versus the periphery. On each trial, observers saw a brief display of an unambiguously rotating structure-from-motion prime sphere, followed by a brief display of a probe sphere with ambiguous motion. Experiment 1 established that conscious perception of the motion direction of the probe was more likely to differ from the prime when the stimuli were presented in the periphery compared with fixation. Experiment 2 ruled out a high-level, non-retinotopic, precision-weighting account of this effect by demonstrating that, although priming was apparent when the stimulus moved from fixation to periphery or vice versa, its magnitude was the same for low-precision peripheral and high-precision fixated primes. Experiment 3 replicated the original location effect and also found stronger motion adaptation in the periphery; the effects were not correlated, though, indicating that motion adaptation cannot account for the location effect. Experiment 4 replicated the location effect again and ruled out differences in fixation stability as the underlying mechanism. Overall, our results demonstrate a robust effect of visual field location on the integration of recent visual experience during construction of perceptual awareness and highlight the need to elucidate the mechanisms underlying differential generation of visual experience across the visual field.

Processing differences between foveal and peripheral vision mean that the location of objects in the visual field can strongly influence the way we experience them. The contents of visual awareness are believed to arise from interactions between sensory stimulation and context (e.g., expectations formed by recent experience), but the effect of visual field location on these interactions remains unclear. Here, we compared the effects of recent experience on awareness at fixation versus the periphery. On each trial, observers saw a brief display of an unambiguously rotating structure-from-motion prime sphere, followed by a brief display of a probe sphere with ambiguous motion. Experiment 1 established that conscious perception of the probe’s motion direction was more likely to differ from the prime when the stimuli were presented in the periphery compared to fixation. Experiment 2 ruled out a high-level, non-retinotopic precision-weighting account of this effect, by demonstrating that although priming was apparent when the stimulus moved from fixation to periphery or vice versa, its magnitude was the same for low-precision peripheral and high-precision fixated primes. Experiment 3 replicated the original location effect, and also found stronger motion adaptation in the periphery; the effects were not correlated, though, indicating that motion adaptation cannot account for the location effect. Experiment 4 replicated the location effect again, and ruled out differences in fixation stability as the underlying mechanism. Overall, our results demonstrate a robust effect of visual field location on the integration of recent visual experience during construction of perceptual awareness, and highlight the need to elucidate the mechanisms underlying differential generation of visual experience across the visual field.

This study investigated the potential for the development of a new perceptual experience through sustained training with a sensory augmentation device. For this purpose, we developed (1) a new sensory augmentation device, the NaviEar, and (2) a battery of tests for automaticity in the use of the device. The NaviEar translates cardinal direction into sound. Because the signal of this device is comparatively simple and easy to interpret it should facilitate automatization of use. The test battery assesses different effects of automaticity (interference, rigidity of responses, dynamic integration) assuming that automaticity is a necessary criterion to show the emergence of perceptual feel, i.e. the sensory quality of a percept. We measured performance in simple training tasks, administered the tests for automaticity, and assessed subjective reports through a questionnaire. Results suggest that the NaviEar is easy and comfortable to use and has a potential for applications in real-world situations; but 5-day training with the NaviEar does not reach levels of automaticity that are indicative of perceptual feel. We propose that the test battery for automaticity may be used as a benchmark test for the possibility of perceptual feel in sensory augmentation and in sensory substitution.

Bodily movement has long been employed as a foundation for cultivating mental skills such as attention, self-control or mindfulness, with recent studies documenting the positive impacts of mindful movement training, such as yoga and tai chi. A parallel “mind-body connection” has also been observed in many developmental disorders. We elaborate a spectrum of mindfulness by considering ADHD, in which deficient motor control correlates with impaired (disinhibited) behavioral control contributing to defining features of excessive distractibility and impulsivity. These data provide evidence for an important axis of variation for wellbeing, in which skillful cognitive control covaries with a capacity for skillful movement. We review empirical and theoretical literature on attention, cognitive control, mind wandering, mindfulness and skill learning, endorsing a model of skilled attention in which motor plans, attention, and executive goals are seen as mutually co-defining aspects of skilled behavior that are linked by reciprocal inhibitory and excitatory connections. Thus, any movement training should engage “higher-order” inhibition and selection and develop a repertoire of rehearsed procedures that coordinate goals, attention and motor plans. However, we propose that mindful movement practice may improve the functional quality of rehearsed procedures, cultivating a transferrable skill of attention. We adopt Langer’s spectrum of mindful learning that spans from “mindlessness” to engagement with the details of the present task and contrast this with the mental attitudes cultivated in standard mindfulness meditation. We particularly follow Feldenkrais’ suggestion that mindful learning of skills for organizing the body in movement might transfer to other forms of mental activity. The results of mindful movement training should be observed in multiple complementary measures, and may have tremendous potential benefit for individuals with ADHD and other populations.

Bio-mimetic approaches to restoring sensory function show great promise in that they rapidly produce perceptual experience, but have the disadvantage of being invasive. In contrast, sensory substitution approaches are non-invasive, but may lead to cognitive rather than perceptual experience. Here we introduce a new non-invasive approach that leads to fast and truly perceptual experience like bio-mimetic techniques. Instead of building on existing circuits at the neural level as done in bio-mimetics, we piggy-back on sensorimotor contingencies at the stimulus level. We convey head orientation to geomagnetic North, a reliable spatial relation not normally sensed by humans, by mimicking sensorimotor contingencies of distal sounds via head-related transfer functions. We demonstrate rapid and long-lasting integration into the perception of self-rotation. Short training with amplified or reduced rotation gain in the magnetic signal can expand or compress the perceived extent of vestibular self-rotation, even with the magnetic signal absent in the test. We argue that it is the reliability of the magnetic signal that allows vestibular spatial recalibration, and the coding scheme mimicking sensorimotor contingencies of distal sounds that permits fast integration. Hence we propose that contingency-mimetic feedback has great potential for creating sensory augmentation devices that achieve fast and genuinely perceptual experiences.

Theories of embodied cognition propose that perception is shaped by sensory stimuli and by the actions of the organism. Following sensorimotor contingency theory, the mastery of lawful relations between own behavior and resulting changes in sensory signals, called sensorimotor contingencies, is constitutive of conscious perception. Sensorimotor contingency theory predicts that, after training, knowledge relating to new sensorimotor contingencies develops, leading to changes in the activation of sensorimotor systems, and concomitant changes in perception. In the present study, we spell out this hypothesis in detail and investigate whether it is possible to learn new sensorimotor contingencies by sensory augmentation. Specifically, we designed an fMRI compatible sensory augmentation device, the feelSpace belt, which gives orientation information about the direction of magnetic north via vibrotactile stimulation on the waist of participants. In a longitudinal study, participants trained with this belt for seven weeks in natural environment. Our EEG results indicate that training with the belt leads to changes in sleep architecture early in the training phase, compatible with the consolidation of procedural learning as well as increased sensorimotor processing and motor programming. The fMRI results suggest that training entails activity in sensory as well as higher motor centers and brain areas known to be involved in navigation. These neural changes are accompanied with changes in how space and the belt signal are perceived, as well as with increased trust in navigational ability. Thus, our data on physiological processes and subjective experiences are compatible with the hypothesis that new sensorimotor contingencies can be acquired using sensory augmentation.

Bodily movement has long been employed as a foundation for cultivating mental skills such as attention, self-control or mindfulness, with recent studies documenting the positive impacts of mindful movement training, such as yoga and tai chi. A parallel “mind-body connection” has also been observed in many developmental disorders. We elaborate a spectrum of mindfulness by considering ADHD, in which deficient motor control correlates with impaired (disinhibited) behavioral control contributing to defining features of excessive distractibility and impulsivity. These data provide evidence for an important axis of variation for wellbeing, in which skillful cognitive control covaries with a capacity for skillful movement. We review empirical and theoretical literature on attention, cognitive control, mind wandering, mindfulness and skill learning, endorsing a model of skilled attention in which motor plans, attention, and executive goals are seen as mutually co-defining aspects of skilled behavior that are linked by reciprocal inhibitory and excitatory connections. Thus, any movement training should engage “higher-order” inhibition and selection and develop a repertoire of rehearsed procedures that coordinate goals, attention and motor plans. However, we propose that mindful movement practice may improve the functional quality of rehearsed procedures, cultivating a transferrable skill of attention. We adopt Langer’s spectrum of mindful learning that spans from “mindlessness” to engagement with the details of the present task and contrast this with the mental attitudes cultivated in standard mindfulness meditation. We particularly follow Feldenkrais’ suggestion that mindful learning of skills for organizing the body in movement might transfer to other forms of mental activity. The results of mindful movement training should be observed in multiple complementary measures, and may have tremendous potential benefit for individuals with ADHD and other populations.

We use functional magnetic resonance imaging to investigate short-term neural effects of a brief sensorimotor intervention adapted from the Feldenkrais method, a movement-based learning method. Twenty-one participants (10 men, 19-30 years) took part in the study. Participants were in a supine position in the scanner with extended legs while an experienced Feldenkrais practitioner used a planar board to touch and apply minimal force to different parts of the sole and toes of their left foot under two experimental conditions. In the local condition, the practitioner explored movement within foot and ankle. In the global condition, the practitioner focused on the connection and support from the foot to the rest of the body. Before (baseline) and after each intervention (post-local, post-global), we measured brain activity during intermittent pushing/releasing with the left leg and during resting state. Independent localizer tasks were used to identify regions of interest (ROI). Brain activity during left-foot pushing did not significantly differ between conditions in sensorimotor areas. Resting state activity (regional homogeneity, ReHo) increased from baseline to post-local in medial right motor cortex, and from baseline to post-global in the left supplementary/cingulate motor area. Contrasting post-global to post-local showed higher ReHo in right lateral motor cortex. ROI analyses showed significant increases in ReHo in pushing-related areas from baseline to both post-local and post-global, and this increase tended to be more pronounced post-local. The results of this exploratory study show that a short, non-intrusive sensorimotor intervention can have short-term effects on spontaneous cortical activity in functionally related brain regions. Increased resting state activity in higher-order motor areas supports the hypothesis that the global intervention engages action-related neural processes.

During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features.