Katsushi Arisaka
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Katsushi Arisaka has a total of 246 co-authors. Here are the top co-authors by number of shared publications:
- Aaron P. Blaisdell
Department of Psychology, University of California, Los Angeles, USA
5 shared publications - Elizabeth Mills
University of California, Los Angeles
5 shared publications - Javier Carmona
Department of Physics and Astronomy, University of California, Los Angeles, Los Angeles, CA 90095, USA
5 shared publications - Brian Ta
University of California, Los Angeles
4 shared publications - Patrick Wilson
University of California, Los Angeles
4 shared publications - Trevor McCarthy
University of California, Los Angeles
4 shared publications
Latest Publications
- Open Access
Multimodal immobilization of second-instar Drosophila melanogaster larvae using PF-127 hydrogel and diethyl ether for calcium imaging
Motion artifacts remain a barrier to in vivo calcium imaging in Drosophila melanogaster larvae. Here, we evaluate a multimodal immobilization approach that combines a Pluronic F-127 (PF-127) hydrogel with brief diethyl ether vapor exposure (5 minutes, 25°C) and compare it against hydrogel-only immobilization using custom MATLAB-based analysis software that performs NoRMCorre rigid motion correction. In wide-field GFP recordings at 1 Hz over approximately 60 minutes ( N = 15 per group), the multimodal condition significantly reduced motion across all three core metrics after FDR correction (all q < 0.001), with large effect sizes for mean speed (Hedges’ g = −1.18) and median step size ( g = −1.36). In a secondary analysis of the first 30 minutes, uniformly large effect sizes (| g | = 1.10–1.51) were observed, consistent with stronger initial chemical immobilization that partially wanes over the recording period. We implemented a dual-flag quality control system that distinguishes motion data reliability from ROI detection eligibility. Control calcium recordings (33.33 Hz, ∼5 minutes; N = 23) yielded 368 ROIs with a mean SNR 30.4 ± 16.9 and an event rate of 0.228 ± 0.113 Hz. Experimental recordings ( N = 21) yielded 295 ROIs with SNR 18.0 ± 10.6 and event rate 0.309 ± 0.188 Hz. SNR was higher in controls (Cliff’s δ = 0.50, p < 0.001), while event rate was modestly higher in the experimental group at the ROI level ( δ = −0.22, p < 0.001), though this difference did not reach significance at the sample level, suggesting altered but not suppressed calcium dynamics. These results support a practical, accessible immobilization workflow for larval calcium imaging. Highlights: Brief ether + hydrogel approach reduces larval motion 85–91% vs. hydrogel alone Dual-flag QC system separates motion reliability from calcium ROI eligibility Calcium event rates not suppressed under multimodal immobilization Complete MATLAB pipeline for motion analysis and calcium imaging provided Accessible protocol requires only standard laboratory supplies
Open AccessMultimodal immobilization of second-instar Drosophila melanogaster larvae using PF-127 hydrogel and diethyl ether for calcium imaging
Motion artifacts remain a barrier to in vivo calcium imaging in Drosophila melanogaster larvae. Here, we evaluate a multimodal immobilization approach that combines a Pluronic F-127 (PF-127) hydrogel with brief diethyl ether vapor exposure (5 minutes, 25°C) and compare it against hydrogel-only immobilization using custom MATLAB-based analysis software that performs NoRMCorre rigid motion correction. In wide-field GFP recordings at 1 Hz over approximately 60 minutes ( N = 15 per group), the multimodal condition significantly reduced motion across all three core metrics after FDR correction (all q < 0.001), with large effect sizes for mean speed (Hedges’ g = −1.18) and median step size ( g = −1.36). In a secondary analysis of the first 30 minutes, uniformly large effect sizes (| g | = 1.10–1.51) were observed, consistent with stronger initial chemical immobilization that partially wanes over the recording period. We implemented a dual-flag quality control system that distinguishes motion data reliability from ROI detection eligibility. Control calcium recordings (33.33 Hz, ∼5 minutes; N = 23) yielded 368 ROIs with a mean SNR 30.4 ± 16.9 and an event rate of 0.228 ± 0.113 Hz. Experimental recordings ( N = 21) yielded 295 ROIs with SNR 18.0 ± 10.6 and event rate 0.309 ± 0.188 Hz. SNR was higher in controls (Cliff’s δ = 0.50, p < 0.001), while event rate was modestly higher in the experimental group at the ROI level ( δ = −0.22, p < 0.001), though this difference did not reach significance at the sample level, suggesting altered but not suppressed calcium dynamics. These results support a practical, accessible immobilization workflow for larval calcium imaging. Highlights: Brief ether + hydrogel approach reduces larval motion 85–91% vs. hydrogel alone Dual-flag QC system separates motion reliability from calcium ROI eligibility Calcium event rates not suppressed under multimodal immobilization Complete MATLAB pipeline for motion analysis and calcium imaging provided Accessible protocol requires only standard laboratory supplies
- Open Access
Transverse Sheet Illumination Microscopy
Recording the neural activity of biological organisms is paramount in understanding how they process the world around them. Fluorescence microscopy has served as the standard in recording this neural activity due to its ability to capture large populations of neurons simultaneously. Recent efforts in fluorescence microscopy have been concentrated in imaging large scale volumes, however, most of these efforts have been limited by spatiotemporal and bandwidth constraints. We present a novel system called Transverse-Sheet Illumination Microscopy (TranSIM), which captures spatially separated planes onto multiple two-dimensional sCMOS sensors at near diffraction limited resolution with 1.0 µm, 1.4 µm, and 4.3 µm (x, y, and z respectively). The parallel use of sensors reduces the bandwidth bottlenecks typically found in other systems. TranSIM allows for the capturing of data at large-scale volumetric field-of-views up to 748 × 278 × 100 µm 3 at 100 Hz. Moreover, we were able to capture smaller field-of-views of 374 × 278 × 100 µm 3 at a faster volumetric rate of 200 Hz. Additionally, we found that the system’s versatile design allowed us the ability to change the vertical magnification programmatically rather than necessitating a change of objectives. With this system we were able to observe intricate communication between neuron populations separated by vast three-dimensional distances, raising the potential to answer complex questions in Neurobiology.
Open AccessTransverse Sheet Illumination Microscopy
Recording the neural activity of biological organisms is paramount in understanding how they process the world around them. Fluorescence microscopy has served as the standard in recording this neural activity due to its ability to capture large populations of neurons simultaneously. Recent efforts in fluorescence microscopy have been concentrated in imaging large scale volumes, however, most of these efforts have been limited by spatiotemporal and bandwidth constraints. We present a novel system called Transverse-Sheet Illumination Microscopy (TranSIM), which captures spatially separated planes onto multiple two-dimensional sCMOS sensors at near diffraction limited resolution with 1.0 µm, 1.4 µm, and 4.3 µm (x, y, and z respectively). The parallel use of sensors reduces the bandwidth bottlenecks typically found in other systems. TranSIM allows for the capturing of data at large-scale volumetric field-of-views up to 748 × 278 × 100 µm 3 at 100 Hz. Moreover, we were able to capture smaller field-of-views of 374 × 278 × 100 µm 3 at a faster volumetric rate of 200 Hz. Additionally, we found that the system’s versatile design allowed us the ability to change the vertical magnification programmatically rather than necessitating a change of objectives. With this system we were able to observe intricate communication between neuron populations separated by vast three-dimensional distances, raising the potential to answer complex questions in Neurobiology.
- Open Access
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Grand Unified Theory of Mind and Brain - Part II: Neural Holographic Tomography (NHT) and Holographic Ring Attractor Lattice (HAL)
For animals to navigate a given space, it is essential to perceive and memorize the external allocentric frame with landmarks. In the previous Part I (Arisaka 2022), by applying causality and locality at every single synapse, we proposed a new concept of MePMoS. This model allowed constructing the complete space-time dynamic connectomes of C. elegans and human brains. This Part II proposes a generic principle of space-to-time conversion for perceiving 3D space and 3D shape in a frequency-time domain, named Neural Holographic Tomography (NHT). In this general model, three strings of one-dimensional neurons can encode 3D space, utilizing the spike timings expressed by the phases of brainwaves. Therefore, dynamic shifting of phases can accomplish natural translation from an ever-changing egocentric frame acquired from sensory input to the perception of a stable allocentric frame, resulting in the steady perception of allocentric 3D space. We further propose a universal unit of memory, an engram named HAL (Holographic Ring Attractor Lattice). Facilitated by Hebbian plasticity, the phases of brainwaves, representing 3D space and shape, are registered by the 2D matrix of synaptic networks to form long-term static memories. This two-step conversion of sensory stimulation, first to a brainwave phase by NHT and second to synaptic memory by HAL, provides a general principle for perception and memory of allocentric 3D space and semantic 3D shape.
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Open AccessGrand Unified Theory of Mind and Brain - Part II: Neural Holographic Tomography (NHT) and Holographic Ring Attractor Lattice (HAL)
For animals to navigate a given space, it is essential to perceive and memorize the external allocentric frame with landmarks. In the previous Part I (Arisaka 2022), by applying causality and locality at every single synapse, we proposed a new concept of MePMoS. This model allowed constructing the complete space-time dynamic connectomes of C. elegans and human brains. This Part II proposes a generic principle of space-to-time conversion for perceiving 3D space and 3D shape in a frequency-time domain, named Neural Holographic Tomography (NHT). In this general model, three strings of one-dimensional neurons can encode 3D space, utilizing the spike timings expressed by the phases of brainwaves. Therefore, dynamic shifting of phases can accomplish natural translation from an ever-changing egocentric frame acquired from sensory input to the perception of a stable allocentric frame, resulting in the steady perception of allocentric 3D space. We further propose a universal unit of memory, an engram named HAL (Holographic Ring Attractor Lattice). Facilitated by Hebbian plasticity, the phases of brainwaves, representing 3D space and shape, are registered by the 2D matrix of synaptic networks to form long-term static memories. This two-step conversion of sensory stimulation, first to a brainwave phase by NHT and second to synaptic memory by HAL, provides a general principle for perception and memory of allocentric 3D space and semantic 3D shape.
- Open Access
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Grand Unified Theory of Mind and Brain - Part I: Space-Time Approach to Dynamic Connectomes of C. elegans and Human Brains by MePMoS
In a total of six articles, Grand Unified Theory of Mind of Brain: Part I – VI, distinct and radical space-time approaches to the human mind and brain are presented step by step. - Part I. Space-Time approaches to Dynamic Connectomes of C. elegans and Human Brains - Part II. Neural Holographic Tomography (NHT) and Holographic Ring Attractor Lattice (HAL)- Part III. Holographic Visual Perception of 3D Space and Shape - Part IV. Navigation and Episodic Memory by Hippocampal Network - Part V.Grand Unification of Five Senses and Memories - Part VI. The Origin of Language, Consciousness, and Intelligence Through these articles, it is shown that multiple brainwaves coordinate brain-wide neural activities in the frequency-time domain. Globally, allocentric 3D space is reconstructed by the phases of the low-frequency bands (< 20 Hz: Theta, Alpha, and Beta) via top-down signal processing. On the other hand, local stimulations of the five senses are encoded by the high-frequency gamma bands (> 30 Hz) via bottom-up parallel processing. This Part I argues that the fundamental principles of physics, causality and locality, must be imposed at every synaptic connection. Under such strict constraint that coincides with Hebbian Plasticity, the brains of any animal must follow the top-down principle of MePMoS (Memory-Prediction-Motion-Sensing) in this order. By applying this new concept, the complete space-time dynamic connectomes of the neural networks for two phylogenetically distant animals, C. elegans and humans, are constructed for the first time.
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Open AccessGrand Unified Theory of Mind and Brain - Part I: Space-Time Approach to Dynamic Connectomes of C. elegans and Human Brains by MePMoS
In a total of six articles, Grand Unified Theory of Mind of Brain: Part I – VI, distinct and radical space-time approaches to the human mind and brain are presented step by step. - Part I. Space-Time approaches to Dynamic Connectomes of C. elegans and Human Brains - Part II. Neural Holographic Tomography (NHT) and Holographic Ring Attractor Lattice (HAL)- Part III. Holographic Visual Perception of 3D Space and Shape - Part IV. Navigation and Episodic Memory by Hippocampal Network - Part V.Grand Unification of Five Senses and Memories - Part VI. The Origin of Language, Consciousness, and Intelligence Through these articles, it is shown that multiple brainwaves coordinate brain-wide neural activities in the frequency-time domain. Globally, allocentric 3D space is reconstructed by the phases of the low-frequency bands (< 20 Hz: Theta, Alpha, and Beta) via top-down signal processing. On the other hand, local stimulations of the five senses are encoded by the high-frequency gamma bands (> 30 Hz) via bottom-up parallel processing. This Part I argues that the fundamental principles of physics, causality and locality, must be imposed at every synaptic connection. Under such strict constraint that coincides with Hebbian Plasticity, the brains of any animal must follow the top-down principle of MePMoS (Memory-Prediction-Motion-Sensing) in this order. By applying this new concept, the complete space-time dynamic connectomes of the neural networks for two phylogenetically distant animals, C. elegans and humans, are constructed for the first time.
- Open Access
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Grand Unified Theory of Mind and Brain - Part III: Holographic Visual Perception of 3D Space and Shapes
In our daily life, we visually perceive an external space and effortlessly navigate through it. Although visual stimulation reaches the 2D retinas in the egocentric frame, our brains appear to reconstruct and maintain external allocentric 3D space regardless of constantly moving eyes, head, and body. How can the 2D egocentric retinotopy be converted to the meaningful allocentric 3D space so promptly and reliably? By applying the new concept of Neural Holographic Tomography (NHT) with Holographic Ring Attractor Lattice (HAL) developed in Part II, this Part III directly solves the above mysteries, especially the following three essential questions:1) How are saccades compensated to establish stable vision? 2) How is 3D allocentric space visually perceived with depth?3) How are semantic shapes recognized in a scale-invariant and rotation-invariant manner?Fundamentally, our vision acts on the frequency-time domain by using alpha brainwaves that holographically project a predicted 3D image in front of us, very much like a 3D projection mapping onto an empty space. This procedure satisfies the basic principle of MePMoS in Part I, which is supported both causally and locally.
- 6 March 2022
- Published by Center for Open Science in PsyArXiv
Open AccessGrand Unified Theory of Mind and Brain - Part III: Holographic Visual Perception of 3D Space and Shapes
In our daily life, we visually perceive an external space and effortlessly navigate through it. Although visual stimulation reaches the 2D retinas in the egocentric frame, our brains appear to reconstruct and maintain external allocentric 3D space regardless of constantly moving eyes, head, and body. How can the 2D egocentric retinotopy be converted to the meaningful allocentric 3D space so promptly and reliably? By applying the new concept of Neural Holographic Tomography (NHT) with Holographic Ring Attractor Lattice (HAL) developed in Part II, this Part III directly solves the above mysteries, especially the following three essential questions:1) How are saccades compensated to establish stable vision? 2) How is 3D allocentric space visually perceived with depth?3) How are semantic shapes recognized in a scale-invariant and rotation-invariant manner?Fundamentally, our vision acts on the frequency-time domain by using alpha brainwaves that holographically project a predicted 3D image in front of us, very much like a 3D projection mapping onto an empty space. This procedure satisfies the basic principle of MePMoS in Part I, which is supported both causally and locally.
- Open Access
Visual Perception of 3D Space and Shape in Time - Part I: 2D Space Perception by 2D Linear Translation
Visual perception plays a critical role in navigating space and extracting useful semantic information crucial to survival. To identify distant landmarks, we constantly shift gaze vectors through saccades, while still maintaining the visual perception of stable allocentric space. How can we sustain stable allocentric space so effortlessly? To solve this question, we have developed a new concept of NHT (Neural Holography Tomography). This model states that retinotopy is invisible (not available to consciousness) and must be converted to a time code by traveling alpha brainwaves to perceive objects consciously. According to this framework, if identical alpha phases are continually assigned to a landmark, we perceive its exact and consistent allocentric location. To test this hypothesis, we designed reaction time (RT) experiments to observe evidence of the predicted space-to-time conversion. Various visual stimuli were generated at a wide range of eccentricities either on a large TV (up to 40°) or by LED strips on a hemispherical dome (up to 60°). Participants were instructed to report the observed patterns promptly under either covert (no eye movement) or overt (with eye movement) conditions. As predicted, stimuli presented at the center of fixation always produced the fastest RTs. The additional RT delay was precisely proportional to the eccentricity of the peripheral stimulus presentation. Furthermore, both covert and overt attention protocols created the same RT delays, and trajectories of saccadic eye motions were in parallel to the overt RT vs. eccentricity. These findings strongly support our NHT model, in which the observed RT-eccentricity dependence is indicative of the spatiotemporal conversion required for maintaining a stable allocentric frame of reference. That is, we perceive space by time.
Open AccessVisual Perception of 3D Space and Shape in Time - Part I: 2D Space Perception by 2D Linear Translation
Visual perception plays a critical role in navigating space and extracting useful semantic information crucial to survival. To identify distant landmarks, we constantly shift gaze vectors through saccades, while still maintaining the visual perception of stable allocentric space. How can we sustain stable allocentric space so effortlessly? To solve this question, we have developed a new concept of NHT (Neural Holography Tomography). This model states that retinotopy is invisible (not available to consciousness) and must be converted to a time code by traveling alpha brainwaves to perceive objects consciously. According to this framework, if identical alpha phases are continually assigned to a landmark, we perceive its exact and consistent allocentric location. To test this hypothesis, we designed reaction time (RT) experiments to observe evidence of the predicted space-to-time conversion. Various visual stimuli were generated at a wide range of eccentricities either on a large TV (up to 40°) or by LED strips on a hemispherical dome (up to 60°). Participants were instructed to report the observed patterns promptly under either covert (no eye movement) or overt (with eye movement) conditions. As predicted, stimuli presented at the center of fixation always produced the fastest RTs. The additional RT delay was precisely proportional to the eccentricity of the peripheral stimulus presentation. Furthermore, both covert and overt attention protocols created the same RT delays, and trajectories of saccadic eye motions were in parallel to the overt RT vs. eccentricity. These findings strongly support our NHT model, in which the observed RT-eccentricity dependence is indicative of the spatiotemporal conversion required for maintaining a stable allocentric frame of reference. That is, we perceive space by time.
- Open Access
Visual Perception of 3D Space and Shape in Time - Part III 2D Shape Recognition by Log-Scaling
Human vision has a remarkable ability to recognize complex 3D objects such as faces that appear with any size and 3D orientations at any 3D location. If we initially memorize a face only with a normalized size and viewed from directly head on, the direct comparison between the one-sized memory and a new incoming image would demand tremendous mental frame translations in 7D. How can we perform such a demanding task so promptly and reliably as we experience the objects in the world around us? Intriguingly, our primary visual cortex exhibits a 2D retinotopy with a log-polar coordinate system, where scaling up/down of shape is converted to linear frame translation. As a result, mental scaling can be performed by linearly translating the memory or the perceptual image until they overlap with each other. According to our new model of NHT (Neural Holography Tomography), alpha brainwaves traveling at a constant speed can conduct this linear translation. With this scheme, every scaling up/down by a factor of two should take the same amount of extra mental time to recognize a smaller/larger face. To test this hypothesis, we designed a reaction time (RT) experiment, where participants were first asked to memorize sets of unfamiliar faces with a given specific size (4° or 8°). Following the memorization phase, similar stimuli with a wide range of sizes (from 1° to 32°) were presented, and RTs were recorded. As predicted, the increase in RT was proportional to the scaling factor in the log scale. Furthermore, we observed that RTs were fastest for 8° faces even if the memorized face was 4°. This supports our hypothesis that we always memorize faces at the exact size of ~8 °. To our surprise, the increases in RT were also consistent with the mentally-estimated depth sensation, which indicates that the apparent size of the recognized face can create a proper depth sensation.
Open AccessVisual Perception of 3D Space and Shape in Time - Part III 2D Shape Recognition by Log-Scaling
Human vision has a remarkable ability to recognize complex 3D objects such as faces that appear with any size and 3D orientations at any 3D location. If we initially memorize a face only with a normalized size and viewed from directly head on, the direct comparison between the one-sized memory and a new incoming image would demand tremendous mental frame translations in 7D. How can we perform such a demanding task so promptly and reliably as we experience the objects in the world around us? Intriguingly, our primary visual cortex exhibits a 2D retinotopy with a log-polar coordinate system, where scaling up/down of shape is converted to linear frame translation. As a result, mental scaling can be performed by linearly translating the memory or the perceptual image until they overlap with each other. According to our new model of NHT (Neural Holography Tomography), alpha brainwaves traveling at a constant speed can conduct this linear translation. With this scheme, every scaling up/down by a factor of two should take the same amount of extra mental time to recognize a smaller/larger face. To test this hypothesis, we designed a reaction time (RT) experiment, where participants were first asked to memorize sets of unfamiliar faces with a given specific size (4° or 8°). Following the memorization phase, similar stimuli with a wide range of sizes (from 1° to 32°) were presented, and RTs were recorded. As predicted, the increase in RT was proportional to the scaling factor in the log scale. Furthermore, we observed that RTs were fastest for 8° faces even if the memorized face was 4°. This supports our hypothesis that we always memorize faces at the exact size of ~8 °. To our surprise, the increases in RT were also consistent with the mentally-estimated depth sensation, which indicates that the apparent size of the recognized face can create a proper depth sensation.
- Open Access
Visual Perception of 3D Space and Shape in Time - Part IV - 3D Shape Recognition by 3D Rotation
Human vision has a remarkable ability to recognize complex 3D objects such as faces that appear at any size and 3D orientations at any 3D location. If we initially memorize a face only with a normalized size upfront at the object center, the direct comparison between the one-sized memory and an incoming new image would demand tremendous mental frame translations in 7D. How can we perform such a demanding task so promptly as we experience it in our daily lives? This paper specifically addresses the recognition of human faces with arbitrary 3D orientation in the [Roll, Yaw, Pitch] axes. According to our new model of NHT (Neural Holography Tomography), space is represented by time utilizing the phase of the alpha brainwave. This principle should be applicable to any mental rotation in 3D; thus, it predicts that extra time is required to perceive a rotated face to revolve it back to upright by the constant-speed alpha wave. To assess this hypothesis, we designed a reaction time (RT) experiment, where participants were first asked to memorize sets of upright unfamiliar faces. Following the memorization phase, similar stimuli with a wide range of rotating faces in 3D were presented, and RTs were recorded. As expected, the memorized upfront face was the fastest RT. The excess of the RT was observed proportional to the rotating angle in all [Roll, Yaw, Pitch] axes. Roll had the flattest slope, whereas upper Pitch was the steepest. We suspect that Roll is the swiftest mental operation because it can be conducted by the linear frame translation on the log-polar retinotopy of the visual cortex.
Open AccessVisual Perception of 3D Space and Shape in Time - Part IV - 3D Shape Recognition by 3D Rotation
Human vision has a remarkable ability to recognize complex 3D objects such as faces that appear at any size and 3D orientations at any 3D location. If we initially memorize a face only with a normalized size upfront at the object center, the direct comparison between the one-sized memory and an incoming new image would demand tremendous mental frame translations in 7D. How can we perform such a demanding task so promptly as we experience it in our daily lives? This paper specifically addresses the recognition of human faces with arbitrary 3D orientation in the [Roll, Yaw, Pitch] axes. According to our new model of NHT (Neural Holography Tomography), space is represented by time utilizing the phase of the alpha brainwave. This principle should be applicable to any mental rotation in 3D; thus, it predicts that extra time is required to perceive a rotated face to revolve it back to upright by the constant-speed alpha wave. To assess this hypothesis, we designed a reaction time (RT) experiment, where participants were first asked to memorize sets of upright unfamiliar faces. Following the memorization phase, similar stimuli with a wide range of rotating faces in 3D were presented, and RTs were recorded. As expected, the memorized upfront face was the fastest RT. The excess of the RT was observed proportional to the rotating angle in all [Roll, Yaw, Pitch] axes. Roll had the flattest slope, whereas upper Pitch was the steepest. We suspect that Roll is the swiftest mental operation because it can be conducted by the linear frame translation on the log-polar retinotopy of the visual cortex.
- Open Access
Visual Perception of 3D Space and Shape in Time - Part II: 3D Space Perception with Holographic Depth
Visual perception plays a critical role in navigating 3D space and extracting semantic information crucial to survival. Even though visual stimulation on the retina is fundamentally 2D, we seem to perceive the world around us in vivid 3D effortlessly. This reconstructed 3D space is allocentric and faithfully represents the external 3D world. How can we recreate stable 3D visual space so promptly and reliably? To solve this mystery, we have developed new concepts MePMoS (Memory-Prediction-Motion-Sensing) and NHT (Neural Holography Tomography). These models state that visual signal processing must be primarily top-down, starting from memory and prediction. Our brains predict and construct the expected 3D space holographically using traveling alpha brainwaves. Thus, 3D space is represented by the three time signals in three directions. To test this hypothesis, we designed reaction time (RT) experiments to observe predicted space-to-time conversion, especially as a function of distance. We placed LED strips on a horizontal plane to cover distances from close up to 2.5 m or 5 m, either using a 1D or a 2D lattice. Participants were instructed to promptly report observed LED patterns at various distances. As expected, stimulation at the fixation cue location always gave the fastest RT. Additional RT delays were proportional to the distance from the cue. Furthermore, both covert attention (without eye movements) and overt attention (with eye movements) created the same RT delays, and both binocular and monocular views resulted in the same RTs. These findings strongly support our predictions, in which the observed RT-depth dependence is indicative of the spatiotemporal conversion required for constructing allocentric 3D space. After all, we perceive and measure 3D space by time as Einstein postulated a century ago.
Open AccessVisual Perception of 3D Space and Shape in Time - Part II: 3D Space Perception with Holographic Depth
Visual perception plays a critical role in navigating 3D space and extracting semantic information crucial to survival. Even though visual stimulation on the retina is fundamentally 2D, we seem to perceive the world around us in vivid 3D effortlessly. This reconstructed 3D space is allocentric and faithfully represents the external 3D world. How can we recreate stable 3D visual space so promptly and reliably? To solve this mystery, we have developed new concepts MePMoS (Memory-Prediction-Motion-Sensing) and NHT (Neural Holography Tomography). These models state that visual signal processing must be primarily top-down, starting from memory and prediction. Our brains predict and construct the expected 3D space holographically using traveling alpha brainwaves. Thus, 3D space is represented by the three time signals in three directions. To test this hypothesis, we designed reaction time (RT) experiments to observe predicted space-to-time conversion, especially as a function of distance. We placed LED strips on a horizontal plane to cover distances from close up to 2.5 m or 5 m, either using a 1D or a 2D lattice. Participants were instructed to promptly report observed LED patterns at various distances. As expected, stimulation at the fixation cue location always gave the fastest RT. Additional RT delays were proportional to the distance from the cue. Furthermore, both covert attention (without eye movements) and overt attention (with eye movements) created the same RT delays, and both binocular and monocular views resulted in the same RTs. These findings strongly support our predictions, in which the observed RT-depth dependence is indicative of the spatiotemporal conversion required for constructing allocentric 3D space. After all, we perceive and measure 3D space by time as Einstein postulated a century ago.
- Open Access
Visual Perception in the Periphery: The Role of Covert Attention Vectors in the Extraction of Semantic Information
Under covert attention, our visual perception deteriorates dramatically as eccentricity increases. This reduction of peripheral visual acuity (PVA) is partially due to the coarse sampling of the retinal ganglion cells towards the periphery, but this property cannot be solely responsible. Other factors, such as character crowding, have been studied, yet the origin of the poor PVA is not entirely understood. This gap motivated us to investigate the PVA by varying the crowding conditions systematically. Under completely crowded conditions (i.e. resembling a full page of text), PVA was observed to be eight times worse than the PVA under uncrowded conditions. By partially crowding the periphery, we obtained PVA values between the fully crowded and uncrowded conditions. On the other hand, crowding the fovea center while leaving the periphery uncrowded improved PVA relative to the uncrowded case. These results support a model for a top-down “covert attention vector” that assists the resulting PVA in a manner analogous to saccadic eye movement for overt attention. We speculate that the attention vector instructs the dorsal pathway to transform the peripheral character to the foveal center. Then, the scale-invariant log-polar retinotopy of the ventral pathway can scale the centered visual input to match the prior memory of the specific character shape.
Open AccessVisual Perception in the Periphery: The Role of Covert Attention Vectors in the Extraction of Semantic Information
Under covert attention, our visual perception deteriorates dramatically as eccentricity increases. This reduction of peripheral visual acuity (PVA) is partially due to the coarse sampling of the retinal ganglion cells towards the periphery, but this property cannot be solely responsible. Other factors, such as character crowding, have been studied, yet the origin of the poor PVA is not entirely understood. This gap motivated us to investigate the PVA by varying the crowding conditions systematically. Under completely crowded conditions (i.e. resembling a full page of text), PVA was observed to be eight times worse than the PVA under uncrowded conditions. By partially crowding the periphery, we obtained PVA values between the fully crowded and uncrowded conditions. On the other hand, crowding the fovea center while leaving the periphery uncrowded improved PVA relative to the uncrowded case. These results support a model for a top-down “covert attention vector” that assists the resulting PVA in a manner analogous to saccadic eye movement for overt attention. We speculate that the attention vector instructs the dorsal pathway to transform the peripheral character to the foveal center. Then, the scale-invariant log-polar retinotopy of the ventral pathway can scale the centered visual input to match the prior memory of the specific character shape.