Image Processing for a High-Resolution Optoelectronic Retinal Prosthesis
Authors:
- Alon AsherAAAlon Asher
- William A. SegalWSWilliam A. Segal
- Stephen A. BaccusSBStephen A. Baccus
- Leonid P. YaroslavskyLYLeonid P. Yaroslavsky
- Daniel V. PalankerDPDaniel V. Palanker
- 21 May 2007
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 54 (6) , 993-1004
Abstract
In an effort to restore visual perception in retinal diseases such as age-related macular degeneration or retinitis pigmentosa, a design was recently presented for a high-resolution optoelectronic retinal prosthesis having thousands of electrodes. This system requires real-time image processing fast enough to convert a video stream of images into electrical stimulus patterns that can be properly interpreted by the brain. Here, we present image-processing and tracking algorithms for a subretinal implant designed to stimulate the second neuron in the visual pathway, bypassing the degenerated first synaptic layer. For this task, we have developed and implemented: 1) A tracking algorithm that determines the implant's position in each frame. 2) Image cropping outside of the implant boundaries. 3) A geometrical transformation that distorts the image appropriate to the geometry of the fovea. 4) Spatio-temporal image filtering to reproduce the visual processing normally occurring in photoceptors and at the photoreceptor-bipolar cell synapse. 5) Conversion of the filtered visual information into a pattern of electrical current. Methods to accelerate real-time transformations include the exploitation of data redundancy in the time domain, and the use of precomputed lookup tables that are adjustable to retinal physiology and allow flexible control of stimulation parameters. A software implementation of these algorithms processes natural visual scenes with sufficient speed for real-time operation. This computationally efficient algorithm resembles, in some aspects, biological strategies of efficient coding in the retina and could provide a refresh rate higher than fifty frames per second on our systemKeywords
This publication has 34 references indexed in Scilit:
- Electrical Stimulation of Mammalian Retinal Ganglion Cells With Multielectrode ArraysJournal of Neurophysiology, 2006
- Visual resolution with retinal implants estimated from recordings in cat visual cortexVision Research, 2006
- Feedback Effects of Horizontal Cell Membrane Potential on Cone Calcium Currents Studied With Simultaneous RecordingsJournal of Neurophysiology, 2006
- Design of a high-resolution optoelectronic retinal prosthesisJournal of Neural Engineering, 2005
- Migration of Retinal Cells through a Perforated Membrane: Implications for a High-Resolution ProsthesisInvestigative Ophthalmology & Visual Science, 2004
- Predicting Every SpikeNeuron, 2001
- Bipolar Cells Use Kainate and AMPA Receptors to Filter Visual Information into Separate ChannelsNeuron, 2000
- Pattern electrical stimulation of the human retinaVision Research, 1999
- Spatiotemporal contrast sensitivity of early visionVision Research, 1993
- Visual Motion Processing and Sensory-Motor Integration for Smooth Pursuit Eye MovementsAnnual Review of Neuroscience, 1987