Characterization of Minimum Error Linear Coding with Sensory and Neural Noise
- 1 October 2011
- journal article
- research article
- Published by MIT Press in Neural Computation
- Vol. 23 (10) , 2498-2510
Abstract
Robust coding has been proposed as a solution to the problem of minimizing decoding error in the presence of neural noise. Many real-world problems, however, have degradation in the input signal, not just in neural representations. This generalized problem is more relevant to biological sensory coding where internal noise arises from limited neural precision and external noise from distortion of sensory signal such as blurring and phototransduction noise. In this note, we show that the optimal linear encoder for this problem can be decomposed exactly into two serial processes that can be optimized separately. One is Wiener filtering, which optimally compensates for input degradation. The other is robust coding, which best uses the available representational capacity for signal transmission with a noisy population of linear neurons. We also present spectral analysis of the decomposition that characterizes how the reconstruction error is minimized under different input signal spectra, types and amounts of degradation, degrees of neural precision, and neural population sizes.Keywords
This publication has 17 references indexed in Scilit:
- Natural Image Coding in V1: How Much Use Is Orientation Selectivity?PLOS Computational Biology, 2009
- MIMO Transceiver Design via Majorization TheoryFoundations and Trends® in Communications and Information Theory, 2007
- Toeplitz and Circulant Matrices: A ReviewFoundations and Trends® in Communications and Information Theory, 2006
- QuantizationIEEE Transactions on Information Theory, 1998
- Designing receptive fields for highest fidelityNetwork: Computation in Neural Systems, 1994
- Towards a Theory of Early Visual ProcessingNeural Computation, 1990
- Optimal Linear Coding for Vector ChannelsIEEE Transactions on Communications, 1976
- Transmission of noisy information to a noisy receiver with minimum distortionIEEE Transactions on Information Theory, 1970
- Source encoding in the presence of random disturbance (Corresp.)IEEE Transactions on Information Theory, 1968
- Information transmission with additional noiseIEEE Transactions on Information Theory, 1962