Patrik O. Hoyer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Patrik O. Hoyer has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
Aapo Hyvärinen
Neural Networks Research Centre, Helsinki University of Technology, P.O. Box 5400, FIN-02015 Hut, Finland
2 shared publications- Aapo Hyvärinen
Department of Computer Science, University of Helsinki, Helsinki, Finland
1 shared publication - Michael Gutmann
HIIT Basic Research Unit and Dept of Computer Science, University of Helsinki, Finland
1 shared publication
Latest Publications
- Open Access
- 16 February 2005
- Published by Springer Nature in BMC Neuroscience
- Vol. 6 (1) , 12
Statistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2
Background: It has been shown that the classical receptive fields of simple and complex cells in the primary visual cortex emerge from the statistical properties of natural images by forcing the cell responses to be maximally sparse or independent. We investigate how to learn features beyond the primary visual cortex from the statistical properties of modelled complex-cell outputs. In previous work, we showed that a new model, non-negative sparse coding, led to the emergence of features which code for contours of a given spatial frequency band. Results: We applied ordinary independent component analysis to modelled outputs of complex cells that span different frequency bands. The analysis led to the emergence of features which pool spatially coherent across-frequency activity in the modelled primary visual cortex. Thus, the statistically optimal way of processing complex-cell outputs abandons separate frequency channels, while preserving and even enhancing orientation tuning and spatial localization. As a technical aside, we found that the non-negativity constraint is not necessary: ordinary independent component analysis produces essentially the same results as our previous work. Conclusion: We propose that the pooling that emerges allows the features to code for realistic low-level image features related to step edges. Further, the results prove the viability of statistical modelling of natural images as a framework that produces quantitative predictions of visual processing.
- 16 February 2005
- Published by Springer Nature in BMC Neuroscience
- Vol. 6 (1) , 12
Open AccessStatistical model of natural stimuli predicts edge-like pooling of spatial frequency channels in V2
Background: It has been shown that the classical receptive fields of simple and complex cells in the primary visual cortex emerge from the statistical properties of natural images by forcing the cell responses to be maximally sparse or independent. We investigate how to learn features beyond the primary visual cortex from the statistical properties of modelled complex-cell outputs. In previous work, we showed that a new model, non-negative sparse coding, led to the emergence of features which code for contours of a given spatial frequency band. Results: We applied ordinary independent component analysis to modelled outputs of complex cells that span different frequency bands. The analysis led to the emergence of features which pool spatially coherent across-frequency activity in the modelled primary visual cortex. Thus, the statistically optimal way of processing complex-cell outputs abandons separate frequency channels, while preserving and even enhancing orientation tuning and spatial localization. As a technical aside, we found that the non-negativity constraint is not necessary: ordinary independent component analysis produces essentially the same results as our previous work. Conclusion: We propose that the pooling that emerges allows the features to code for realistic low-level image features related to step edges. Further, the results prove the viability of statistical modelling of natural images as a framework that produces quantitative predictions of visual processing.
- 30 June 2002
- Published by Elsevier in Neurocomputing
- Vol. 44-46, 459-466
Sparse coding of natural contours
- 30 June 2002
- Published by Elsevier in Neurocomputing
- Vol. 44-46, 459-466
Sparse coding of natural contours
- 1 June 2002
- Published by Elsevier in Vision Research
- Vol. 42 (12) , 1593-1605
A multi-layer sparse coding network learns contour coding from natural images
- 1 June 2002
- Published by Elsevier in Vision Research
- Vol. 42 (12) , 1593-1605
A multi-layer sparse coding network learns contour coding from natural images
- Open Access
Non-negative sparse coding
Non-negative sparse coding is a method for decomposing multivariate data into non-negative sparse components. In this paper we briefly describe the motivation behind this type of data representation and its relation to standard sparse coding and non-negative matrix factorization. We then give a simple yet efficient multiplicative algorithm for finding the optimal values of the hidden components. In addition, we show how the basis vectors can be learned from the observed data. Simulations demonstrate the effectiveness of the proposed method.
Open AccessNon-negative sparse coding
Non-negative sparse coding is a method for decomposing multivariate data into non-negative sparse components. In this paper we briefly describe the motivation behind this type of data representation and its relation to standard sparse coding and non-negative matrix factorization. We then give a simple yet efficient multiplicative algorithm for finding the optimal values of the hidden components. In addition, we show how the basis vectors can be learned from the observed data. Simulations demonstrate the effectiveness of the proposed method.