Information Compression as a Unifying Principle in Human Learning, Perception, and Cognition
Author:
Open Access
- 1 January 2019
- journal article
- review article
- Published by Wiley in Complexity
- Vol. 2019 (1)
Abstract
This paper reviews evidence for the idea that much of human learning, perception, and cognition may be understood as information compression and often more specifically as “information compression via the matching and unification of patterns” (ICMUP). Evidence includes the following: information compression can mean selective advantage for any creature; the storage and utilisation of the relatively enormous quantities of sensory information would be made easier if the redundancy of incoming information was to be reduced; content words in natural languages, with their meanings, may be seen as ICMUP; other techniques for compression of information—such as class‐inclusion hierarchies, schema‐plus‐correction, run‐length coding, and part‐whole hierarchies—may be seen in psychological phenomena; ICMUP may be seen in how we merge multiple views to make one, in recognition, in binocular vision, in how we can abstract object concepts via motion, in adaptation of sensory units in the eye of Limulus, the horseshoe crab, and in other examples of adaptation; the discovery of the segmental structure of language (words and phrases), grammatical inference, and the correction of over‐ and undergeneralisations in learning may be understood in terms of ICMUP; information compression may be seen in the perceptual constancies; there is indirect evidence for ICMUP in human cognition via kinds of redundancy such as the decimal expansion of π which are difficult for people to detect; much of the structure and workings of mathematics—an aid to human thinking—may be understood in terms of ICMUP; and there is additional evidence via the SP Theory of Intelligence and its realisation in the SP Computer Model. Three objections to the main thesis of this paper are described, with suggested answers. These ideas may be seen to be part of a “Big Picture” with six components, outlined in the paper.Keywords
This publication has 80 references indexed in Scilit:
- The SP Theory of Intelligence: An OverviewInformation, 2013
- The impact of microsaccades on vision: towards a unified theory of saccadic functionNature Reviews Neuroscience, 2013
- Language Learning From Positive Evidence, Reconsidered: A Simplicity‐Based ApproachTopics in Cognitive Science, 2013
- Concepts and Categories: A Cognitive Neuropsychological PerspectiveAnnual Review of Psychology, 2009
- How Much the Eye Tells the BrainCurrent Biology, 2006
- A simplicity principle in unsupervised human categorizationCognitive Science, 2002
- The Search for Simplicity: A Fundamental Cognitive Principle?The Quarterly Journal of Experimental Psychology Section A, 1999
- Failure to detect changes to people during a real-world interactionPsychonomic Bulletin & Review, 1998
- The Discovery of Algorithmic ProbabilityJournal of Computer and System Sciences, 1997
- Making sense of randomness: Implicit encoding as a basis for judgment.Psychological Review, 1997