Gary F. Marcus
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Gary F. Marcus has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Ernest Davis
New York University University of Texas at Austin
3 shared publications Hugh Rabagliati
Gary Marcus and Hugh Rabagliati are at the Department of Psychology, New York University, 6 Washington Place, New York, New York 10003, USA
2 shared publicationsAdam Marblestone
Media Lab, Massachusetts Institute of Techonology, Cambridge, MA 02139, USA
1 shared publication- Doug Lenat1 shared publication
Ernest Davis
New York University
1 shared publication- Ernest Davis
Department of Computer Science,New York University,New York,NY://www.cs.nyu.edu/faculty/davise
1 shared publication
Latest Publications
- Open Access
Getting from Generative AI to Trustworthy AI: What LLMs might learn from Cyc
Generative AI, the most popular current approach to AI, consists of large language models (LLMs) that are trained to produce outputs that are plausible, but not necessarily correct. Although their abilities are often uncanny, they are lacking in aspects of reasoning, leading LLMs to be less than completely trustworthy. Furthermore, their results tend to be both unpredictable and uninterpretable. We lay out 16 desiderata for future AI, and discuss an alternative approach to AI which could theoretically address many of the limitations associated with current approaches: AI educated with curated pieces of explicit knowledge and rules of thumb, enabling an inference engine to automatically deduce the logical entailments of all that knowledge. Even long arguments produced this way can be both trustworthy and interpretable, since the full step-by-step line of reasoning is always available, and for each step the provenance of the knowledge used can be documented and audited. There is however a catch: if the logical language is expressive enough to fully represent the meaning of anything we can say in English, then the inference engine runs much too slowly. That's why symbolic AI systems typically settle for some fast but much less expressive logic, such as knowledge graphs. We describe how one AI system, Cyc, has developed ways to overcome that tradeoff and is able to reason in higher order logic in real time. We suggest that any trustworthy general AI will need to hybridize the approaches, the LLM approach and more formal approach, and lay out a path to realizing that dream.
Open AccessGetting from Generative AI to Trustworthy AI: What LLMs might learn from Cyc
Generative AI, the most popular current approach to AI, consists of large language models (LLMs) that are trained to produce outputs that are plausible, but not necessarily correct. Although their abilities are often uncanny, they are lacking in aspects of reasoning, leading LLMs to be less than completely trustworthy. Furthermore, their results tend to be both unpredictable and uninterpretable. We lay out 16 desiderata for future AI, and discuss an alternative approach to AI which could theoretically address many of the limitations associated with current approaches: AI educated with curated pieces of explicit knowledge and rules of thumb, enabling an inference engine to automatically deduce the logical entailments of all that knowledge. Even long arguments produced this way can be both trustworthy and interpretable, since the full step-by-step line of reasoning is always available, and for each step the provenance of the knowledge used can be documented and audited. There is however a catch: if the logical language is expressive enough to fully represent the meaning of anything we can say in English, then the inference engine runs much too slowly. That's why symbolic AI systems typically settle for some fast but much less expressive logic, such as knowledge graphs. We describe how one AI system, Cyc, has developed ways to overcome that tradeoff and is able to reason in higher order logic in real time. We suggest that any trustworthy general AI will need to hybridize the approaches, the LLM approach and more formal approach, and lay out a path to realizing that dream.
- Open Access
A very preliminary analysis of DALL-E 2
The DALL-E 2 system generates original synthetic images corresponding to an input text as caption. We report here on the outcome of fourteen tests of this system designed to assess its common sense, reasoning and ability to understand complex texts. All of our prompts were intentionally much more challenging than the typical ones that have been showcased in recent weeks. Nevertheless, for 5 out of the 14 prompts, at least one of the ten images fully satisfied our requests. On the other hand, on no prompt did all of the ten images satisfy our requests.
Open AccessA very preliminary analysis of DALL-E 2
The DALL-E 2 system generates original synthetic images corresponding to an input text as caption. We report here on the outcome of fourteen tests of this system designed to assess its common sense, reasoning and ability to understand complex texts. All of our prompts were intentionally much more challenging than the typical ones that have been showcased in recent weeks. Nevertheless, for 5 out of the 14 prompts, at least one of the ten images fully satisfied our requests. On the other hand, on no prompt did all of the ten images satisfy our requests.
- Open Access
A Review of Winograd Schema Challenge Datasets and Approaches
The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a highly ambiguous pronoun, resolved differently in the two sentences, that appears to require commonsense knowledge to be resolved correctly. The examples were designed to be easily solvable by humans but difficult for machines, in principle requiring a deep understanding of the content of the text and the situation it describes. This paper reviews existing Winograd Schema Challenge benchmark datasets and approaches that have been published since its introduction.
Open AccessA Review of Winograd Schema Challenge Datasets and Approaches
The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a highly ambiguous pronoun, resolved differently in the two sentences, that appears to require commonsense knowledge to be resolved correctly. The examples were designed to be easily solvable by humans but difficult for machines, in principle requiring a deep understanding of the content of the text and the situation it describes. This paper reviews existing Winograd Schema Challenge benchmark datasets and approaches that have been published since its introduction.
- 11 March 2020
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 43, e7
Computational limits don't fully explain human cognitive limitations
The project of justifying all the limits and failings of human cognition as inevitable consequences of strategies that are actually “optimal” relative to the limits on computational resources available may have some value, but it is far from a complete explanation. It is inconsistent with both common observation and a large body of experimentation, and it is of limited use in explaining human cognition.
- 11 March 2020
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 43, e7
Computational limits don't fully explain human cognitive limitations
The project of justifying all the limits and failings of human cognition as inevitable consequences of strategies that are actually “optimal” relative to the limits on computational resources available may have some value, but it is far from a complete explanation. It is inconsistent with both common observation and a large body of experimentation, and it is of limited use in explaining human cognition.
- 10 November 2017
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 40, e262
Causal generative models are just a start
Human reasoning is richer than Lake et al. acknowledge, and the emphasis on theories of how images and scenes are synthesized is misleading. For example, the world knowledge used in vision presumably involves a combination of geometric, physical, and other knowledge, rather than just a causal theory of how the image was produced. In physical reasoning, a model can be a set of constraints rather than a physics engine. In intuitive psychology, many inferences proceed without detailed causal generative models. How humans reliably perform such inferences, often in the face of radically incomplete information, remains a mystery.
- 10 November 2017
- Published by Cambridge University Press (CUP) in Behavioral and Brain Sciences
- Vol. 40, e262
Causal generative models are just a start
Human reasoning is richer than Lake et al. acknowledge, and the emphasis on theories of how images and scenes are synthesized is misleading. For example, the world knowledge used in vision presumably involves a combination of geometric, physical, and other knowledge, rather than just a causal theory of how the image was produced. In physical reasoning, a model can be a set of constraints rather than a physics engine. In intuitive psychology, many inferences proceed without detailed causal generative models. How humans reliably perform such inferences, often in the face of radically incomplete information, remains a mystery.
- 5 March 2015
- Published by SAGE Publications in Psychological Science
- Vol. 26 (4) , 542-544
Still Searching for Principles
- 5 March 2015
- Published by SAGE Publications in Psychological Science
- Vol. 26 (4) , 542-544
Still Searching for Principles
- 31 October 2014
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 346 (6209) , 551-552
The atoms of neural computation
The human cerebral cortex is central to a wide array of cognitive functions, from vision to language, reasoning, decision-making, and motor control. Yet, nearly a century after the neuroanatomical organization of the cortex was first defined, its basic logic remains unknown. One hypothesis is that cortical neurons form a single, massively repeated “canonical” circuit, characterized as a kind of a “nonlinear spatiotemporal filter with adaptive properties” (1). In this classic view, it was “assumed that these…properties are identical for all neocortical areas.” Nearly four decades later, there is still no consensus about whether such a canonical circuit exists, either in terms of its anatomical basis or its function. Likewise, there is little evidence that such uniform architectures can capture the diversity of cortical function in simple mammals, let alone characteristically human processes such as language and abstract thinking (2). Analogous software implementations in artificial intelligence (e.g., deep learning networks) have proven effective in certain pattern classification tasks, such as speech and image recognition, but likewise have made little inroads in areas such as reasoning and natural language understanding. Is the search for a single canonical cortical circuit misguided?
- 31 October 2014
- Published by American Association for the Advancement of Science (AAAS) in Science
- Vol. 346 (6209) , 551-552
The atoms of neural computation
The human cerebral cortex is central to a wide array of cognitive functions, from vision to language, reasoning, decision-making, and motor control. Yet, nearly a century after the neuroanatomical organization of the cortex was first defined, its basic logic remains unknown. One hypothesis is that cortical neurons form a single, massively repeated “canonical” circuit, characterized as a kind of a “nonlinear spatiotemporal filter with adaptive properties” (1). In this classic view, it was “assumed that these…properties are identical for all neocortical areas.” Nearly four decades later, there is still no consensus about whether such a canonical circuit exists, either in terms of its anatomical basis or its function. Likewise, there is little evidence that such uniform architectures can capture the diversity of cortical function in simple mammals, let alone characteristically human processes such as language and abstract thinking (2). Analogous software implementations in artificial intelligence (e.g., deep learning networks) have proven effective in certain pattern classification tasks, such as speech and image recognition, but likewise have made little inroads in areas such as reasoning and natural language understanding. Is the search for a single canonical cortical circuit misguided?
- 7 September 2012
- Published by Wiley in Topics in Cognitive Science
- Vol. 4 (4) , 498-512
Musicality: Instinct or Acquired Skill?
Is the human tendency toward musicality better thought of as the product of a specific, evolved instinct or an acquired skill? Developmental and evolutionary arguments are considered, along with issues of domain‐specificity. The article also considers the question of why humans might be consistently and intensely drawn to music if musicality is not in fact the product of a specifically evolved instinct.
- 7 September 2012
- Published by Wiley in Topics in Cognitive Science
- Vol. 4 (4) , 498-512
Musicality: Instinct or Acquired Skill?
Is the human tendency toward musicality better thought of as the product of a specific, evolved instinct or an acquired skill? Developmental and evolutionary arguments are considered, along with issues of domain‐specificity. The article also considers the question of why humans might be consistently and intensely drawn to music if musicality is not in fact the product of a specifically evolved instinct.
- 31 August 2010
- Published by Elsevier in Trends in Cognitive Sciences
- Vol. 14 (8) , 346-347
Neither size fits all: comment on McClelland et al. and Griffiths et al.
- 31 August 2010
- Published by Elsevier in Trends in Cognitive Sciences
- Vol. 14 (8) , 346-347
Neither size fits all: comment on McClelland et al. and Griffiths et al.
- 15 July 2009
- Published by Oxford University Press (OUP) in Child Development Perspectives
- Vol. 3 (2) , 94-95
Misrepresentational Innateness
Both nature and nurture are important contributors to development, but the two are not mutually exclusive. Understanding their joint contribution will require a balanced look at both contributors. This commentary proposes that the target article by J. P. Spencer et al. (2009) falls short in this regard, largely because it misrepresents the very “nativist” position it seeks to critique.
- 15 July 2009
- Published by Oxford University Press (OUP) in Child Development Perspectives
- Vol. 3 (2) , 94-95
Misrepresentational Innateness
Both nature and nurture are important contributors to development, but the two are not mutually exclusive. Understanding their joint contribution will require a balanced look at both contributors. This commentary proposes that the target article by J. P. Spencer et al. (2009) falls short in this regard, largely because it misrepresents the very “nativist” position it seeks to critique.