Logical Reasoning over Natural Language as Knowledge Representation: A Survey
Preprint
Abstract
Logical reasoning is central to human cognition and intelligence. It includes deductive, inductive, and abductive reasoning. Past research of logical reasoning within AI uses formal language as knowledge representation and symbolic reasoners. However, reasoning with formal language has proved challenging (e.g., brittleness and knowledge-acquisition bottleneck). This paper provides a comprehensive overview on a new paradigm of logical reasoning, which uses natural language as knowledge representation and pretrained language models as reasoners, including philosophical definition and categorization of logical reasoning, advantages of the new paradigm, benchmarks and methods, challenges of the new paradigm, possible future directions, and relation to related NLP fields. This new paradigm is promising since it not only alleviates many challenges of formal representation but also has advantages over end-to-end neural methods. This survey focus on transformer-based LLMs explicitly working on deductive, inductive, and abductive reasoning over English representation.Keywords
All Related Versions
This publication has 55 references indexed in Scilit:
- A survey on XAI and natural language explanationsInformation Processing & Management, 2022
- Inductive logic programming at 30Machine Learning, 2021
- L2R²: Leveraging Ranking for Abductive Reasoning2020
- Information Extraction2018
- Logical Reasoning and Learning2012
- ILP turns 20Machine Learning, 2011
- Expert systems in production planning and scheduling: A state-of-the-art surveyJournal of Intelligent Manufacturing, 2002
- Inductive Logic Programming: Theory and methodsThe Journal of Logic Programming, 1994
- Approaches to abductive reasoning: an overviewArtificial Intelligence Review, 1993
- Linguistics and natural logicSynthese, 1970