Layer-of-Thoughts Prompting (LoT): Leveraging LLM-Based Retrieval with Constraint Hierarchies
Preprint
Abstract
This paper presents a novel approach termed Layer-of-Thoughts Prompting (LoT), which utilizes constraint hierarchies to filter and refine candidate responses to a given query. By integrating these constraints, our method enables a structured retrieval process that enhances explainability and automation. Existing methods have explored various prompting techniques but often present overly generalized frameworks without delving into the nuances of prompts in multi-turn interactions. Our work addresses this gap by focusing on the hierarchical relationships among prompts. We demonstrate that the efficacy of thought hierarchy plays a critical role in developing efficient and interpretable retrieval algorithms. Leveraging Large Language Models (LLMs), LoT significantly improves the accuracy and comprehensibility of information retrieval tasks.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Demystifying Chains, Trees, and Graphs of ThoughtsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
- Attentive deep neural networks for legal document retrievalArtificial Intelligence and Law, 2022
- Deep learning in law: early adaptation and legal word embeddings trained on large corporaArtificial Intelligence and Law, 2018
- Constraint hierarchiesHigher-Order and Symbolic Computation, 1992
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988
- A definition of relevance for information retrievalInformation Storage and Retrieval, 1971
- A Statistical Approach to Mechanized Encoding and Searching of Literary InformationIBM Journal of Research and Development, 1957