Relevance Structures Are a Necessary Prerequisite for Artificial Metacognition
- 1 July 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Intelligent Systems
- Vol. 41 (4) , 16-26
Abstract
AI-enabled systems deployed in dynamic, open-world, safety- and mission-critical environments often lack mechanisms for reliable self-monitoring and self-regulation under shift and perturbation. Artificial Metacognition (AM) addresses this by enabling systems to assess and adapt their own inference and learning processes. We show that relevance structures, which are order-theoretic substrates for comparing generalization and specialization and for quantifying under-coverage versus overreach, are structurally unavoidable for computable self-regulation. In turn, relevance structures provide an operational control theory for metacognitive tasks. We introduce exploratory, parsimonious, and balanced relevance scores and embed them into version-space algebra to regulate hypothesis search and inductive strategy selection. The resulting framework yields competence-aware learning systems that can both correct and explain their behavior by explicitly balancing exploration and parsimony. We illustrate relevance structures and their application with a medical visual question answering study on the SLAKE dataset.Keywords
This publication has 4 references indexed in Scilit:
- Applications of Certainty Scoring for Machine Learning Classification and Out-of-Distribution DetectionACM Transactions on Probabilistic Machine Learning, 2025
- QLoRA: Efficient Finetuning of Quantized LLMs2023
- Slake: A Semantically-Labeled Knowledge-Enhanced Dataset For Medical Visual Question Answering2021
- Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry.American Psychologist, 1979