From Harness Optimization to Recursive Self-Improvement: A Survey of Language Model Agents
Preprint
- 23 October 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Language-model agents rely on harnesses that govern tool use, context, memory, and execution. Understanding automated harness revision requires connecting improvement methods to the reusable functionality they produce. This survey examines three linked perspectives: improvement workflows, recursive scope, and concrete modifications across task domains. We compare search strategies, memory management, edit guidance, and integration with model training, and use an existing five-level framework to distinguish harness optimization from recursive self-improvement. Across coding, reasoning and information processing, interactive and embodied tasks, and visual tasks, we trace reported changes from starting capabilities to outcomes. Our synthesis identifies repairs at model–environment interfaces, cases where added tools and context fail to help, and conditions constraining recovery reuse. Cross-domain analogies motivate, rather than establish, transfer. We distinguish task-performance gains from improved subsequent optimization and identify priorities in reliable evaluation, attribution, transfer, and safety.Keywords
All Related Versions
This publication has 73 references indexed in Scilit:
- The Path to Recursive Self-Improving Agents: Foundation, Framework, and Future DirectionsPreprints.org, 2026
- AgentEvo: cost-aware agentic workflow generation via adaptive multi-stage evolutionComplex & Intelligent Systems, 2026
- HARBOR: Automated Harness OptimizationarXiv, 2026
- HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient ReasoningarXiv, 2026
- HyperagentsarXiv, 2026
- EXACT: Explicit Attribute-Guided Decoding-Time PersonalizationarXiv, 2026
- Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution2026
- MermaidFlow: Redefining Agentic Workflow Generation via Safety-Constrained Evolutionary ProgrammingarXiv, 2025
- SkillWeaver: Web Agents can Self-Improve by Discovering and Honing SkillsarXiv, 2025
- Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance2025