From Harness Optimization to Recursive Self-Improvement: A Survey of Language Model Agents
Preprint
- 30 October 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Language-model agents rely on harnesses that govern tool use, context, memory, and execution. Understanding automated harness revision requires connecting improvement methods to the reusable functionality they produce. This survey examines three linked perspectives: improvement workflows, recursive scope, and concrete modifications across task domains. We compare search strategies, memory management, edit guidance, and integration with model training, and use an existing five-level framework to distinguish harness optimization from recursive self-improvement. Across coding, reasoning and information processing, interactive and embodied tasks, and visual tasks, we trace reported changes from starting capabilities to outcomes. Our synthesis identifies repairs at model–environment interfaces, cases where added tools and context fail to help, and conditions constraining recovery reuse. Cross-domain analogies motivate, rather than establish, transfer. We distinguish task-performance gains from improved subsequent optimization and identify priorities in reliable evaluation, attribution, transfer, and safety.Keywords
All Related Versions
This publication has 80 references indexed in Scilit:
- AgentEvo: cost-aware agentic workflow generation via adaptive multi-stage evolutionComplex & Intelligent Systems, 2026
- The Last Harness You'll Ever BuildarXiv, 2026
- HARBOR: Automated Harness OptimizationarXiv, 2026
- HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient ReasoningarXiv, 2026
- HyperagentsarXiv, 2026
- EXACT: Explicit Attribute-Guided Decoding-Time PersonalizationarXiv, 2026
- MemSkill: Learning and Evolving Memory Skills for Self-Evolving AgentsarXiv, 2026
- Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolution2026
- SkillWeaver: Web Agents can Self-Improve by Discovering and Honing SkillsarXiv, 2025
- Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance2025