Yixia Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Yixia Li has a total of 25 co-authors. Here are the top co-authors by number of shared publications:
- Guanhua Chen
Southern University of Science and Technology
3 shared publications - Yun Chen
Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, USA
2 shared publications - Amos Storkey
The University of Edinburgh, Edinburgh, United Kingdom
1 shared publication - Cheng Qian
University of Illinois Urbana-Champaign, USA
1 shared publication - Haifeng Wang
Baidu Inc., Beijing, China
1 shared publication - Haohuinan Zhang
Beihang University, China
1 shared publication
Latest Publications
- Open Access
- 3 September 2026
- Published by MDPI AG in Preprints.org
Theory of Agent: The Science of Internalization and Externalization for LLM-Based Agents
A large language model (LLM) agent is a model coupled to a harness: parametric weights that hold knowledge and reasoning ability, wrapped in an external apparatus of memory, tools, and orchestration through which the model perceives and acts. Progress over the past years has come from pushing on both, with stronger models and richer harnesses, but the design decision that quietly governs an agent’s behavior is where competence should live: which knowledge, skills, and control to internalize into the model’s parameters, and which to externalize onto the surrounding harness. These decisions increasingly determine whether an agent is reliable, efficient, and able to keep improving. We investigate this core problem through the lens of the Theory of Agent (ToA), which views an LLM agent not as a task executor but as an epistemic decision-maker in terms of reasoning or acting at every step. The two means it has for that epistemic uncertainty reduction, namely reasoning over what it already holds and acting on the world to obtain what it does not, are the run-time faces of internalization and externalization: reasoning draws on competence that has been absorbed into the model, while acting exploits competence that remains in the harness. We review this internalization and externalization across five chapters. Foundations sets up the basic picture: an agent that, at each step, decides whether to answer from what it already knows or reach outside for what it does not, and what separates a good version of that decision from a wasteful one. Learning examines how training places competence on either side of the boundary, spanning internalization of memory, reasoning, tool-use policy, and world models, and externalization of memory, skills, and orchestration. Aligning treats calibration as the connecting thread across an agent’s cognitive boundaries, efficiency constraints, human preferences, environment constraints, and other agents. Evolving studies how agents revise both sides of the boundary over time, from model-side and harness-side updates to agent–environment co-evolution. Evaluation reinterprets metrics and benchmarks by the epistemic effort they expose and argues for measuring the boundary decision rather than task completion alone. We conclude with the open problems that follow once internalization and externalization are treated as the governing axis of agent design.
- 3 September 2026
- Published by MDPI AG in Preprints.org
Open AccessTheory of Agent: The Science of Internalization and Externalization for LLM-Based Agents
A large language model (LLM) agent is a model coupled to a harness: parametric weights that hold knowledge and reasoning ability, wrapped in an external apparatus of memory, tools, and orchestration through which the model perceives and acts. Progress over the past years has come from pushing on both, with stronger models and richer harnesses, but the design decision that quietly governs an agent’s behavior is where competence should live: which knowledge, skills, and control to internalize into the model’s parameters, and which to externalize onto the surrounding harness. These decisions increasingly determine whether an agent is reliable, efficient, and able to keep improving. We investigate this core problem through the lens of the Theory of Agent (ToA), which views an LLM agent not as a task executor but as an epistemic decision-maker in terms of reasoning or acting at every step. The two means it has for that epistemic uncertainty reduction, namely reasoning over what it already holds and acting on the world to obtain what it does not, are the run-time faces of internalization and externalization: reasoning draws on competence that has been absorbed into the model, while acting exploits competence that remains in the harness. We review this internalization and externalization across five chapters. Foundations sets up the basic picture: an agent that, at each step, decides whether to answer from what it already knows or reach outside for what it does not, and what separates a good version of that decision from a wasteful one. Learning examines how training places competence on either side of the boundary, spanning internalization of memory, reasoning, tool-use policy, and world models, and externalization of memory, skills, and orchestration. Aligning treats calibration as the connecting thread across an agent’s cognitive boundaries, efficiency constraints, human preferences, environment constraints, and other agents. Evolving studies how agents revise both sides of the boundary over time, from model-side and harness-side updates to agent–environment co-evolution. Evaluation reinterprets metrics and benchmarks by the epistemic effort they expose and argues for measuring the boundary decision rather than task completion alone. We conclude with the open problems that follow once internalization and externalization are treated as the governing axis of agent design.
- Open Access
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 18817-18829
ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs
Yan Yang, Yixia Li, Hongru Wang, Xuetao Wei, James Jianqiao Yu, Yun Chen, Guanhua Chen. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 18817-18829
Open AccessImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs
Yan Yang, Yixia Li, Hongru Wang, Xuetao Wei, James Jianqiao Yu, Yun Chen, Guanhua Chen. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 654-665
PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
Tianci Xue, Ziqi Wang, Yixia Li, Yun Chen, Guanhua Chen. Findings of the Association for Computational Linguistics ACL 2024. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 654-665
Open AccessPACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
Tianci Xue, Ziqi Wang, Yixia Li, Yun Chen, Guanhua Chen. Findings of the Association for Computational Linguistics ACL 2024. 2024.