Delay-aware adaptive chemotherapy for tumor-immune dynamics using proximal policy optimization
- 30 September 2026
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Modern Physics C
Abstract
The design of adaptive chemotherapy is complicated by nonlinear tumor-immune interactions, delayed drug transport and uncertainty in state evolution. This study develops a delay-aware computational framework that couples a normalized normal-tumor-immune model with central and peripheral pharmacokinetic compartments. A Proximal Policy Optimization (PPO) agent observes the population states, their rates of change and both drug concentrations, and selects a bounded continuous infusion action. Pharmacodynamic killing is driven by peripheral exposure, thereby distinguishing systemic administration from the concentration acting at the tumor site. Positivity and boundedness of the deterministic biological-pharmacokinetic system are established for nonnegative initial states and bounded infusion. The learning objective jointly penalizes tumor burden, positive tumor growth, cumulative exposure, abrupt normalized-action variation and depletion of normal and immune populations. Numerical experiments compare untreated and periodic regimens, one- and two-compartment environments, nominal and stochastic transitions, and PPO with two actor-critic baselines. Explicit distribution dynamics change the learned policy from a sustained high-action plateau to an early loading phase followed by gradual tapering. Moderate transition randomization yields the smallest reported tumor-tracking errors and reduced trajectory dispersion, whereas stronger perturbations substantially widen the uncertainty bands. These results identify pharmacokinetic representation as a consequential component of learning-based treatment design. The framework is an in-silico mechanism study rather than a clinical dosing recommendation and requires drug-specific calibration, hard toxicity constraints, complete statistical evaluation and biological validation.Keywords
Funding Information
- National Natural Science Foundation of China (12301486)
This publication has 25 references indexed in Scilit:
- A mathematical modeling of patient-derived lung cancer stem cells with fractional-order derivativePhysica Scripta, 2024
- Numerical simulation for fractional optimal control problems via euler waveletsPhysica Scripta, 2024
- Reinforcement learning for intelligent healthcare applications: A surveyArtificial Intelligence in Medicine, 2020
- Optimal control to develop therapeutic strategies for metastatic castrate resistant prostate cancerJournal of Theoretical Biology, 2018
- The mathematics of cancer: integrating quantitative modelsNature Reviews Cancer, 2015
- Integrative mathematical oncologyNature Reviews Cancer, 2008
- The dynamics of an optimally controlled tumor model: A case studyMathematical and Computer Modelling, 2003
- Analysis of logistic growth modelsMathematical Biosciences, 2002
- A Mathematical Tumor Model with Immune Resistance and Drug Therapy: An Optimal Control ApproachComputational and Mathematical Methods in Medicine, 2000
- Dynamics of Tumor GrowthBritish Journal of Cancer, 1964