Optimal Navigation Functions for Nonlinear Stochastic Systems
Authors:
- Matanya B. HorowitzMHMatanya B. Horowitz
- Joel W. BurdickJBJoel W. Burdick
Preprint
Abstract
This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential equation. This approach allows for optimality criteria to be incorporated into the navigation function, and generalizes several existing results in navigation functions. It is shown that the HJB and that existing navigation functions in the literature sit on ends of a spectrum of optimization problems, upon which tradeoffs may be made in problem complexity. In particular, it is shown that under certain criteria the optimal navigation function is related to Laplace's equation, previously used in the literature, through an exponential transform. Further, analytical solutions to the HJB are available in simplified domains, yielding guidance towards optimality for approximation schemes. Examples are used to illustrate the role that noise, and optimality can potentially play in navigation system design.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Introduction to Finite and Spectral Element Methods Using MATLAB2014
- Controlled Markov Processes and Viscosity Solutions2006
- Linear Theory for Control of Nonlinear Stochastic SystemsPhysical Review Letters, 2005
- Path integrals and symmetry breaking for optimal control theoryJournal of Statistical Mechanics: Theory and Experiment, 2005
- The Linear Programming Approach to Approximate Dynamic ProgrammingOperations Research, 2003
- Unconstrained receding-horizon control of nonlinear systemsIEEE Transactions on Automatic Control, 2001
- Exact robot navigation using artificial potential functionsIEEE Transactions on Robotics and Automation, 1992
- Real-time obstacle avoidance using harmonic potential functionsIEEE Transactions on Robotics and Automation, 1992
- Robot navigation functions on manifolds with boundaryAdvances in Applied Mathematics, 1990
- Incorporating range sensing in the robot navigation functionIEEE Transactions on Systems, Man, and Cybernetics, 1990