Ye. F. Tsarkov

This paper aims at discussing methods and results of Lyapunov stability theory for dynamical systems with vector field subjected to permanent Markov type perturbations. The paper is organized as follows. Section 1 introduces the model of Markov dynamical system (MDS) and suggests different possible definitions of equilibrium stochastic stability, which are under discussion in the next sections. It is proven that for linear Markov dynamical systems equilibrium asymptotical stability with probability one is equivalent to the exponential decreasing of the -moment with sufficiently small . In Section 3 we will discuss validity of equilibrium stability analysis of Markov dynamical systems applying a linear approximation of a vector field. Section 4 is devoted to a semigroup approach for mean square stability analysis of linear Markov dynamical systems. It permits us to write the Lyapunov matrix in an explicit form and to reduce the equilibrium stability problem to real spectrum analysis of a specially constructed closed operator.

This paper deals with the family of Cauchy matrices of a linear differential equation dependent on a step Markov process and an impulse type dynamical system rapidly switched by the above process. Applying the stochastic and deterministic averaging procedures according to the invariant measures of the Markov process one achieves a simpler linear differential equation dependent on simpler dynamical systems such as an ordinary differential equation, a differential equation with the right hand side switched by a merger Markov process or a stochastic Itô differential equation. It is proved that under some hypotheses one may successfully apply these resulting evolution families not only to analyzing the initial family on an arbitrary finite time interval but also to describing a time asymptotic of this family.