Search

In this paper, exponential stability of discrete-time Markov jump linear systems (MJLSs) with the Markov chain on a Borel space $(\Theta, \mathcal{B}(\Theta))$ is studied, and bounded real lemmas (BRLs) are given. The work generalizes the results from the previous literature that considered only the Markov chain taking values in a countable set to the scenario of an uncountable set and provides unified approaches for describing exponential stability and $H_{\infty}$ performance of MJLSs. This paper covers two kinds of exponential stabilities: one is exponential mean-square stability with conditioning (EMSSy-C), and the other is exponential mean-square stability (EMSSy). First, based on the infinite-dimensional operator theory, the equivalent conditions for determining these two kinds of stabilities are shown respectively by the exponentially stable evolutions generated by the corresponding bounded linear operators on different Banach spaces, which turn out to present the spectral criteria of EMSSy-C and EMSSy. Furthermore, the relationship between these two kinds of stabilities is discussed. Moreover, some easier-to-check criteria are established for EMSSy-C of MJLSs in terms of the existence of uniformly positive definite solutions of Lyapunov-type equations or inequalities. In addition, BRLs are given separately in terms of the existence of solutions of the $\Theta$-coupled difference Riccati equation for the finite horizon case and algebraic Riccati equation for the infinite horizon case, which facilitates the $H_{\infty}$ analysis of MJLSs with the Markov chain on a Borel space.

The stochastic $H_{\infty}$ control is studied for a linear stochastic It\^o system with an unknown system model. The linear stochastic $H_{\infty}$ control issue is known to be transformable into the problem of solving a so-called generalized algebraic Riccati equation (GARE), which is a nonlinear equation that is typically difficult to solve analytically. Worse, model-based techniques cannot be utilized to approximately solve a GARE when an accurate system model is unavailable or prohibitively expensive to construct in reality. To address these issues, an off-policy reinforcement learning (RL) approach is presented to learn the solution of a GARE from real system data rather than a system model; its convergence is demonstrated, and the robustness of RL to errors in the learning process is investigated. In the off-policy RL approach, the system data may be created with behavior policies rather than the target policies, which is highly significant and promising for use in actual systems. Finally, the proposed off-policy RL approach is validated on a stochastic linear F-16 aircraft system.

This paper discusses the stabilizability, weak stabilizability, exact observability and robust quadratic stabilizability of linear stochastic control systems. By means of the spectrum technique of the generalized Lyapunov operator, a necessary and sufficient condition is given for stabilizability and weak stabilizability of stochastic systems, respectively. Some new concepts called unremovable spectrums, strong solutions, and weakly feedback stabilizing solutions are introduced. An unremovable spectrum theorem is given, which generalizes the corresponding theorem of deterministic systems to stochastic systems. A stochastic Popov-Belevith-Hautus (PBH) criterion for exact observability is obtained. For applications, we give a comparison theorem for generalized algebraic Riccati equations (GAREs), and two results on Lyapunov-type equations are obtained, which improve the previous works. Finally, we also discuss robust quadratic stabilization of uncertain stochastic systems, and a necessary and sufficient condition is given for quadratic stabilization via a linear matrix inequality (LMI).

This paper studies finite-time stability and instability theorems in probability sense for stochastic nonlinear systems. Firstly, a new sufficient condition is proposed to guarantee that the considered system has a global solution. Secondly, we propose improved finite-time stability and instability criteria that relax the constraints on $\mathcal {L}V$ (the infinitesimal operator of Lyapunov function $V$) by the uniformly asymptotically stable function(UASF). The improved finite-time stability theorems allow $\mathcal {L}V$ to be indefinite (negative or positive) rather than just only allow $\mathcal {L}V$ to be negative. Most existing finite-time stability and instability results can be viewed as special cases of the obtained theorems. Finally, some simulation examples verify the validity of the theoretical results.

This paper studies the mixed $H_-/H_{\infty}$ fault detection filtering of It\^o-type nonlinear stochastic systems. Mixed $H_-/H_{\infty}$ filtering combines the system robustness to the external disturbance and the sensitivity to the fault of the residual signal. Firstly, for It\^o-type affine nonlinear stochastic systems, some sufficient criteria are obtained for the existence of $H_-/H_{\infty}$ filter in terms of Hamilton-Jacobi inequalities (HJIs). Secondly, for a class of quasi-linear It\^o systems, a sufficient condition is given for the existence of $H_-/H_{\infty}$ filter by means of linear matrix inequalities (LMIs). Finally, a numerical example is presented to illustrate the effectiveness of the proposed results.

This paper mainly discusses the $H_{\infty}$ filtering of general nonlinear discrete time-varying stochastic systems. A nonlinear discrete-time stochastic bounded real lemma (SBRL) is firstly obtained by means of the smoothness of the conditional mathematical expectation, and then, based on the given SBRL and a stochastic LaSalle-type theorem, a sufficient condition for the existence of the $H_\infty$ filtering of general nonlinear discrete time-varying stochastic systems is presented via a new introduced Hamilton-Jacobi inequality (HJI), which is easily verified. When the worst-case disturbance $\{v^*_k\}_{k\in {\mathcal N}}$ is considered, the suboptimal $H_2/H_\infty$ filtering is studied. Two examples including a practical engineering example show the effectiveness of our main results.

This paper studies the finite-time stability and stabilization of linear discrete time-varying stochastic systems with multiplicative noise. Firstly, necessary and sufficient conditions for finite-time stability are presented via state transition matrix approach. Secondly, this paper also develops the Lyapunov function method to study finite-time stability and stabilization of discrete time-varying stochastic systems based on matrix inequalities and linear matrix inequalities (LMIs), so as to Matlab LMI Toolbox can be used. Two numerical examples are given to illustrate the effectiveness of the proposed results.

In this paper, a new approach based on convex analysis is introduced to solve the $H_\infty$ problem for discrete-time nonlinear stochastic systems. A stochastic version of bounded real lemma is proved and the state feedback $H_\infty$ control is studied. Two examples are presented to show the effectiveness of our developed theory., Comment: 29 pages, 4 figures, 36 references

The objective of this paper is to study detectability, observability and related Lyapunov-type theorems of linear discrete-time time-varying stochastic systems with multiplicative noise. Some new concepts such as uniform detectability, ${\cal K}^{\infty}$-exact detectability (resp. ${\cal K}^{WFT}$-exact detectability, ${\cal K}^{FT}$-exact detectability, ${\cal K}^{N}$-exact detectability) and ${\cal K}^{\infty}$-exact observability (resp. ${\cal K}^{WFT}$-exact observability, ${\cal K}^{FT}$-exact observability, ${\cal K}^{N}$-exact observability) are introduced, respectively, and nice properties associated with uniform detectability, exact detectability and exact observability are also obtained. Moreover, some Lyapunov-type theorems associated with generalized Lyapunov equations and exponential stability in mean square sense are presented under uniform detectability, ${\cal K}^{N}$-exact observability and ${\cal K}^{N}$-exact detectability, respectively.

This paper aims to develop the stability theory for singular stochastic Markov jump systems with state-dependent noise, including both continuous- and discrete-time cases. The sufficient conditions for the existence and uniqueness of a solution to the system equation are provided. Some new and fundamental concepts such as non-impulsiveness and mean square admissibility are introduced, which are different from those of other existing works. By making use of the $\mathcal{H}$-representation technique and the pseudo inverse $E^+$ of a singular matrix $E$, sufficient conditions ensuring the system to be mean square admissible are established in terms of strict linear matrix inequalities, which can be regarded as extensions of the corresponding results of deterministic singular systems and normal stochastic systems. Practical examples are given to demonstrate the effectiveness of the proposed approaches.