Search

The main goal of this book is to systematically address the mathematical methods that are applied in the study of synchronization of infinite-dimensional evolutionary dissipative or partially dissipative systems. It bases its unique monograph presentation on both general and abstract models and covers several important classes of coupled nonlinear deterministic and stochastic PDEs which generate infinite-dimensional dissipative systems. This text, which adapts readily to advanced graduate coursework in dissipative dynamics, requires some background knowledge in evolutionary equations and introductory functional analysis as well as a basic understanding of PDEs and the theory of random processes. Suitable for researchers in synchronization theory, the book is also relevant to physicists and engineers interested in both the mathematical background and the methods for the asymptotic analysis of coupled infinite-dimensional dissipative systems that arise in continuum mechanics.

This book presents a treatise on the theory and modeling of second-order stationary processes, including an exposition on selected application areas that are important in the engineering and applied sciences. The foundational issues regarding stationary processes dealt with in the beginning of the book have a long history, starting in the 1940s with the work of Kolmogorov, Wiener, Cramér and his students, in particular Wold, and have since been refined and complemented by many others. Problems concerning the filtering and modeling of stationary random signals and systems have also been addressed and studied, fostered by the advent of modern digital computers, since the fundamental work of R.E. Kalman in the early 1960s. The book offers a unified and logically consistent view of the subject based on simple ideas from Hilbert space geometry and coordinate-free thinking. In this framework, the concepts of stochastic state space and state space modeling, based on the notionof the conditional independence of past and future flows of the relevant signals, are revealed to be fundamentally unifying ideas. The book, based on over 30 years of original research, represents a valuable contribution that will inform the fields of stochastic modeling, estimation, system identification, and time series analysis for decades to come. It also provides the mathematical tools needed to grasp and analyze the structures of algorithms in stochastic systems theory.

This monograph introduces methods for handling filtering and control problems in nonlinear stochastic systems arising from network-induced phenomena consequent on limited communication capacity. Such phenomena include communication delay, packet dropout, signal quantization or saturation, randomly occurring nonlinearities and randomly occurring uncertainties.The text is self-contained, beginning with an introduction to nonlinear stochastic systems, network-induced phenomena and filtering and control, moving through a collection of the latest research results which focuses on the three aspects of:· the state-of-the-art of nonlinear filtering and control;· recent advances in recursive filtering and sliding mode control; and· their potential for application in networked control systems, and concluding with some ideas for future research work. New concepts such as the randomly occurring uncertainty and the probability-constrained performance index are proposed to make the network models as realistic as possible. The power of combinations of such recent tools as the completing-the-square and sums-of-squares techniques, Hamilton‒Jacobi‒Isaacs matrix inequalities, difference linear matrix inequalities and parameter-dependent matrix inequalities is exploited in treating the mathematical and computational challenges arising from nonlinearity and stochasticity.Nonlinear Stochastic Systems with Network-Induced Phenomena establishes a unified framework of control and filtering which will be of value to academic researchers in bringing structure to problems associated with an important class of networked system and offering new means of solving them. The significance of the new concepts, models and methods presented for practical control engineering and signal processing will also make it a valuable reference for engineers dealing with nonlinear control and filteringproblems.

This second edition of Mathematical Methods in the Robust Control of Linear Stochastic Systems includes a large number of recent results in the control of linear stochastic systems. More specifically, the new results presented are: - A unified and abstract framework for Riccati type equations arising in the stochastic control- Stability and control problems for systems perturbed by homogeneous Markov processes with infinite number of states- Mixed H2 / H∞ control problem and numerical procedures- Linear differential equations with positive evolution on ordered Banach spaces with applications for stochastic systems including both multiplicative white noise and Markovian jumps represented by a Markov chain with countable infinite set of states- Kalman filtering for stochastic systems subject both to state dependent noise and Markovian jumps- H∞ reduced order filters for stochastic systems The book will appeal to graduate students, researchers in advanced control engineering, finance, mathematical systems theory, applied probability and stochastic processes, and numerical analysis.From Reviews of the First Edition: This book is concerned with robust control of stochastic systems. One of the main features is its coverage of jump Markovian systems. … Overall, this book presents results taking into consideration both white noise and Markov chain perturbations. It is clearly written and should be useful for people working in applied mathematics and in control and systems theory. The references cited provide further reading sources. (George Yin, Mathematical Reviews, Issue 2007 m)This book considers linear time varying stochastic systems, subjected to white noise disturbances and system parameter Markovian jumping, in the context of optimal control … robust stabilization, and disturbanceattenuation. … The material presented in the book is organized in seven chapters. … The book is very well written and organized. … is a valuable reference for all researchers and graduate students in applied mathematics and control engineering interested in linear stochastic time varying control systems with Markovian parameter jumping and white noise disturbances.(Zoran Gajic, SIAM Review, Vol. 49 (3), 2007)

Nonlinear Stochastic Processes addresses the frequently-encountered problem of incomplete information. The causes of this problem considered here include: missing measurements; sensor delays and saturation; quantization effects; and signal sampling. Divided into three parts, the text begins with a focus on H∞ filtering and control problems associated with general classes of nonlinear stochastic discrete-time systems. Filtering problems are considered in the second part, and in the third the theory and techniques previously developed are applied to the solution of issues arising in complex networks with the design of sampled-data-based controllers and filters. Among its highlights, the text provides: • a unified framework for filtering and control problems in complex communication networks with limited bandwidth; • new concepts such as random sensor and signal saturations for more realistic modeling; and • demonstration of the use of techniques such as the Hamilton–Jacobi–Isaacs, difference linear matrix, and parameter-dependent matrix inequalities and sums of squares to handle the computational challenges inherent in these systems. The collection of recent research results presented in Nonlinear Stochastic Processes will be of interest to academic researchers in control and signal processing. Graduate students working with communication networks with lossy information and control of stochastic systems will also benefit from reading the book.

The problem of controlling or stabilizing a system of differential equa­ tions in the presence of random disturbances is intuitively appealing and has been a motivating force behind a wide variety of results grouped loosely together under the heading of'Stochastic Control.'This book is concerned with a special instance of this general problem, the'Adaptive LQ Regulator,'which is a stochastic control problem of partially observed type that can, in certain cases, be solved explicitly. We first describe this problem, as it is the focal point for the entire book, and then describe the contents of the book. The problem revolves around an uncertain linear system x(O) = x~ in R', where 0 E {1,..., N} is a random variable representing this uncertainty and (Ai'B, C) and xJ are the coefficient matrices and initial state, respectively, of j j a linear control system, for eachj = 1,..., N. A common assumption is that the mechanism causing this uncertainty is additive noise, and that conse­ quently the'controller'has access only to the observation process y(.) where y = Cex +~.

This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include various aspects of dynamic programming, approximation algorithms, and infinite-dimensional linear programming. In all, the work comprises 18 carefully selected papers written by experts in their respective fields. Optimization, Control, and Applications of Stochastic Systems will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and dynamic games.

The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. Because such problems are infinite-dimensional, many new issues arise in getting good numerical approximations and in the convergence proofs. Useful forms of numerical algorithms and system approximations are developed in this work, and the convergence proofs are given. All of the usual cost functions are treated as well as singular and impulsive controls. A major concern is on representations and approximations that use minimal memory. Features and topics include: • Surveys properties of the most important stochastic dynamical models, including singular control, and those for diffusion and reflected diffusion models. • Gives approximations to the dynamical models that simplify the numerical problem, but have only small effects on the behavior. • Develops an ergodic theory for reflected diffusions with delays, as well as model simplifications useful for numerical approximations for average cost per unit time problems. • Provides numerical algorithms for models with delays in the path, or path and control, with reduced memory requirements. • Develops transformations of the problem that yield more efficient approximations when the control, driving Wiener process, and/or reflection processes might be delayed, as well as the path. • Presents examples with applications to control and modern communications systems. The book is the first on the subject and will be of interest to all those who work with stochastic delay equations and whose main interest is in either the use of the algorithms or the underlying mathematics. An excellent resource for graduate students, researchers, and practitioners, the work may be used as a graduate-level textbook for a special topics course or seminar on numerical methods in stochastic control.

Linear stochastic systems are successfully used to provide mathematical models for real processes in fields such as aerospace engineering, communications, manufacturing, finance and economy. This monograph presents a useful methodology for the control of such stochastic systems with a focus on robust stabilization in the mean square, linear quadratic control, the disturbance attenuation problem, and robust stabilization with respect to dynamic and parametric uncertainty. Systems with both multiplicative white noise and Markovian jumping are covered. Key Features:-Covers the necessary pre-requisites from probability theory, stochastic processes, stochastic integrals and stochastic differential equations-Includes detailed treatment of the fundamental properties of stochastic systems subjected both to multiplicative white noise and to jump Markovian perturbations-Systematic presentation leads the reader in a natural way to the original results-New theoretical results accompanied by detailed numerical examples-Proposes new numerical algorithms to solve coupled matrix algebraic Riccati equations. The unique monograph is geared to researchers and graduate students in advanced control engineering, applied mathematics, mathematical systems theory and finance. It is also accessible to undergraduate students with a fundamental knowledge in the theory of stochastic systems.

Stochastic switching systems represent an interesting class of systems that can be used to model a variety of systems having abrupt random changes in their dynamics. Such systems may be found in the fields of manufacturing, communications, aerospace, power, and economics. This work presents stochastic switching systems and provides up-to-date methods and techniques for the analysis and design of various control systems with or without uncertainties. An introductory chapter highlights basic concepts and practical models, which are then used to solve more advanced problems throughout the book. Included are many numerical examples as well as LMI analysis methods and design approaches to supplement the developed results. Stochastic Switching Systems may be used as a supplementary textbook for graduate-level engineering courses, or as a reference for control engineers, graduate students, and researchers in systems and control. Prerequisites include elementary courses in matrix theory, probability, optimization techniques, and control systems theory.

Safety critical and high-integrity systems, such as industrial plants and economic systems can be subject to abrupt changes - for instance due to component or interconnection failure, and sudden environment changes etc. Combining probability and operator theory, Discrete-Time Markov Jump Linear Systems provides a unified and rigorous treatment of recent results for the control theory of discrete jump linear systems, which are used in these areas of application. The book is designed for experts in linear systems with Markov jump parameters, but is also of interest for specialists in stochastic control since it presents stochastic control problems for which an explicit solution is possible - making the book suitable for course use. From the reviews:'This text is very well written...it may prove valuable to those who work in the area, are at home with its mathematics, and are interested in stability of linear systems, optimal control, and filtering.'Journal of the American Statistical Association, December 2005

Nonlinear Stochastic Operator Equations deals with realistic solutions of the nonlinear stochastic equations arising from the modeling of frontier problems in many fields of science. This book also discusses a wide class of equations to provide modeling of problems concerning physics, engineering, operations research, systems analysis, biology, medicine. This text discusses operator equations and the decomposition method. This book also explains the limitations, restrictions and assumptions made in differential equations involving stochastic process coefficients (the stochastic operator case), which yield results very different from the needs of the actual physical problem. Real-world application of mathematics to actual physical problems, requires making a reasonable model that is both realistic and solvable. The decomposition approach or model is an approximation method to solve a wide range of problems. This book explains an inherent feature of real systems—known as nonlinear behavior—that occurs frequently in nuclear reactors, in physiological systems, or in cellular growth. This text also discusses stochastic operator equations with linear boundary conditions. This book is intended for students with a mathematics background, particularly senior undergraduate and graduate students of advanced mathematics, of the physical or engineering sciences.