Search

In this article, we investigate a novel reinforcement-learning (RL)-based scheme to address the optimal leader–follower consensus issue for constrained-input continuous-time multiagent systems. First, as for input-constrained problems, the fundamental smooth assumption is not satisfied for the value function. To deal with this problem, we employ the method of vanishing viscosity solutions to relax this smooth assumption to a continuity assumption for the value function, which broadens the scope of RL applications. Second, the control cost functions take a more general form which guarantees the continuity of the optimal control policy instead of the specific integrand form used in previous input-constrained RL-based schemes. Based on these results, we introduce a novel identifier–critic–actor structure to extend the conventional critic–actor RL framework into a distributed model-free one, where the learning of the identifier, critic, and actor is online and simultaneous. We provide the simulation examples to validate the effectiveness of the proposed scheme. [ABSTRACT FROM AUTHOR]

Relative states between neighbors are ubiquitous in large-scale systems, and the relative state saturations need to be considered when designing controllers based on this relative state information. This article investigates the consensus control of the delayed multiagent systems under the relative state saturations. By means of an incidence matrix, the consensus under the relative state saturations is transformed into the stability of edge dynamics operating on constrained sets. To enable the edge states to stay within the constrained sets, a novel nonlinear protocol is designed by embedding an elaborate saturation function. Sufficient conditions are identified, under which not only consensus is achieved but also relative state saturations do not occur. Moreover, this analytical result can address the consensus problem while preserving connectivity, within the limited communication range framework. Simulations illustrate the theoretical results. [ABSTRACT FROM AUTHOR]

This article investigates the consensus tracking of exponentially unstable multiagent systems with time-varying input delay. The truncated predictor feedback approach is utilized for designing delay-dependent state and output feedback protocols. And the explicit conditions that can realize consensus tracking are established in terms of parametric Lyapunov equations and scalar inequalities. Besides, the protocol design algorithms under the maximum allowable delay and the maximum convergence rate are, respectively, provided. Compared with the existing results, the salient characteristic of the current results is to reveal the quantitative relationship among the time delay, unstable plant, network topologies, and the convergence rate. Specifically, for achieving the consensus tracking, the synchronization force from network connectivity needs to dominate the anti-synchronization force from unstable open-loop poles and input delays; the maximum allowable input delay is inversely proportional to the sum of the unstable open-loop poles; the convergence rate becomes smaller as the input delay bounds or/and the sum of the unstable poles in plant increase. Numerical simulations confirm the effectiveness of the proposed theoretical design. [ABSTRACT FROM AUTHOR]

Within the multiagent systems framework, the relative states between neighbors can be acquired by some on-board sensors, and then the relative state saturations inevitably occur due to the limited sensing capabilities. This paper investigates the consensus problem of nonlinear multiagent systems subject to the relative state saturations. Utilizing the incidence matrix and the edge Laplacian, the consensus problem of nonlinear multiagent systems with the relative state saturations can be cast into the stabilization problem of edge dynamics operating on the constrained set. Three types of protocols, namely continuous, intermittent, and adaptive state feedback protocols are, respectively, proposed for achieving the constrained consensus, and meanwhile yielding consensus values. A consensus analysis is provided by virtue of state saturation theory, switched system theory, adaptive theory, and Lyapunov stability theory. Output feedback protocol is also designed. Finally, the obtained results are applied to connectivity preservation for first-order nonlinear multiagent systems, despite the presence of limited communication range and input constraints. The theoretical results are validated by two simulation examples. [ABSTRACT FROM AUTHOR]

This paper focuses on the leader-following consensus control problem of stochastic multi-agent systems with hysteresis inputs and nonlinear dynamics. A leader-following consensus scheme is presented for stochastic multi-agent systems directions under directed graphs, which can achieve predefined synchronisation error bounds. By mainly activating an auxiliary robust control component for pulling back the transient escaped from the neural active region, a multi-switching robust neuro adaptive controller in the neural approximation domain, which can achieve globally uniformly ultimately bounded tracking stability of multi-agent systems recently. A specific Nussbaum-type function is introduced to solve the problem of unknown control directions. Using a dynamic surface control technique, distributed consensus controllers are developed to guarantee that the outputs of all followers synchronise with that of the leader with prescribed performance. Based on Lyapunov stability theory, it is proved that all signals in closed-loop systems are uniformly ultimately bounded and all the follower agents can keep consensus with the leader. Two simulation examples are provided to illustrate the effectiveness and advantage of the proposed control scheme. [ABSTRACT FROM AUTHOR]

This paper addresses an observer-based consensus problem for leader-following control of a class of linear multi-agent systems (MASs) under a directed communication topology via event-triggered approaches. State observers are employed to tackle the scenario wherein inner information of the follower agents are not available for measurement. And then, an observer-based distributed leader-following control scheme is developed on the basis of event-triggered mechanisms. Further, to avoid continuous measurement information monitor, we present a technical approach for generation of the combinational information from their own neighbouring agents only at triggered instants. In theory, the stability of the resulting closed-loop system is rigorously investigated, and it is proven that all signals in the closed-loop system are bounded and Zeno behaviour is also excluded. Finally, simulation examples are presented for illustration of the theoretical claims. [ABSTRACT FROM AUTHOR]

In this paper, we are concerned with the output tracking consensus matter for a class of pure-feedback nonlinear multi-agent systems (MASs) with actuator failures comprising loss of effectiveness and bias. Taking advantage of relative information from individual agents and their neighbors, a distributed adaptive fault-tolerant control strategy is proposed recursively by the approximation property of neural networks (NNs), backstepping methods, dynamic surface control (DSC) methodology and algebraic graph theory. The distinct features of this control approach are that it is not of requirement of prior information of individual agents with the help of approximation property, and the online update parameters are the norms of NNs weight vectors instead of weight vectors themselves. Also, it reduces the computational burden considerably by introducing the DSC approach. The stability of the resulting closed-loop system is rigorously investigated and it is proven that the consensus tracking errors of the MASs under directed communication topology converge to a small adjustable neighborhood around the origin in spite of actuator failures. Two simulation examples, both practical and numerical ones, are presented to verify the effectiveness of the proposed approach. [ABSTRACT FROM AUTHOR]

This paper investigates the distributed adaptive event-triggered consensus control for a class of nonlinear agents. Each agent is subject to input saturation. Two kinds of distributed event-triggered control scheme are introduced, one is continuous-time-based event-triggered scheme and the other is sampled-data-based event-triggered scheme. Compared with the traditional event-triggered schemes in the existing literatures, the parameters of the event-triggered schemes in this paper are adaptively adjusted by using some event-error-dependent adaptive laws. The problem of simultaneously deriving the controller gain matrix and the event-triggering parameter matrix, and tackling the saturation nonlinearity is cast into standard linear matrix inequalities problem. A convincing simulation example is given to demonstrate the theoretical results. [ABSTRACT FROM AUTHOR]

The consensus tracking problem is discussed for a class of multi-agent systems (MASs) in non-affine pure-feedback form via output feedback approach under switching directed topologies. Observers are employed to reconstruct state information of the system, and then a consensus tracking control scheme is presented by the backstepping method combining with dynamic surface control (DSC) technique, neural networks (NNs), and graph theory. The main advantage of the proposed strategy is that it only relies on the output signals of individual agents in communication graph and it removes the requirement for exact priori knowledge about parameters of agents. Moreover, by introducing DSC technology, it avoids the well known problem of ‘explosion of complexity’ that conventional backstepping method suffers from along with the increasement of the degree of individual agents. It is proven that the designed output feedback control scheme guarantees consensus errors are cooperatively semiglobally uniformly ultimately bounded and converge to neighborhood of the origin by suitable choice of design parameters. Simulation results are presented to demonstrate the effectiveness of the proposed control approach. [ABSTRACT FROM AUTHOR]

This study is devoted to the consensus protocols design for a set of fractional‐order heterogeneous agents, which is composed of two kinds of agents differed by their dynamics and the fractional‐order α satisfies 0 < α < 2. Distributed state feedback consensus protocols are constructed for the two kinds of agents, respectively. Based on the Kronecker product technique and the fractional‐order stability theory, sufficient conditions are derived to ensure the consensus of heterogeneous multi‐agent systems in terms of linear matrix inequalities (LMIs). These can be solved numerically by LMI toolbox in Matlab. Finally, a simulation example is employed to validate the effectiveness of the theoretical results. [ABSTRACT FROM AUTHOR]

Containment control is an important issue in the consensus problem of multiagent systems (MASs). This article presents an output-based containment control strategy for a class of nonaffine nonlinear MASs with uncertainies and directed topology. With the help of differential homeomorphism transform and the idea of active disturbance rejection control (ADRC), a nonaffine nonlinear MAS is transformed into an affine one with uncertainties. Two filters with extended states in each follower are designed with the idea of extended state observer to reconstruct the states of the transformed MAS. Then, uncertainties of the MAS are compensated with the help of the estimations of the extended states. Moreover, the derivative of the virtual control signal in the backstepping technique is replaced by a tracking differentiator (TD), overcoming the so-called “explosion of complexity” problem. By means of Lyapunov theory, the containment errors of the followers are proven to converge to a small neighborhood around the origin via an appropriate choice of parameters. Simulation examples are provided to demonstrate the proposed control strategy. [ABSTRACT FROM AUTHOR]

This article considers integral sliding-mode control (ISMC) for multiagent systems with matched disturbances through adaptive dynamic programming (ADP) method. A distributed disturbance observer (DDO) is designed for each agent to generate the disturbance estimation. Using the disturbance estimation, an ISMC scheme is proposed to reject the input disturbance and obtain the equivalent local neighbor consensus sliding-mode dynamics. Then, a discount performance function is designed for each agent, and ADP technique is utilized to address the optimal consensus control for the equivalent sliding-mode dynamics online. Based on the gradient descent algorithm, we propose the adaptive weight tuning laws for the critic-actor neural networks (NNs) to carry out the ADP method. Furthermore, the local neighbor consensus errors and the weight estimation errors for the critic-actor NNs are proved to be uniformly ultimately bounded (UUB). Finally, the practical example is applied to validate the effectiveness of our results. [ABSTRACT FROM AUTHOR]

This paper focuses on a class of nonlinear switching multi-agent systems about event-triggered adaptive tracking control. Compared with existing results, the event-triggered mechanism is first employed in nonlinear switched multi-agent systems with unknown parameters, and it can reduce the amount of computation and the frequency of the controller updates. By utilizing the backstepping technology, adaptive laws are designed to analyze the unknown parameters. In the sequel, all signals of multi-agent systems are bounded, the tracking errors converge to a small neighborhood of the origin. Finally, simulation results verify the effectiveness of the proposed scheme. [ABSTRACT FROM AUTHOR]

This paper investigates leaderless consensus and leader-following consensus of multiagent systems with Lipschitz nonlinearity and input delay. For such systems, the observer-based truncated prediction feedback protocols are designed via dropping the distributed term and remaining the exponential term of the solution of the system equation over the delay period. Using Lyapunov–Krasovskii functional approach, two sufficient criteria are, respectively, established for achieving leaderless and leader-following consensus. The observer and controller gains are then obtained by means of an iterative linear matrix inequality procedure. A numerical simulation verifies the effectiveness of the proposed control design approach. [ABSTRACT FROM AUTHOR]

Within the framework of multiagent systems, relative information can be directly acquired by vehicle-mounted sensors and the relative information constraints inevitably occur due to limited sensing capabilities. This paper investigates observer-based consensus of nonlinear multiagent systems subject to relative state estimate constraints. Each agent’s state is constructed via a state observer, and the relative state estimate is assumed to be confined into a hypercube. In virtue of the edge Laplacian, the consensus problem of nonlinear multiagent systems under this constraint is converted into the stabilization problem of edge dynamics operating on the constrained set. Observer-based intermittent protocol and adaptive protocol are, respectively, designed for achieving consensus. A convergence analysis is provided with the help of state saturation theory, switched system theory and adaptive theory. Finally, the results on consensus with relate state estimate constraints are applied into the consensus problem while preserving the connectedness, and are validated by a simulation example. [ABSTRACT FROM AUTHOR]