Search

This article investigates the optimally distributed consensus control problem for discrete-time multiagent systems with completely unknown dynamics and computational ability differences. The problem can be viewed as solving nonzero-sum games with distributed reinforcement learning (RL), and each agent is a player in these games. First, to guarantee the real-time performance of learning algorithms, a data-based distributed control algorithm is proposed for multiagent systems using offline system interaction data sets. By utilizing the interactive data produced during the run of a real-time system, the proposed algorithm improves system performance based on distributed policy gradient RL. The convergence and stability are guaranteed based on functional analysis and the Lyapunov method. Second, to address asynchronous learning caused by computational ability differences in multiagent systems, the proposed algorithm is extended to an asynchronous version in which executing policy improvement or not of each agent is independent of its neighbors. Furthermore, an actor-critic structure, which contains two neural networks, is developed to implement the proposed algorithm in synchronous and asynchronous cases. Based on the method of weighted residuals, the convergence and optimality of the neural networks are guaranteed by proving the approximation errors converge to zero. Finally, simulations are conducted to show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

This paper investigates the cooperative output regulation problem for heterogeneous multiagent systems (MASs) under switching topology. Two novel distributed event-triggered adaptive control strategies based on state feedback and output feedback are developed, which can avoid using the minimal nonzero eigenvalue of Laplacian matrix associated with global system topologies. It is shown that under the proposed control protocols, MASs could achieve asymptotic tracking and disturbance rejection, and meanwhile, the amount of transmission data and communication cost among agents can be reduced. Then, the leader-following consensus problem of MASs is given as an application of our main results. Finally, an example is presented to verify the effectiveness of the proposed control schemes. [ABSTRACT FROM AUTHOR]

This paper is concerned with the consensus problem for multi-agent systems with switching topology. A novel distributed control strategy is proposed to reduce the frequency of controller update and save network resources. Based on communication uncertainty of practical networks, partial information exchange and switching topology which subjects to a heterogeneous Markov chain are considered in controller design. An H ∞ consensus criterion is derived by using linear matrix inequality and Lyapunov methods. According to this consensus criterion, a sufficient condition on designing H ∞ state-feedback controller is presented. Finally, a simulation example is given to illustrate the effectiveness of the proposed event-based control strategy. [ABSTRACT FROM AUTHOR]

This paper addresses the bearing-only distributed localization, which is more accurate and more reliable than traditional localization technologies. A new bearing-only distributed localization framework is proposed to solve localization problems for both static sensor networks and mobile multi-agent systems (MASs). Based on the complex coordinate representation, a novel bearing-only distributed localization algorithm for sensor networks is proposed. The algorithm combines the orientation estimation and the position estimation to solve the orientation alignment problem, which makes the compasses no longer needed for the localized networks. The localization for the mobile MASs is also studied and the corresponding localization algorithm is designed, which is more general and more challenging. The key to obtaining positions of moving agents, is the velocity estimator in the proposed localization algorithm which makes the estimated positions and velocities converge to the true value simultaneously. A distinctive advantage of the localization framework proposed in this paper is that the bearing-only localization algorithms can be applied to more general systems, such as sensor networks and MASs. Simulations and experiment are presented to verify the proposed algorithms. [ABSTRACT FROM AUTHOR]

This article aims to point out an error in the concerned paper and a possible correction to address the error. The correction is achieved by several revisions made on the corresponding assumption, event-triggering function, adaptive laws, and event-triggered control law. [ABSTRACT FROM AUTHOR]