Search

In this paper, we propose a new robust congestion- control strategy for a differentiated-services (DiffServ) network. A sliding-mode-based variable structure control technique is utilized to design a congestion controller on the basis of a fluid flow model. The performance of our proposed scheme is then demonstrated on a DiffServ network. Our proposed algorithm is developed for an interconnected network as a hop-by-hop distributed-control approach. A formal analysis of the controlled network is conducted, where it is shown that the error dynamics of the overall time-delay-dependent system is ℒ∞ stable. Numerical simulations are provided to demonstrate the capabilities of our proposed methodology. [ABSTRACT FROM AUTHOR]

In this paper we introduce a novel reinforcement learning algorithm called event-learning. The algorithm uses events, ordered pairs of two consecutive states. We define event-value function and we derive learning rules. Combining our method with a well-known robust control method, the SDS algorithm, we introduce Robust Policy Heuristics (RPH). It is shown that RPH, a fast-adapting non-Markovian policy, is particularly useful for coarse models of the environment and could be useful for some partially observed systems. RPH may be of help in alleviating the ‘curse of dimensionality’ problem. Event-learning and RPH can be used to separate time scales of learning of value functions and adaptation. We argue that the definition of modules is straightforward for event-learning and event-learning makes planning feasible in the RL framework. Computer simulations of a rotational inverted pendulum with coarse discretization are shown to demonstrate the principle. [Copyright &y& Elsevier]