Running summarizing tools on a new article

Check the paper below, then start its synthesis.


Reducing the complexity of multiagent reinforcement learning

Andriy Burkov (Université Laval), Brahim Chaib-draa (Université Laval)

Adaptive Agents and Multi-Agents Systems
DOI: 10.1145/1329125.1329178 (Computer Science)
License: not stated (all rights reserved)

Abstract: It is known that the complexity of the reinforcement learning algorithms, such as Q-learning, may be exponential in the number of environment's states. It was shown, however, that the learning complexity for the goal-directed problems may be substantially reduced by initializing the Q-values with a "good" approximative function. In the multiagent case, there exists such a good approximation for a big class of problems, namely, for goal-directed stochastic games. These games, for example, can reflect coordination and common interest problems of cooperative robotics. The approximative function for these games is nothing but the relaxed, single-agent, problem solution, which can easily be found by each agent individually. In this article, we show that (1) an optimal single-agent solution is a "good" approximation for the goal-directed stochastic games with action-penalty representation and (b) the complexity is reduced when the learning is initialized with this approximative function, as compared to the uninformed case.

Published on 14 May. 2007