Search

Monte Carlo Tree Search (MCTS) is a pronounced empirical search algorithm for agent decision-making, especially when enhanced by Deep Learning (DL), in mastering board games that were once thought to be unconquerable. However, it does not appear to be as equally successful in the domain of real-time video games, where the simulation time limit for exploration is a crucial factor, since they are generally designed to be played by human users and hence require a significant amount of resources for simulation. We in this paper propose a surrogate-assisted MCTS approach, specifically targeting commercial real-time video games by approximating the result of gameplay with a deep-learning-based surrogate model. The key contribution of our work is that we designed a modified MCTS for video games that are both commercial and processed in real-time. Since commercial video games include considerably more complex and dynamic gameplays to satisfy their market consumers, as opposed to their non-commercial analogs, our work can be regarded as having challenged the domain unattempted by precedent studies. We validated the performance of our method by conducting a comparative experiment with other algorithms, including the traditional MCTS, under the environment of a commercial real-time video game. [Display omitted] • A Monte Carlo tree search (MCTS) method applicable to commercial real-time video games is proposed. • The method integrates MCTS with a deep neural network structure to function efficiently in a real-time environment. • Performance verification of the proposed surrogate-assisted MCTS is done via two commercial real-time video games with distinct features. • Our surrogate model can be trained with a comparatively little amount of computational resources in real-time video games. [ABSTRACT FROM AUTHOR]

Monte Carlo Tree Search (MCTS) is a pronounced empirical search algorithm for agent decision-making, especially when enhanced by Deep Learning (DL), in mastering board games that were once thought to be unconquerable. However, it does not appear to be as equally successful in the domain of real-time video games, where the simulation time limit for exploration is a crucial factor, since they are generally designed to be played by human users and hence require a significant amount of resources for simulation. We in this paper propose a surrogate-assisted MCTS approach, specifically targeting commercial real-time video games by approximating the result of gameplay with a deep-learning-based surrogate model. The key contribution of our work is that we designed a modified MCTS for video games that are both commercial and processed in real-time. Since commercial video games include considerably more complex and dynamic gameplays to satisfy their market consumers, as opposed to their non-commercial analogs, our work can be regarded as having challenged the domain unattempted by precedent studies. We validated the performance of our method by conducting a comparative experiment with other algorithms, including the traditional MCTS, under the environment of a commercial real-time video game. [Display omitted] • A Monte Carlo tree search (MCTS) method applicable to commercial real-time video games is proposed. • The method integrates MCTS with a deep neural network structure to function efficiently in a real-time environment. • Performance verification of the proposed surrogate-assisted MCTS is done via two commercial real-time video games with distinct features. • Our surrogate model can be trained with a comparatively little amount of computational resources in real-time video games. [ABSTRACT FROM AUTHOR]