TAKAHAMA Setsuko
   Department   Hiroshima shudo University  The Faculty of Commercial Sciences
   Position   Professor
Language English
Publication Date 2022/02
Type books
Title A Study on Multi-Armed Bandit Algorithms for Dynamic Selection of Parameters and Topologies in Particle Swarm Optimization
Contribution Type Contributor
Journal Operations Researche and Information Systems
Journal TypeJapan
Publisher Kyushu University Press
Volume, Issue, Pages pp.21-48
Number of pages 28
Author and coauthor Setsuko Sakai and Tetsuyuki Takahama
Details The multi-armed bandit problem is defined as maximizing the total reward when the reward of each choice is unknown and a choice is sequentially selected from multiple choices. Particle Swarm Optimization (PSO) has been successfully applied to various optimization problems. Various parameter (including topology) settings are known for PSO, but it is difficult to determine the appropriate setting because the setting depends on the problem to be solved and the search process. In this study, we propose to apply bandit algorithms to the parameter setting. If a new position after a movement is better than the personal best position found so far, the reward is 1 as success, otherwise the reward is 0 as failure. The setting that maximizes the cumulative reward is discovered by the bandit algorithms. The effectiveness of the proposed method is shown by introducing the method to PSO and optimizing 13 benchmark problems.
ISBN 9784798503264