강화학습 기반의 위성통신 빔호핑 최적화 기법

Abstract

In this paper, we suggest a reinforcement learning algorithm in satellite-aided communication system. Satellite-aided communication are drawing attention because it can increase stability and robustness of wireless communication. To improve the efficiency of satellite-aided communication, beamhopping method is introduced. In beamhopping, satellite beams are divided and operated in time-based system. The actual efficiency of beamhopping can be depend on the hopping pattern. To determine beamhopping pattern, we introduced multiplay Thompson sampling which is a family of reinforcement learning. We mathematically modeled the features of satellite communication and then applied reinforcement learning. By means of simulations, the performances of proposed learning were analyzed in terms of capacity and regret.