본문 바로가기

Rate maximization with reinforcement learning for time-varying energy harvesting broadcast channels

문서 유형
연구출판물 · 학술대회 발표논문
등재
Scopus
피인용
Scopus 6
FWCI (Scopus)
0.93

저자

  1. Kim, Heasung제1저자Department of Electrical and Computer Engineering, Seoul National University, Seoul, Korea
  2. 신원재Department of Electrical Engineering, Pusan National University, Seoul, Korea
  3. Yang, HeecheolSchool of Electronic Engineering, Kumoh National Institute of Technology, Gumi, Korea
  4. Lee, NayoungDepartment of Electrical and Computer Engineering, Seoul National University, Seoul, Korea
  5. Lee, JungwooDepartment of Electrical and Computer Engineering, Seoul National University, Seoul, Korea

초록

© 2019 IEEE.In this paper, we consider a power allocation optimization technique for a time-varying fading broadcast channel in energy harvesting communication systems, in which a transmitter with a rechargeable battery transmits messages to receivers using the harvested energy. We first prove that the optimal online power allocation policy for the sum rate maximization of the transmitter is an increasing function of harvested energy, remaining battery, and each user's channel gain. We then construct an appropriate neural network by relying on increasing behavior of the optimal policy. This two-step approach, by using an effective function approximation as well as providing a fundamental guideline for neural network design, can prevent us from wasting the representational capacity of neural networks. On the basis of the neural network, we apply the policy gradient method to solve the power allocation problem. To validate the performance of our approach, we compare it with the closed-form the optimal policy in a partially observable Markov problem. Through further experiments, it is observed that our online solution achieves a performance close to the theoretical upper bound of the performance in a time-varying fading broadcast channel.

식별자

Scopus EID
2-s2.0-85081948031