Skip to content

Deep Reinforcement Learning for Energy-Efficient Federated Learning in UAV-Enabled Wireless Powered Networks

Document Type
Publications · Journal Article
Registered DB
SCIEScopus
Journal Ranking
JCR Q2Scopus Q1
Journal
IEEE COMMUNICATIONS LETTERS26(1) · pp.99 · 2022
Citation
Web of Science 86Scopus 95
FWCI (Scopus)
6.04
JCR IF
JCR 2021 3.553
ISSN
1089-7798

Authors

  1. Quang Vinh DoFirst authorPusan Natl Univ, Artificial Intelligence Res Ctr, Busan 46241, South Korea
  2. Pham, Quoc-VietPusan Natl Univ, Korean Southeast Ctr Ind Revolut Leader Educ 4, Busan 46241, South Korea
  3. Hwang, WonjooCorresponding authorPusan Natl Univ, Dept Biomed Convergence Engn, Gyeongsangnam 50612, South Korea

Abstract

Federated learning (FL) is a promising solution to privacy preservation for data-driven deep learning approaches. However, enabling FL in unmanned aerial vehicle (UAV)-assisted wireless networks is still challenging due to limited resources and battery capacity in the UAV and user devices. In this regard, we propose a deep reinforcement learning (DRL)-based framework for joint UAV placement and resource allocation to enable sustainable FL with energy harvesting user devices. We aim to maximize the long-term FL performance considering the limited resources in the network, such as harvested energy, bandwidth resources, and UAV's energy budget. To reduce the complexity of the original problem, we leverage the Lyapunov optimization technique to transform a long-term energy constraint into a deterministic problem. We reformulate the optimization problem as the framework of a Markov decision process (MDP) and design a DRL-based algorithm to solve the MDP. The proposed solution can guarantee the sustainable operation of UAV-aided wireless networks by improving energy conservation of the network in the long run.

Keywords

Unmanned aerial vehiclesTrainingEnergy consumptionTask analysisBatteriesBandwidthOptimizationDeep reinforcement learningenergy harvestingfederated learningresource allocationunmanned aerial vehicleMAXIMIZATIONCHALLENGES

Identifiers

Scopus EID
2-s2.0-85118586333
WoS UID
000739999500024