Optimization-Guided Reinforcement Learning Approach for Efficient Microservice Deployment in Edge Computing Environments
- 문서 유형
- 연구출판물 · 학술지 논문
- 등재
- SCIEScopus
- 저널 순위
- JCR Q1Scopus Q1
- 피인용
- Scopus 0
- JCR IF
- JCR 2024 5.4
- ISSN
- 2168-6750
저자
- 누그로호 아빌리아 쿠수마푸테이제1저자Pusan National University, Department of Computer Science and Engineering, Busan, Republic of Korea
- Lin, Jenn-WeiFu Jen Catholic University, Department of Computer Science and Information Engineering, New Taipei City, Taiwan
- 김태운교신저자Pusan National University, Department of Computer Science and Engineering, Busan, Republic of Korea
- Kuo, Po-HsienFu Jen Catholic University, Department of Computer Science and Information Engineering, New Taipei City, Taiwan
초록
Microservice-based edge computing decomposes applications into lightweight services that can be deployed near users to reduce service latency. However, practical edge environments must balance latency reduction and edge-serving efficiency: aggressively minimizing latency may overload limited edge resources, whereas prioritizing edge utilization may increase congestion and degrade service quality. This paper studies the multi-objective microservice deployment problem (MOMDP), which jointly minimizes the average waiting time of service requests and maximizes the fraction of requests served by edge servers. We formulate MOMDP as a mixed-integer linear programming (MILP) problem under demand conservation, service-placement coupling, coverage, CPU, memory, and cloud offloading constraints. Since solving the MILP online is impractical under dynamic workloads, we propose an optimization guided deep deterministic policy gradient (DDPG) framework. The framework uses a relaxed optimization layer to project actor generated deployment and resource-allocation preferences into feasible executable decisions, enabling adaptation to time-varying demand while satisfying system constraints. Extensive simulations across multiple demand profiles show that DDPG+Optimization achieves lower average waiting time, higher edge-serving ratios, and reduced cloud dependency compared with the baseline methods.
키워드
DDPGedge computingMicroservice deploymentmulti-objective optimizationreinforcement learning
식별자
- Scopus EID
- 2-s2.0-105050388266



로그인
연구물 목록으로