Orchestrated Scheduling and Multi-Agent Deep Reinforcement Learning for Cloud-Assisted Multi-UAV Charging Systems
- Authors
- Jung, S.; Yun, W.J.; Shin, M.; Kim, J.; Kim, J.
- Issue Date
- 6월-2021
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- charging scheduling; Companies; Computational modeling; convex optimization; Energy resources; multi-agent deep reinforcement learning; Poles and towers; Processor scheduling; Resource management; Unmanned aerial vehicles; Unmanned aerial vehicles (UAVs)
- Citation
- IEEE Transactions on Vehicular Technology, v.70, no.6, pp.5362 - 5377
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE Transactions on Vehicular Technology
- Volume
- 70
- Number
- 6
- Start Page
- 5362
- End Page
- 5377
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/128803
- DOI
- 10.1109/TVT.2021.3062418
- ISSN
- 0018-9545
- Abstract
- This paper proposes a cloud-assisted joint charging scheduling and energy management framework for unmanned aerial vehicle (UAV) networks. For charging the UAVs those are extremely power hungry, charging towers are considered for plug-and-play charging during run-time operations. The charging towers should be cost-effective, thus it is equipped with photo-voltaic power generation and energy storage systems functionalities. Furthermore, the towers should be cooperative for more cost-effectiveness by intelligent energy sharing. Based on the needs and setting, this paper proposes 1) charging scheduling between UAVs and towers and 2) cooperative energy managements among towers. For charging scheduling, the UAVs and towers should be scheduled for maximizing charging energy amounts and the scheduled pairs should determine charging energy allocation amounts. Here, two decisions are correlated, i.e., it is a non-convex problem. We re-formulate the non-convex to convex for guaranteeing optimal solutions. Lastly, the cooperative energy sharing among towers is designed and implemented with multi-agent deep reinforcement learning and then intelligent energy sharing can be realized. We can observe that the two methods are related and it should be managed, coordinated, and harmonized by a centralized orchestration manager under the consideration of fairness, energy-efficiency, and cost-effectiveness. Our data-intensive performance evaluation verifies that our proposed framework achieves desired performance. IEEE
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.