Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications

  • Park, Jihong; 
  • Samarakoon, Sumudu; 
  • Elgabli, Anis; 
  • Kim, Joongheon; 
  • Bennis, Mehdi; 
  • 외 2명
Citations

WEB OF SCIENCE

162
Citations

SCOPUS

193

초록

Machine learning (ML) is a promising enabler for the fifth-generation (5G) communication systems and beyond. By imbuing intelligence into the network edge, edge nodes can proactively carry out decision-making and, thereby, react to local environmental changes and disturbances while experiencing zero communication latency. To achieve this goal, it is essential to cater for high ML inference accuracy at scale under the time-varying channel and network dynamics, by continuously exchanging fresh data and ML model updates in a distributed way. Taming this new kind of data traffic boils down to improving the communication efficiency of distributed learning by optimizing communication payload types, transmission techniques, and scheduling, as well as ML architectures, algorithms, and data processing methods. To this end, this article aims to provide a holistic overview of relevant communication and ML principles and, thereby, present communication-efficient and distributed learning frameworks with selected use cases.

키워드

Data models; Training; Distributed databases; Wireless sensor networks; Network topology; 5G mobile communication; Servers; 6G; beyond 5G; beyond federated learning (FL); communication efficiency; distributed machine learning; NEURAL-NETWORKS; LATENCY; TRENDS
제목
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
저자
Park, Jihong; Samarakoon, Sumudu; Elgabli, Anis; Kim, Joongheon; Bennis, Mehdi; Kim, Seong-Lyun; Debbah, Merouane
DOI
10.1109/JPROC.2021.3055679
발행일
2021-05
유형
Article
저널명
Proceedings of the IEEE
권
109
호
5
페이지
796 ~ 819