Empirical Analysis of Asynchronous Federated Learning on Heterogeneous Devices: Efficiency, Fairness, and Privacy Trade-offs
2025 (English)Conference paper, Published paper (Refereed)
Abstract [en]
Device heterogeneity poses major challenges in Federated Learning (FL), where resource-constrained clients slow down synchronous schemes that wait for all updates before aggregation. Asynchronous FL addresses this by incorporating updates as they arrive, substantially improving efficiency. While its efficiency gains are well recognized, its privacy costs remain largely unexplored-particularly for high-end devices that contribute updates more frequently, increasing their cumulative privacy exposure. This paper presents the first comprehensive analysis of the efficiency-fairness-privacy trade-off in synchronous vs. asynchronous FL under realistic device heterogeneity. We empirically compare FedAvg and staleness-aware FedAsync using a physical testbed of five edge devices spanning diverse hardware tiers, integrating Local Differential Privacy (LDP) and the Moments Accountant to quantify per-client privacy loss. Using Speech Emotion Recognition (SER) as a privacy-critical benchmark, we show that FedAsync achieves up to 10× faster convergence but exacerbates fairness and privacy disparities: high-end devices contribute 6-10× more updates and incur up to 5× higher privacy loss, while low-end devices suffer amplified accuracy degradation due to infrequent, stale, and noise-perturbed updates. These findings motivate the need for adaptive FL protocols that jointly optimize aggregation and privacy mechanisms based on client capacity and participation dynamics, moving beyond static, one-size-fits-all solutions
Place, publisher, year, edition, pages
IEEE, 2025.
Series
Proceedings of the International Joint Conference on Neural Networks
Keywords [en]
Asynchronous FL, Device Heterogeneity, Differential Privacy, Federated Learning
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:ri:diva-80043DOI: 10.1109/IJCNN64981.2025.11228075Scopus ID: 2-s2.0-105023961584OAI: oai:DiVA.org:ri-80043DiVA, id: diva2:2022053
Conference
2025 International Joint Conference on Neural Networks, IJCNN 2025
Note
This work has been supported by the H2020 ECSEL EU project Distributed Artificial Intelligent System (DAIS) under grant agreement No. 101007273, and the Knowledge Foundation within the framework of INDTECH (Grant No. 20200132) and INDTECH+ Research School project (Grant No. 20220132). Additional funding was provided by the Research Council of Norway (RCN), Romania UEFISCDI, Spain CSCJA, Sweden Forte, under the Transforming Health and Care Systems (THCS, GA No. 101095654, EU Horizon Europe).
2025-12-162025-12-162025-12-16Bibliographically approved