ABD-HFL: Byzantine-resistant Decentralized Hierarchical Federated Learning - CNRS - Centre national de la recherche scientifique
Rapport (Rapport Technique) Année : 2024

ABD-HFL: Byzantine-resistant Decentralized Hierarchical Federated Learning

Résumé

Hierarchical federated learning (HFL) has attracted academic attention to improve the efficiency of federated learning (FL) in real-world applications, however, little research has been done to explore the structural advantages of HFL against Byzantine attacks and to investigate how to make HFL immune to top-level server Single Point of Failure (SPOF). To explore this field and improve the robustness of HFL, we propose a novel generalized paradigm ABD-HFL for asynchronous Byzantineresistant decentralized hierarchical federated learning, a multitier structure without a central server for FL tasks with a large number of devices. Based on the layered structure, an innovative universal Byzantine resistance mechanism is designed in ABD-HFL, which enables it to apply a combination of multiple Byzantine robust techniques, making ABD-HFL more powerful than any single application of such techniques. Besides, ABDHFL is a fully decentralized HFL, there is no central server, but rather multiple nodes at the top level agree on the global model where malicious model updates are excluded. A new concept of pipeline learning workflow is also introduced to study communication efficiency in ABD-HFL, which is based on asynchronous communication between various levels to train and propagate the global model. Our numerical evaluation validates the advantage of ABD-HFL in terms of robustness and communication efficiency.
Fichier principal
Vignette du fichier
ABD-HFL.pdf (679.15 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04627430 , version 1 (27-06-2024)

Identifiants

  • HAL Id : hal-04627430 , version 1

Citer

Tengfei An, Maria Potop-Butucaru, Sébastien Tixeuil, Serge Fdida. ABD-HFL: Byzantine-resistant Decentralized Hierarchical Federated Learning. LIP6, Sorbonne Université, CNRS, UMR 7606. 2024. ⟨hal-04627430⟩
120 Consultations
52 Téléchargements

Partager

More