Pré-Publication, Document De Travail Année : 2024

HEAL: Resilient and Self-* Hub-based Learning

Résumé

Decentralized learning enhances privacy, scalability, and fault tolerance by distributing data and computation across nodes. A popular approach is Federated learning, which relies on a central aggregator, yet faces challenges such as server vulnerabilities, scalability issues, privacy risks and most importantly, the single point of failure. Alternatively Gossip Learning and Epidemic Learning offer fully decentralization through peer-to-peer exchanges of model updates, ensuring robustness and privacy, at the price of slower model convergence. In this work, we introduce a novel decentralized learning framework called HEAL. HEAL is the first cross-layer decentralized learning framework that exploits an optimized self-organizing and self-healing underlying P2P overlay combining the strengths of Federated Learning, Gossip and Epidemic Learning. Leveraging the recently proposed Elevator algorithm, HEAL promotes dynamically chosen nodes to act as aggregators. Through simulations, we demonstrate that HEAL has similar performances to that of Federated Learning in crash-free settings, while being fully decentralized and fault-tolerant. In crash and churn prone environments HEAL outperforms Gossip and Epidemic Learning.

Fichier principal
Vignette du fichier
AINA2025Submission(3).pdf (617.46 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04855934 , version 1 (26-12-2024)

Identifiants

  • HAL Id : hal-04855934 , version 1

Citer

Mohamed Amine Legheraba, Stefan Galkiewicz, Maria Potop-Butucaru, Sébastien Tixeuil. HEAL: Resilient and Self-* Hub-based Learning. 2024. ⟨hal-04855934⟩
0 Consultations
0 Téléchargements

Partager

More