Load-aware shedding in stream processing systems - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Load-aware shedding in stream processing systems

Résumé

Load shedding is a technique employed by stream processing systems to handle unpredictable spikes in the input load whenever available computing resources are not adequately provisioned. A load shedder drops tuples to keep the input load below a critical threshold and thus avoid tuple queuing and system trashing. In this paper we propose Load-Aware Shedding (LAS), a novel load shedding solution that drops tuples with the aim of maintaining queuing times below a tunable threshold. Tuple execution durations are estimated at runtime using efficient sketch data structures. We provide a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and show its performance through a practical evaluation based both on simulations and on a running prototype.
Fichier principal
Vignette du fichier
main-no-cc.pdf (516.81 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01413212 , version 1 (12-12-2016)

Identifiants

Citer

Nicoló Rivetti, Yann Busnel, Leonardo Querzoni. Load-aware shedding in stream processing systems. 10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, ⟨10.1145/2933267.2933311⟩. ⟨hal-01413212⟩
727 Consultations
223 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More