OFC: an opportunistic caching system for FaaS platforms - Laboratoire d'Informatique de Grenoble Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

OFC: an opportunistic caching system for FaaS platforms

Lucien Ndjie
  • Fonction : Auteur
  • PersonId : 1242091
  • IdHAL : lndjie
Josiane Kouam
Jinho Hwang
  • Fonction : Auteur
Noël de Palma

Résumé

Cloud applications based on the "Functions as a Service" (FaaS) paradigm have become very popular. Yet, due to their stateless nature, they must frequently interact with an external data store, which limits their performance. To mitigate this issue, we introduce OFC, a transparent, vertically and horizontally elastic in-memory caching system for FaaS platforms, distributed over the worker nodes. OFC provides these benefits cost-effectively by exploiting two common sources of resource waste: (i) most cloud tenants overprovision the memory resources reserved for their functions because their footprint is non-trivially input-dependent and (ii) FaaS providers keep function sandboxes alive for several minutes to avoid cold starts. Using machine learning models adjusted for typical function input data categories (e.g., multimedia formats), OFC estimates the actual memory resources required by each function invocation and hoards the remaining capacity to feed the cache. We build our OFC prototype based on enhancements to the OpenWhisk FaaS platform, the Swift persistent object store, and the RAM-Cloud in-memory store. Using a diverse set of workloads, we show that OFC improves by up to 82 % and 60 % respectively the execution time of single-stage and pipelined functions.
Fichier principal
Vignette du fichier
main.pdf (2.89 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03211416 , version 1 (28-04-2021)

Identifiants

Citer

Djob Mvondo, Mathieu Bacou, Kevin Nguetchouang, Lucien Ndjie, Stéphane Pouget, et al.. OFC: an opportunistic caching system for FaaS platforms. EUROSYS 2021 - 16th European Conference on Computer Systems, Apr 2021, Edinburgh (online), United Kingdom. pp.228-244, ⟨10.1145/3447786.3456239⟩. ⟨hal-03211416⟩
467 Consultations
739 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More