Faa$T: A transparent auto-scaling cache for serverless applications

82Citations
Citations of this article
76Readers
Mendeley users who have this article in their library.
Get full text

Abstract

Function-as-a-Service (FaaS) has become an increasingly popular way for users to deploy their applications without the burden of managing the underlying infrastructure. However, existing FaaS platforms rely on remote storage to maintain state, limiting the set of applications that can be run efficiently. Recent caching work for FaaS platforms has tried to address this problem, but has fallen short: it disregards the widely different characteristics of FaaS applications, does not scale the cache based on data access patterns, or requires changes to applications. To address these limitations, we present Faa$T, a transparent auto-scaling distributed cache for serverless applications. Each application gets its own cache. After a function executes and the application becomes inactive, the cache is unloaded from memory with the application. Upon reloading for the next invocation, Faa$T pre-warms the cache with objects likely to be accessed. In addition to traditional compute-based scaling, Faa$T scales based on working set and object sizes to manage cache space and I/O bandwidth. We motivate our design with a comprehensive study of data access patterns on Azure Functions. We implement Faa$T for Azure Functions, and show that Faa$T can improve performance by up to 92% (57% on average) for challenging applications, and reduce cost for most users compared to state-of-the-art caching systems, i.e. the cost of having to stand up additional serverful resources.

Cite

CITATION STYLE

APA

Romero, F., Chaudhry, G. I., Goiri, Í., Gopa, P., Batum, P., Yadwadkar, N. J., … Bianchini, R. (2021). Faa$T: A transparent auto-scaling cache for serverless applications. In SoCC 2021 - Proceedings of the 2021 ACM Symposium on Cloud Computing (pp. 122–137). Association for Computing Machinery, Inc. https://doi.org/10.1145/3472883.3486974

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free