On Data Processing through the Lenses of S3 Object Lambda

Pablo Gimeno Sarroca, Marc Sánchez-Artigas

IEEE INFOCOM 2023 - IEEE Conference on Computer Communications, 2023

PDF (accepted manuscript) Published version (DOI) Code

Abstract

Despite that Function-as-a-Service (FaaS) has settled down as one of the fundamental cloud programming models, it is still evolving quickly. Recently, Amazon has introduced S3 Object Lambda, which allows a user-defined function to be automatically invoked to process an object as it is being downloaded from S3. As with any new feature, careful study thereof is the key to elucidate if S3 Object Lambda, or more generally, if inline serverless data processing, is a valuable addition to the cloud. For this reason, we conduct an extensive measurement study of this novel service, in order to characterize its architecture and performance (in terms of coldstart latency, TTFB times, and more). We particularly put an eye on the streaming capabilities of this new form of function, as it may open the door to empower existing serverless systems with stream processing capacities. We discuss the pros and cons of this new capability through several workloads, concluding that S3 Object Lambda can go far beyond its original purpose and be leveraged as a building block for more complex abstractions.

Funding

This research has been partly supported by the EU through the Horizon Europe programme (No. 101092646, No. 101092644) and the Spanish Government (No. PID2019-106774RB-22). Marc Sánchez-Artigas is a Serra Húnter Fellow. Pablo Gimeno Sarroca is a Martí Franquès Research Grant Fellow (Banco Santander Ed.).

Cite this paper

@inproceedings{gimeno2023objectlambda,
  title     = {On Data Processing through the Lenses of {S3} Object Lambda},
  author    = {Gimeno Sarroca, Pablo and S{\'a}nchez-Artigas, Marc},
  booktitle = {IEEE INFOCOM 2023 - IEEE Conference on Computer Communications},
  address   = {New York City, NY, USA},
  pages     = {1--10},
  publisher = {IEEE},
  year      = {2023},
  doi       = {10.1109/INFOCOM53939.2023.10228890}
}

© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.