Publications

2026

1. EXTRACT/TASKA: Towards a digital computing platform for modern radio astronomy

   B. Cecconi, J. N. Girard, C. Dumez-Viou, E. Mauduit, S. Aicardi, F. Nammour, E. Quiñones, B. Xandri-Zaragoza, E. Molina-Giménez, O. Martinéz, D. Barcelona-Pons, E. Hadad, L. Bondonneau, V. Landeau, A. Bellucci, and I. Penas

   In Planetary, Solar and Heliospheric Radio Emissions X, 2026

   Abs DOI Bib PDF

   

   The EXTRACT project (<https://extract-project.eu/>) aims to design a distributed data-mining software platform that can efficiently and smoothly orchestrate tasks across a continuum of computing resources, including edge devices, cloud systems, and high-performance computing centres. One use-case of EXTRACT is TASKA (Transient Astrophysics with an SKA Pathfinder), in which this platform will be used to process massive astronomy datasets, particularly those generated by the NenuFAR instrument, a SKA Pathfinder developed in Nançay, France. NenuFAR has the potential to produce up to 109 PB of raw data annually, necessitating on-site processing using carefully designed pipelines to reduce the dataset to approximately 1 PB per year. The TASKA project is structured into four distinct use cases: (a) Real-time detection of high-resolution events within beamformer data streams, seamlessly integrated with artificial intelligence algorithms. (b) The development of a modular and adaptable radio imaging pipeline, capable of operating on local, cloud, or high-performance computing resources. (c) The design of a novel dynamic radio imager, employing video reconstruction techniques and artificial intelligence, as an integral component of the radio imaging pipeline. (d) The creation of a spatial-temporal-spectral feature-matching tool, facilitating the integration of detected events with images generated by the imaging pipeline. The current status and results of TASKA activities demonstrate their application to NenuFAR data processing and their relevance for the SKA Regional Centre network.

   @inproceedings{cecconi2025extract,
     altmetric = true,
     dimensions = true,
     author = {{Cecconi}, B. and {Girard}, J. N. and {Dumez-Viou}, C. and {Mauduit}, E. and {Aicardi}, S. and {Nammour}, F. and {Quiñones}, E. and {Xandri-Zaragoza}, B. and {Molina-Gim{\'{e}}nez}, E. and {Martin{\'{e}}z}, O. and {Barcelona-Pons}, D. and {Hadad}, E. and {Bondonneau}, L. and {Landeau}, V. and {Bellucci}, A. and {Penas}, I.},
     title = {{EXTRACT/TASKA: Towards a digital computing platform for modern radio astronomy}},
     booktitle = {Planetary, Solar and Heliospheric Radio Emissions X},
     publisher = {OSU Pyth{\'{e}}as/AMU, Observatoire de Paris},
     year = {2026},
     editor = {{Lamy}, L. and {Louis}, C. K. and {Fischer}, G. and {Morosan}, D. E. and {Zarka}, P.},
     pages = {},
     doi = {10.25935/PREX-BFI6},
   }

2. IPDPS

   MetaPaper: Massively Scaling Minecraft Worlds With Dynamic Load Balancing

   Marina Lopez-Alet, Stepan Klymonchuk, Daniel Barcelona-Pons, and Pedro Garcia-Lopez

   In 2026 IEEE International Parallel and Distributed Processing Symposium (IPDPS) , May 2026

   Abs DOI Bib PDF

   

   Minecraft is one of the most popular massively multiplayer environments, supported by an active and open community that continuously works to improve it. Among these contributions, MultiPaper focuses on addressing a critical challenge: the limited scalability of standard Minecraft servers, which restricts the number of users that can interact within a single shared world. Despite its innovations, our novel evaluation of MultiPaper reveals scaling limitations to maintain a good experience for large user counts.To address this, we introduce MetaPaper, an extension of MultiPaper that presents novel advancements in Minecraft’s multiplayer scalability. We present two key innovations: dynamic scaling, which enables elastic infrastructure and automated server deployment; and dynamic load balancing, allowing seamless player distribution and real-time migration across server instances. Our empirical analysis demonstrates that MetaPaper significantly improves both user experience and system performance, increasing playability and supporting substantially more concurrent users within the same virtual space (from 250 to 800 users).

   @inproceedings{lopezalet2026metapaper,
     altmetric = true,
     dimensions = true,
     author = {Lopez-Alet, Marina and Klymonchuk, Stepan and Barcelona-Pons, Daniel and Garcia-Lopez, Pedro},
     booktitle = { 2026 IEEE International Parallel and Distributed Processing Symposium (IPDPS) },
     title = {{ MetaPaper: Massively Scaling Minecraft Worlds With Dynamic Load Balancing }},
     year = {2026},
     volume = {},
     issn = {},
     pages = {264-277},
     keywords = {Loading;Servers;Load management;Games;Bot (Internet);Measurement;Timing},
     doi = {10.1109/IPDPS65963.2026.00033},
     url = {https://doi.ieeecomputersociety.org/10.1109/IPDPS65963.2026.00033},
     publisher = {IEEE Computer Society},
     address = {Los Alamitos, CA, USA},
     month = may,
   }

2025

1. USENIX ATC

   Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources

   Daniel Barcelona-Pons, Aitor Arjona, Pedro Garcı́a-López, Enrique Molina-Giménez, and Stepan Klymonchuk

   In 2025 USENIX Annual Technical Conference (USENIX ATC 25), Jul 2025

   Abs Bib PDF Slides Website

   

   We present burst computing, a novel serverless solution tailored for burst-parallel jobs. Unlike Function-as-a-Service (FaaS), burst computing establishes job-level isolation using a novel group invocation primitive to launch large groups of workers with guaranteed simultaneity. Resource allocation is optimized by packing workers into fewer containers, which accelerates their initialization and enables locality. Locality significantly reduces remote communication compared to FaaS and, combined with simultaneity, it allows workers to communicate synchronously with message passing and group collectives. Consequently, applications unfeasible n FaaS are now possible. We implement burst computing atop OpenWhisk and provide a communication middleware that seamlessly leverages locality with zero-copy messaging. Evaluation shows reduced job invocation and communication latency for a 2× speed-up in TeraSort and a 98.5% reduction in remote communication in PageRank (13× speed-up) compared to standard FaaS.

   @inproceedings{barcelonapons2025burst,
     title = {Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources},
     author = {Barcelona-Pons, Daniel and Arjona, Aitor and Garc{\'\i}a-L{\'o}pez, Pedro and Molina-Gim{\'e}nez, Enrique and Klymonchuk, Stepan},
     booktitle = {2025 USENIX Annual Technical Conference (USENIX ATC 25)},
     year = {2025},
     isbn = {978-1-939133-48-9},
     pages = {39--56},
     publisher = {USENIX Association},
     month = jul,
     address = {Santa Clara, CA},
     url = {https://www.usenix.org/conference/atc25/presentation/barcelona-pons},
   }

2. SIGMOD

   Building Stateless Serverless Vector DBs via Block-based Data Partitioning

   Daniel Barcelona-Pons, Raúl Gracia-Tinedo, Albert Cañadilla-Domingo, Xavier Roca-Canals, and Pedro Garcı́a-López

   Proc. ACM Manag. Data, Dec 2025

   Abs DOI Bib PDF

   

   Retrieval-Augmented Generation (RAG) and other AI/ML workloads rely on vector databases (DBs) for efficient analysis of unstructured data. However, cluster (or serverful) vector DB architectures, such as Milvus, lack the elasticity to handle high workload fluctuations, sparsity, and burstiness. Serverless vector DBs–i.e., vector DBs built on top of cloud functions–have emerged as a promising alternative architecture, but they are still in their infancy. This paper presents the first experimental study comparing data partitioning strategies in vector DBs built atop stateless Function-as-a-Service (FaaS). Through extensive benchmarks, we reveal key limitations of clustering-based data partitioning when applied to dynamic datasets (e.g., complexity, load balancing). We then evaluate a block-based alternative that addresses such limitations (e.g., up to 5.8× faster data partitioning, up to 63% lower costs, similar querying times). Moreover, our results show that a stateless serverless vector DB using block-based data partitioning achieves competitive performance with Milvus in several aspects (e.g., up to 65.6× faster data partitioning, similar recall), while reducing costs for sparse workloads (up to 99%). Our empirical insights aim to guide the design of next-generation serverless vector DBs.

   @article{barcelonapons2025vectordb,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and Gracia-Tinedo, Ra\'{u}l and Ca\~{n}adilla-Domingo, Albert and Roca-Canals, Xavier and Garc\'{\i}a-L\'{o}pez, Pedro},
     title = {Building Stateless Serverless Vector DBs via Block-based Data Partitioning},
     year = {2025},
     issue_date = {December 2025},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     volume = {3},
     number = {6 (SIGMOD)},
     url = {https://doi.org/10.1145/3769769},
     doi = {10.1145/3769769},
     journal = {Proc. ACM Manag. Data},
     month = dec,
     articleno = {304},
     numpages = {25},
     keywords = {data partitioning, indexing, serverless functions, vector databases},
   }

3. arXiv

   AI Factories: It’s time to rethink the Cloud-HPC divide

   Pedro Garcia Lopez, Daniel Barcelona Pons, Marcin Copik, Torsten Hoefler, Eduardo Quiñones, Maciej Malawski, Peter Pietzutch, Alberto Marti, Thomas Ohlson Timoudas, and Aleksander Slominski

   2025

   Abs arXiv Bib PDF

   

   The strategic importance of artificial intelligence is driving a global push toward Sovereign AI initiatives. Nationwide governments are increasingly developing dedicated infrastructures, called AI Factories (AIF), to achieve technological autonomy and secure the resources necessary to sustain robust local digital ecosystems.In Europe, the EuroHPC Joint Undertaking is investing hundreds of millions of euros into several AI Factories, built atop existing high-performance computing (HPC) supercomputers. However, while HPC systems excel in raw performance, they are not inherently designed for usability, accessibility, or serving as public-facing platforms for AI services such as inference or agentic applications. In contrast, AI practitioners are accustomed to cloud-native technologies like Kubernetes and object storage, tools that are often difficult to integrate within traditional HPC environments. This article advocates for a dual-stack approach within supercomputers: integrating both HPC and cloud-native technologies. Our goal is to bridge the divide between HPC and cloud computing by combining high performance and hardware acceleration with ease of use and service-oriented front-ends. This convergence allows each paradigm to amplify the other. To this end, we will study the cloud challenges of HPC (Serverless HPC) and the HPC challenges of cloud technologies (High-performance Cloud).

   @unpublished{garcialopez2025aifactories,
     title = {AI Factories: It's time to rethink the Cloud-HPC divide},
     author = {Garcia Lopez, Pedro and Barcelona Pons, Daniel and Copik, Marcin and Hoefler, Torsten and Quiñones, Eduardo and Malawski, Maciej and Pietzutch, Peter and Marti, Alberto and Timoudas, Thomas Ohlson and Slominski, Aleksander},
     year = {2025},
     archiveprefix = {arXiv},
     primaryclass = {cs.DC},
     url = {https://arxiv.org/abs/2509.12849},
   }

4. WOSC

   Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows

   Enrique Molina-Giménez, Daniel Barcelona-Pons, Octavio H. Iacoponelli, and Pedro Garcı́a-López

   In Proceedings of the 11th International Workshop on Serverless Computing, Vanderbilt University, Nashville, TN, USA, 2025

   Abs DOI Bib PDF

   

   Serverless computing enables applications to scale dynamically without manual server management, with users paying only for the actual compute resources consumed. In the context of parallel workload execution, the problem of determining how many resources to provision and of what size has been extensively studied in recent years. However, existing approaches often present usability challenges, such as ad-hoc implementations or tight integration with a single cloud provider, which hinder the efficient deployment of new applications. In this work, we introduce Flexecutor, a Python library built on top of Lithops that unifies state-of-the-art serverless provisioners into a reusable and easy-to-use framework. Flexecutor abstracts away the underlying complexity, providing practitioners with a simple interface to deploy, manage, and optimize serverless workflows across multiple FaaS platforms. With Flexecutor, the deployment effort for coding serverless workflows is significantly reduced, while enabling the seamless integration of new smart provisioning strategies.

   @inproceedings{molinagimenez2025flexecutor,
     altmetric = true,
     dimensions = true,
     author = {Molina-Gim\'{e}nez, Enrique and Barcelona-Pons, Daniel and Iacoponelli, Octavio H. and Garc\'{\i}a-L\'{o}pez, Pedro},
     title = {Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows},
     year = {2025},
     isbn = {9798400723025},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3774899.3775013},
     doi = {10.1145/3774899.3775013},
     booktitle = {Proceedings of the 11th International Workshop on Serverless Computing},
     pages = {14–19},
     numpages = {6},
     keywords = {serverless computing, function-as-a-service (FaaS), serverless workflows, resource provisioning, parallel workloads, scalability, smart provisioning},
     location = {Vanderbilt University, Nashville, TN, USA},
     series = {WoSC11 '25},
   }

2024

1. CCGrid

   Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data

   Aitor Arjona, Pedro Garcia-Lopez, and Daniel Barcelona-Pons

   In 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), May 2024

   Abs DOI Bib PDF

   

   The elasticity of the Cloud is very appealing for processing large scientific data. However, enormous volumes of unstructured research data, totaling petabytes, remain untapped in data repositories due to the lack of efficient parallel data access. Even-sized partitioning of these data to enable its parallel processing requires a complete re-write to storage, becoming prohibitively expensive for high volumes. In this article we present Dataplug, an extensible framework that enables fine-grained parallel data access to unstructured scientific data in object storage. Dataplug employs read-only, format-aware indexing, allowing to define dynamically-sized partitions using various partitioning strategies. This approach avoids writing the partitioned dataset back to storage, enabling distributed workers to fetch data partitions on-the-fly directly from large data blobs, efficiently leveraging the high bandwidth capability of object storage. Validations on genomic (FASTQGZip) and geospatial (LiDAR) data formats demonstrate that Dataplug considerably lowers pre-processing compute costs (between 65.5% — 71.31% less) without imposing significant overheads.

   @inproceedings{arjona2024dataplug,
     altmetric = true,
     dimensions = true,
     author = {Arjona, Aitor and Garcia-Lopez, Pedro and Barcelona-Pons, Daniel},
     booktitle = {2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid)},
     title = {Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data},
     year = {2024},
     volume = {},
     issn = {},
     pages = {567-576},
     keywords = {Cloud computing;Costs;Scientific computing;Semantics;Genomics;Distributed databases;Bandwidth;Dynamic scheduling;Geospatial analysis;Bioinformatics;data partitioning;Cloud;object storage;scientific data management;unstructured data;data analytics},
     doi = {10.1109/CCGrid59990.2024.00069},
     url = {https://doi.org/10.1109/CCGrid59990.2024.00069},
     publisher = {IEEE Computer Society},
     address = {Los Alamitos, CA, USA},
     month = may,
   }

2. Middleware

   Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)

   Germán T. Eizaguirre, Daniel Barcelona-Pons, Aitor Arjona, Gil Vernik, Pedro Garcı́a-López, and Theodore Alexandrov

   In Proceedings of the 25th International Middleware Conference Industrial Track, Hong Kong, Hong Kong, 2024

   Abs DOI Bib PDF

   

   The scalability of cloud functions makes them a convenient backend for elastic data analytics pipelines where parallelism changes drastically from one stage to the next. However, cloud functions require intermediate storage systems for communication, which limits the efficiency of stateful operations. Furthermore, cloud functions are expensive, which reduces the cost-effectiveness of pure serverless architectures. We propose a hybrid architecture for data analytics that uses cloud functions for embarrassingly parallel stages and virtual cloud instances for stateful operations under a unified serverless programming framework. Extending Lithops, a serverless programming library, we implement a parallel programming interface that proactively provisions serverless and serverful cloud resources with minimal user intervention. We validate the feasibility of a hybrid architecture, by comparing it to fully serverless and serverful versions of a production-level metabolomics pipeline. We show that mixing cloud functions with virtual instances increases the cost-effectiveness of the execution by up to 188.23% over the serverless implementation, while achieving a speedup of 3.64 compared to the serverful one.

   @inproceedings{eizaguirre2024serverful,
     altmetric = true,
     dimensions = true,
     author = {Eizaguirre, Germ\'{a}n T. and Barcelona-Pons, Daniel and Arjona, Aitor and Vernik, Gil and Garc\'{\i}a-L\'{o}pez, Pedro and Alexandrov, Theodore},
     title = {Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)},
     year = {2024},
     isbn = {9798400713194},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3700824.3701095},
     doi = {10.1145/3700824.3701095},
     booktitle = {Proceedings of the 25th International Middleware Conference Industrial Track},
     pages = {15–21},
     numpages = {7},
     keywords = {Cloud computing, function-as-a-service, resource allocation, resource efficiency, serverless computing},
     location = {Hong Kong, Hong Kong},
     series = {Middleware Industrial Track '24},
   }

2023

1. Middleware

   Glider: Serverless Ephemeral Stateful Near-Data Computation

   Daniel Barcelona-Pons, Pedro García-López, and Bernard Metzler

   In Proceedings of the 24th International Middleware Conference, Bologna, Italy, 2023

   Abs DOI Bib PDF

   

   Serverless data analytics generate a large amount of intermediate data during computation stages. However, serverless functions, which are short-lived and lack direct communication, face significant challenges in managing this data effectively. The traditional approach of using object storage to carry the data proves to be slow and costly, as it involves constant movement of data back and forth. Although specialized ephemeral storage solutions have been developed to address this issue, they fail to tackle the fundamental challenge of minimizing data movements. This work focuses on incorporating near-data computation into an ephemeral storage system to reduce the volume of transferred data in serverless analytics. We present Glider with the aim to enhance communication between serverless compute stages, allowing data to smoothly "glide" through the processing pipeline instead of bouncing between different services. Glider achieves this by leveraging stateful near-data execution of complex data-bound operations and an efficient I/O streaming interface. Under evaluation, it reduces data transfers by up to 99.7%, improves storage utilization by up to 99.8%, and enhances performance by up to 2.7×. In sum, Glider improves serverless data analytics by optimizing data movement, streamlining processing, and avoiding redundant transfers.

   @inproceedings{barcelonapons2023glider,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and Garc\'{i}a-L\'{o}pez, Pedro and Metzler, Bernard},
     title = {Glider: Serverless Ephemeral Stateful Near-Data Computation},
     year = {2023},
     isbn = {9798400701771},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3590140.3629119},
     doi = {10.1145/3590140.3629119},
     booktitle = {Proceedings of the 24th International Middleware Conference},
     pages = {247–260},
     numpages = {14},
     keywords = {Serverless, stateful, cloud, near-data, ephemeral, intermediate data},
     location = {Bologna, Italy},
     series = {Middleware '23},
   }

2022

1. TOSEM

   Stateful Serverless Computing with Crucial

   Daniel Barcelona-Pons, Pierre Sutra, Marc Sánchez-Artigas, Gerard París, and Pedro García-López

   ACM Trans. Softw. Eng. Methodol., Mar 2022

   Abs DOI Bib PDF

   

   Serverless computing greatly simplifies the use of cloud resources. In particular, Function-as-a-Service (FaaS) platforms enable programmers to develop applications as individual functions that can run and scale independently. Unfortunately, applications that require fine-grained support for mutable state and synchronization, such as machine learning (ML) and scientific computing, are notoriously hard to build with this new paradigm. In this work, we aim at bridging this gap. We present Crucial, a system to program highly-parallel stateful serverless applications. Crucial retains the simplicity of serverless computing. It is built upon the key insight that FaaS resembles to concurrent programming at the scale of a datacenter. Accordingly, a distributed shared memory layer is the natural answer to the needs for fine-grained state management and synchronization. Crucial allows to port effortlessly a multi-threaded code base to serverless, where it can benefit from the scalability and pay-per-use model of FaaS platforms. We validate Crucial with the help of micro-benchmarks and by considering various stateful applications. Beyond classical parallel tasks (e.g., a Monte Carlo simulation), these applications include representative ML algorithms such as k-means and logistic regression. Our evaluation shows that Crucial obtains superior or comparable performance to Apache Spark at similar cost (18%–40% faster). We also use Crucial to port (part of) a state-of-the-art multi-threaded ML library to serverless. The ported application is up to 30% faster than with a dedicated high-end server. Finally, we attest that Crucial can rival in performance with a single-machine, multi-threaded implementation of a complex coordination problem. Overall, Crucial delivers all these benefits with less than 6% of changes in the code bases of the evaluated applications.

   @article{barcelonapons2022crucial,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and Sutra, Pierre and S\'{a}nchez-Artigas, Marc and Par\'{i}s, Gerard and Garc\'{i}a-L\'{o}pez, Pedro},
     title = {Stateful Serverless Computing with Crucial},
     year = {2022},
     issue_date = {July 2022},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     volume = {31},
     number = {3},
     issn = {1049-331X},
     url = {https://doi.org/10.1145/3490386},
     doi = {10.1145/3490386},
     journal = {ACM Trans. Softw. Eng. Methodol.},
     month = mar,
     articleno = {39},
     numpages = {38},
     keywords = {Serverless, synchronization, stateful, in-memory, FaaS},
   }

2. PhD Thesis

   Towards Enhanced State Management for Serverless Computation

   Daniel Barcelona-Pons

   Universitat Rovira i Virgili, 2022

   Doctoral Thesis

   Abs Bib PDF Website

   

   Cloud computing is becoming more accessible and fitting for many applications. In this line, and with fervent interest from research and industry, there is the concept of serverless. Serverless services hide the existence of servers from users, so that they can focus on their applications. In the trend to exploit the elasticity of serverless computing, distributed parallel computations such as analytics, machine learning, and data processing have special attention from researchers. However, current serverless services are unfitted out-of-the-box to support parallel applications. Broadly, the issues come from a lack of state management, coordination, and predictability. This context opens several research lines; we discuss three: 1) It is unclear how well can current serverless services support distributed parallel computing, which requires execution simultaneity and performance consistency. Current platforms do not ensure that, and users may find extreme variability between services. 2) Current serverless computing exclusively offers stateless ephemeral workers with no direct communication. Applications built on top of these services struggle to manage their mutable global state and coordinate their execution. 3) Intermediate data generated during data processing workloads is forcibly transferred between workers and disaggregated storage. This data-shipping model generates very expensive data movement. In this thesis, we present tree novel contributions to tackle these challenges. First, we study the architectural design of the main serverless platforms and empirically evaluate them to find the platforms that best fit parallel applications. Second, we explore novel methods to code stateful distributed applications in serverless. We present the cloud thread abstraction and build a shared objects layer that allows serverless workers to share and mutate global state and coordinate their execution. Finally, we study a solution to serverless data-shipping through in-storage ephemeral stateful computation. We build a storage system that allows to offload data-bound tasks from serverless workers and significantly reduce data movement.

   @phdthesis{barcelonapons2022thesis,
     author = {Barcelona-Pons, Daniel},
     school = {Universitat Rovira i Virgili},
     note = {Doctoral Thesis},
     title = {Towards Enhanced State Management for Serverless Computation},
     year = {2022},
     url = {http://hdl.handle.net/10803/687462},
   }

2021

1. FGCS

   Benchmarking Parallelism in FaaS Platforms

   Daniel Barcelona-Pons and Pedro García-López

   Future Gener. Comput. Syst., Nov 2021

   Abs DOI Bib PDF

   

   Serverless computing has seen a myriad of work exploring its potential. Some systems tackle Function-as-a-Service (FaaS) properties on automatic elasticity and scale to run highly-parallel computing jobs. However, they focus on specific platforms and convey that their ideas can be extrapolated to any FaaS runtime.An important question arises: do all FaaS platforms fit parallel computations? In this paper, we argue that not all of them provide the necessary means to host highly-parallel applications. To validate our hypothesis, we create a comparative framework and categorize the architectures of four cloud FaaS offerings, emphasizing parallel performance. We attest and extend this description with an empirical experiment that consists in plotting in deep detail the evolution of a parallel computing job on each service.The analysis of our results evinces that FaaS is not inherently good for parallel computations and architectural differences across platforms are decisive to categorize their performance. A key insight is the importance of virtualization technologies and the scheduling approach of FaaS platforms. Parallelism improves with lighter virtualization and proactive scheduling due to finer resource allocation and faster elasticity. This causes some platforms like AWS and IBM to perform well for highly-parallel computations, while others such as Azure present difficulties to achieve the required parallelism degree. Consequently, the information in this paper becomes of special interest to help users choose the most adequate infrastructure for their parallel applications.

   @article{barcelonapons2021faasbench,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and Garc\'{i}a-L\'{o}pez, Pedro},
     title = {Benchmarking Parallelism in FaaS Platforms},
     year = {2021},
     issue_date = {Nov 2021},
     publisher = {Elsevier Science Publishers B. V.},
     address = {NLD},
     volume = {124},
     number = {C},
     issn = {0167-739X},
     url = {https://doi.org/10.1016/j.future.2021.06.005},
     doi = {10.1016/j.future.2021.06.005},
     journal = {Future Gener. Comput. Syst.},
     month = nov,
     pages = {268–284},
     numpages = {17},
     keywords = {FaaS, Parallelism, Benchmark, Serverless},
   }

2019

1. Middleware

   On the FaaS Track: Building Stateful Distributed Applications with Serverless Architectures

   Daniel Barcelona-Pons, Marc Sánchez-Artigas, Gerard París, Pierre Sutra, and Pedro García-López

   In Proceedings of the 20th International Middleware Conference, Davis, CA, USA, 2019

   Abs DOI Bib PDF

   

   Serverless computing is an emerging paradigm that greatly simplifies the usage of cloud resources and suits well to many tasks. Most notably, Function-as-a-Service (FaaS) enables programmers to develop cloud applications as individual functions that can run and scale independently. Yet, due to the disaggregation of storage and compute resources in FaaS, applications that require fine-grained support for mutable state and synchronization, such as machine learning and scientific computing, are hard to build.In this work, we present Crucial, a system to program highly-concurrent stateful applications with serverless architectures. Its programming model keeps the simplicity of FaaS and allows to port effortlessly multi-threaded algorithms to this new environment. Crucial is built upon the key insight that FaaS resembles to concurrent programming at the scale of a data center. As a consequence, a distributed shared memory layer is the right answer to the need for fine-grained state management and coordination in serverless. We validate our system with the help of micro-benchmarks and various applications. In particular, we implement two common machine learning algorithms: k-means clustering and logistic regression. For both cases, Crucial obtains superior or comparable performance to an equivalent Spark cluster.

   @inproceedings{barcelonapons2019crucial,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and S\'{a}nchez-Artigas, Marc and Par\'{i}s, Gerard and Sutra, Pierre and Garc\'{i}a-L\'{o}pez, Pedro},
     title = {On the FaaS Track: Building Stateful Distributed Applications with Serverless Architectures},
     year = {2019},
     isbn = {9781450370097},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3361525.3361535},
     doi = {10.1145/3361525.3361535},
     booktitle = {Proceedings of the 20th International Middleware Conference},
     pages = {41–54},
     numpages = {14},
     keywords = {in-memory, FaaS, stateful, synchronization, Serverless},
     location = {Davis, CA, USA},
     series = {Middleware '19},
   }

2. WOSC

   FaaS Orchestration of Parallel Workloads

   Daniel Barcelona-Pons, Pedro García-López, Álvaro Ruiz, Amanda Gómez-Gómez, Gerard París, and Marc Sánchez-Artigas

   In Proceedings of the 5th International Workshop on Serverless Computing, Davis, CA, USA, 2019

   Abs DOI Bib PDF

   

   Function as a Service (FaaS) is based on a reactive programming model where functions are activated by triggers in response to cloud events (e.g., objects added to an object store). The inherent elasticity and the pay-per-use model of serverless functions make them very appropriate for embarrassingly parallel tasks like data preprocessing, or even the execution of MapReduce jobs in the cloud.But current Serverless orchestration systems are not designed for managing parallel fork-join workflows in a scalable and efficient way. We demonstrate in this paper that existing services like AWS Step Functions or Azure Durable Functions incur in considerable overheads, and only Composer at IBM Cloud provides suitable performance.Successively, we analyze the architecture of OpenWhisk as an open-source FaaS systems and its orchestration features (Composer). We outline its architecture problems and propose guidelines for orchestrating massively parallel workloads using serverless functions.

   @inproceedings{barcelonapons2019faasorch,
     altmetric = true,
     dimensions = true,
     author = {Barcelona-Pons, Daniel and Garc\'{i}a-L\'{o}pez, Pedro and Ruiz, \'{A}lvaro and G\'{o}mez-G\'{o}mez, Amanda and Par\'{i}s, Gerard and S\'{a}nchez-Artigas, Marc},
     title = {FaaS Orchestration of Parallel Workloads},
     year = {2019},
     isbn = {9781450370387},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3366623.3368137},
     doi = {10.1145/3366623.3368137},
     booktitle = {Proceedings of the 5th International Workshop on Serverless Computing},
     pages = {25–30},
     numpages = {6},
     keywords = {Serverless, FaaS, orchestration, event-based},
     location = {Davis, CA, USA},
     series = {WOSC '19},
   }

2018

1. WOSC

   Comparison of FaaS Orchestration Systems

   Pedro García López, Marc Sánchez-Artigas, Gerard París, Daniel Barcelona-Pons, Álvaro Ruiz Ollobarren, and David Arroyo Pinto

   In 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion), 2018

   Abs DOI Bib PDF

   

   Since the appearance of Amazon Lambda in 2014, all major cloud providers have embraced the "Function as a Service" (FaaS) model, because of its enormous potential for a wide variety of applications. As expected (and also desired), the competition is fierce in the serverless world, and includes aspects such as the run-time support for the orchestration of serverless functions. In this regard, the three major production services are currently Amazon Step Functions (December 2016), Azure Durable Functions (June 2017), and IBM Composer (October 2017), still young and experimental projects with a long way ahead. In this article, we will compare and analyze these three serverless orchestration systems under a common evaluation framework. We will study their architectures, programming and billing models, and their effective support for parallel execution, among others. Through a series of experiments, we will also evaluate the run-time overhead of the different infrastructures for different types of workflows.

   @inproceedings{garcialopez2018comparefaas,
     altmetric = true,
     dimensions = true,
     author = {García López, Pedro and Sánchez-Artigas, Marc and París, Gerard and Barcelona-Pons, Daniel and Ruiz Ollobarren, Álvaro and Arroyo Pinto, David},
     booktitle = {2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion)},
     title = {Comparison of FaaS Orchestration Systems},
     year = {2018},
     publisher = {IEEE},
     pages = {148-153},
     doi = {10.1109/UCC-Companion.2018.00049},
     series = {WOSC '18},
   }