A distributed data-mining software platform for extreme data across the compute continuum

Información del proyecto

EXTRACT

Identificador del acuerdo de subvención: 101093110

DOI

10.3030/101093110

Proyecto cerrado

Fecha de la firma de la CE 16 Noviembre 2022

Fecha de inicio 1 Enero 2023

Fecha de finalización 31 Diciembre 2025

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 4 997 875,00

Aportación de la UE

€ 4 997 875,00

Coordinado por

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Spain

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (9)

Use-case requirements

Report including the specification of the use-case requirements.

Data infrastructure and data mining framework requirements

Report including the specification of the Data infrastructure and Data mining framework.

First release of the EXTRACT data infrastructure and data mining framework

First release of software components of the data infrastructure and framework. Complete specification and APIs.

Project management plan and quality guidelines

Report of main project procedures (contractual framework, governance, monitoring, internal communication, etc.) and standards and quality procedures.

First release of the data-driven orchestration and monitoring

Prototype of orchestra-tor and monitoring with limited functionality and a report describing it.

Compute Continuum Specification and first integration plan

Requirements and early design of the EXTRACT compute continuum abstraction layer and the initial integration plan.

Dissemination, exploitation and community building report

Description of the activities performed in the first period, and the list of foreseen training materials and actions, based on Phase 1 requirement.

Updated dissemination, exploitation and community building, and first sustainability report

Description of the activities performed and update on the initial plan covering the Phase 2, establishing new objectives and actions if needed.

Data-driven orchestration requirements

Description of: (1) workflow and continuum in-formation for orchestration, (2) orchestration and monitoring architecture and (3) software components selection.

Other (2)

First release of the EXTRACT use-cases

First released of the PER and TASKA use-cases developed with the EXTRACT technology at Phase 2, and a report describing them.

First release of the Compute Continuum and final integration plan

D4.2 defines the first architecture and deployment of the EXTRACT compute continuum abstraction layer and the EXTRACT platform.

Data Management Plan (1)

Data Management Plan

Report data management from internal/external point of view, including a table specifying data exploitation, shared for verification and reuse. Updates will be provided if need.

Publicaciones

Conference proceedings (15)

Quantifying Serverless Elasticity: The gumeter Benchmark Suite

Autores: Eizaguirre, Germán T.; Molina-Giménez, Enrique; Finol, Gerard; Molina, Carlos; García-López, Pedro
Publicado en: Service-Oriented Computing: 23rd International Conference, 2025
Editor: Springer-Verlag
DOI: 10.5281/ZENODO.17701734

Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows

Autores: Enrique Molina-Giménez, Daniel Barcelona-Pons, Octavio H. Iacoponelli, Pedro García-López
Publicado en: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Editor: ACM
DOI: 10.1145/3774899.3775013

Let It Unthread: The Good, the Bad and the Ugly Within Webassembly Portable Multithreading

Autores: Sanchez-Artigas, Marc; Bohoyo-Bengoetxea, Julen
Publicado en: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025
Editor: IEEE
DOI: 10.5281/ZENODO.18037245

Temporal Fusion Transformer Based Vertical Scaling Management for Kubernetes

Autores: Bora, Kemalcan; Kartsakli, Elli; Quiñones Moreno, Eduardo
Publicado en: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Editor: IEEE
DOI: 10.1109/CLOUD67622.2025.00058

Glider: Serverless Ephemeral Stateful Near-Data Computation

Autores: Daniel Barcelona-Pons, Pedro García-López, and Bernard Metzler.
Publicado en: Middleware '23: Proceedings of the 24th International Middleware Conference, 2023, ISBN 979-8-4007-0177-1
Editor: Association for Computing Machinery
DOI: 10.1145/3590140.3629119

Exploring Secure and Efficient Temporary Data Sharing Between Co-Located Kubernetes Containers

Autores: Arjona, Aitor; Metzler, Bernard; Pascal, Spörri
Publicado en: 2024 IEEE 32nd International Conference on Network Protocols (ICNP), 2025
Editor: IEEE
DOI: 10.5281/ZENODO.15097004

Manifesting the Elasticity of Serverless Data Pipelines: a Metabolomics Use Case

Autores: Elena Díez-Cuadrado, Germán Telmo Eizaguirre, Enrique Molina-Giménez
Publicado en: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Editor: ACM
DOI: 10.1145/3774899.3775018

Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)

Autores: Eizaguirre, Germán T.; Barcelona-Pons, Daniel; Arjona, Aitor; Vernik, Gil; López García, Pedro; Alexandrov, Theodore
Publicado en: Proceedings of the 25th International Middleware Conference Industrial Track on ZZZ, 2024
Editor: Association for Computing Machinery
DOI: 10.1145/3700824.3701095

Scaling a Variant Calling Genomics Pipeline with FaaS

Autores: Aitor Arjona, Arnau Gabriel-Atienza, Sara Lanuza-Orna, Xavier Roca-Canals, Ayman Bourramouss, Tyler K. Chafin, Lucio Marcello, Paolo Ribeca, and Pedro García-López
Publicado en: 9th International Workshop on Serverless Computing, 2023, ISBN 979-8-4007-0455-0
Editor: ACM
DOI: 10.1145/3631295.3631403

Multi-party Computation for Privacy and Security in Machine Learning: a Practical Review

Autores: Alessandro Bellini, Emanuele Bellini, Massimo Bertini, Doaa Almhaithawi, Stefano Cuomo
Publicado en: 2023 IEEE International Conference on Cyber Security and Resilience (CSR), 2023, ISBN 979-8-3503-1170-9
Editor: IEEE
DOI: 10.1109/CSR57506.2023.10224826

Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources

Autores: Barcelona-Pons, Daniel; Arjona, Aitor; Garcia Lopez, Pedro; Molina-Giménez, Enrique; Klymonchuk, Stepan
Publicado en: USENIX Annual Technical Conference 2025, 2025
Editor: ACM
DOI: 10.5281/ZENODO.17662627

Serverless Data Analytics (Finally) Bridging the Gap: Introducing the Ortzi DataFrame

Autores: Germán T. Eizaguirre, Marc Hostau, Marc Sánchez-Artigas
Publicado en: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Editor: IEEE
DOI: 10.5281/ZENODO.17701352

Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data

Autores: Arjona, Aitor; Garcia-Lopez, Pedro; Barcelona-Pons, Daniel
Publicado en: 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2024, ISSN 2993-2114
Editor: IEEE
DOI: 10.5281/ZENODO.14161823

Is Performance of Object Storage Predictable for Serverless I/O Workloads? A Comparative Study

Autores: G. Eizaguirre and M. Sanchez-Artigas
Publicado en: Cloud-Edge Continuum Workshop 2023 (IEEE 31st International Conference on Network Protocols, 2023, ISBN 979-8-3503-0322-3
Editor: IEEE Computer Society
DOI: 10.1109/ICNP59255.2023.10355617

A seer knows best

Autores: Marc Sánchez-Artigas, Germán T. Eizaguirre
Publicado en: Proceedings of the 23rd ACM/IFIP International Middleware Conference, 2022
Editor: ACM
DOI: 10.1145/3528535.3565241

Peer reviewed articles (3)

Optics Express

Autores: Bartomeu Pou, Jeffrey Smith, Eduardo Quinones, Mario Martin, and Damien Gratadour
Publicado en: Optics express, 2024, ISSN 1094-4087
Editor: Optica Publishing Group
DOI: 10.1364/OE.530254

Corrigendum to “MLLess: Achieving Cost Efficiency in Serverless Machine Learning Training

Autores: Pablo Gimeno Sarroca, Marc Sánchez-Artigas
Publicado en: Journal of Parallel and Distributed Computing, Edición 183, 2024, ISSN 0743-7315
Editor: Elsevier Inc.
DOI: 10.48550/arXiv.2206.05786

Semantic Segmentation of Solar Radio Spikes at Low Frequencies

Autores: Pearse C Murphy, Stéphane Aicardi, Baptiste Cecconi, Carine Briand, Thibault Peccoux
Publicado en: The Open Journal of Astrophysics, Edición 7, 2024, ISSN 0000-0000
Editor: Maynooth Academic Publishing
DOI: 10.48550/ARXIV.2403.08546