A distributed data-mining software platform for extreme data across the compute continuum

Projektinformationen

EXTRACT

ID Finanzhilfevereinbarung: 101093110

DOI

10.3030/101093110

Projekt abgeschlossen

EK-Unterschriftsdatum 16 November 2022

Startdatum 1 Januar 2023

Enddatum 31 Dezember 2025

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 4 997 875,00

EU-Beitrag

€ 4 997 875,00

Koordiniert durch

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (9)

Use-case requirements

Report including the specification of the use-case requirements.

Data infrastructure and data mining framework requirements

Report including the specification of the Data infrastructure and Data mining framework.

First release of the EXTRACT data infrastructure and data mining framework

First release of software components of the data infrastructure and framework. Complete specification and APIs.

Project management plan and quality guidelines

Report of main project procedures (contractual framework, governance, monitoring, internal communication, etc.) and standards and quality procedures.

First release of the data-driven orchestration and monitoring

Prototype of orchestra-tor and monitoring with limited functionality and a report describing it.

Compute Continuum Specification and first integration plan

Requirements and early design of the EXTRACT compute continuum abstraction layer and the initial integration plan.

Dissemination, exploitation and community building report

Description of the activities performed in the first period, and the list of foreseen training materials and actions, based on Phase 1 requirement.

Updated dissemination, exploitation and community building, and first sustainability report

Description of the activities performed and update on the initial plan covering the Phase 2, establishing new objectives and actions if needed.

Data-driven orchestration requirements

Description of: (1) workflow and continuum in-formation for orchestration, (2) orchestration and monitoring architecture and (3) software components selection.

Other (2)

First release of the EXTRACT use-cases

First released of the PER and TASKA use-cases developed with the EXTRACT technology at Phase 2, and a report describing them.

First release of the Compute Continuum and final integration plan

D4.2 defines the first architecture and deployment of the EXTRACT compute continuum abstraction layer and the EXTRACT platform.

Data Management Plan (1)

Data Management Plan

Report data management from internal/external point of view, including a table specifying data exploitation, shared for verification and reuse. Updates will be provided if need.

Veröffentlichungen

Conference proceedings (15)

Quantifying Serverless Elasticity: The gumeter Benchmark Suite

Autoren: Eizaguirre, Germán T.; Molina-Giménez, Enrique; Finol, Gerard; Molina, Carlos; García-López, Pedro
Veröffentlicht in: Service-Oriented Computing: 23rd International Conference, 2025
Herausgeber: Springer-Verlag
DOI: 10.5281/ZENODO.17701734

Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows

Autoren: Enrique Molina-Giménez, Daniel Barcelona-Pons, Octavio H. Iacoponelli, Pedro García-López
Veröffentlicht in: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Herausgeber: ACM
DOI: 10.1145/3774899.3775013

Let It Unthread: The Good, the Bad and the Ugly Within Webassembly Portable Multithreading

Autoren: Sanchez-Artigas, Marc; Bohoyo-Bengoetxea, Julen
Veröffentlicht in: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025
Herausgeber: IEEE
DOI: 10.5281/ZENODO.18037245

Temporal Fusion Transformer Based Vertical Scaling Management for Kubernetes

Autoren: Bora, Kemalcan; Kartsakli, Elli; Quiñones Moreno, Eduardo
Veröffentlicht in: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Herausgeber: IEEE
DOI: 10.1109/CLOUD67622.2025.00058

Glider: Serverless Ephemeral Stateful Near-Data Computation

Autoren: Daniel Barcelona-Pons, Pedro García-López, and Bernard Metzler.
Veröffentlicht in: Middleware '23: Proceedings of the 24th International Middleware Conference, 2023, ISBN 979-8-4007-0177-1
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3590140.3629119

Exploring Secure and Efficient Temporary Data Sharing Between Co-Located Kubernetes Containers

Autoren: Arjona, Aitor; Metzler, Bernard; Pascal, Spörri
Veröffentlicht in: 2024 IEEE 32nd International Conference on Network Protocols (ICNP), 2025
Herausgeber: IEEE
DOI: 10.5281/ZENODO.15097004

Manifesting the Elasticity of Serverless Data Pipelines: a Metabolomics Use Case

Autoren: Elena Díez-Cuadrado, Germán Telmo Eizaguirre, Enrique Molina-Giménez
Veröffentlicht in: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Herausgeber: ACM
DOI: 10.1145/3774899.3775018

Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)

Autoren: Eizaguirre, Germán T.; Barcelona-Pons, Daniel; Arjona, Aitor; Vernik, Gil; López García, Pedro; Alexandrov, Theodore
Veröffentlicht in: Proceedings of the 25th International Middleware Conference Industrial Track on ZZZ, 2024
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3700824.3701095

Scaling a Variant Calling Genomics Pipeline with FaaS

Autoren: Aitor Arjona, Arnau Gabriel-Atienza, Sara Lanuza-Orna, Xavier Roca-Canals, Ayman Bourramouss, Tyler K. Chafin, Lucio Marcello, Paolo Ribeca, and Pedro García-López
Veröffentlicht in: 9th International Workshop on Serverless Computing, 2023, ISBN 979-8-4007-0455-0
Herausgeber: ACM
DOI: 10.1145/3631295.3631403

Multi-party Computation for Privacy and Security in Machine Learning: a Practical Review

Autoren: Alessandro Bellini, Emanuele Bellini, Massimo Bertini, Doaa Almhaithawi, Stefano Cuomo
Veröffentlicht in: 2023 IEEE International Conference on Cyber Security and Resilience (CSR), 2023, ISBN 979-8-3503-1170-9
Herausgeber: IEEE
DOI: 10.1109/CSR57506.2023.10224826

Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources

Autoren: Barcelona-Pons, Daniel; Arjona, Aitor; Garcia Lopez, Pedro; Molina-Giménez, Enrique; Klymonchuk, Stepan
Veröffentlicht in: USENIX Annual Technical Conference 2025, 2025
Herausgeber: ACM
DOI: 10.5281/ZENODO.17662627

Serverless Data Analytics (Finally) Bridging the Gap: Introducing the Ortzi DataFrame

Autoren: Germán T. Eizaguirre, Marc Hostau, Marc Sánchez-Artigas
Veröffentlicht in: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Herausgeber: IEEE
DOI: 10.5281/ZENODO.17701352

Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data

Autoren: Arjona, Aitor; Garcia-Lopez, Pedro; Barcelona-Pons, Daniel
Veröffentlicht in: 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2024, ISSN 2993-2114
Herausgeber: IEEE
DOI: 10.5281/ZENODO.14161823

Is Performance of Object Storage Predictable for Serverless I/O Workloads? A Comparative Study

Autoren: G. Eizaguirre and M. Sanchez-Artigas
Veröffentlicht in: Cloud-Edge Continuum Workshop 2023 (IEEE 31st International Conference on Network Protocols, 2023, ISBN 979-8-3503-0322-3
Herausgeber: IEEE Computer Society
DOI: 10.1109/ICNP59255.2023.10355617

A seer knows best

Autoren: Marc Sánchez-Artigas, Germán T. Eizaguirre
Veröffentlicht in: Proceedings of the 23rd ACM/IFIP International Middleware Conference, 2022
Herausgeber: ACM
DOI: 10.1145/3528535.3565241

Peer reviewed articles (3)

Optics Express

Autoren: Bartomeu Pou, Jeffrey Smith, Eduardo Quinones, Mario Martin, and Damien Gratadour
Veröffentlicht in: Optics express, 2024, ISSN 1094-4087
Herausgeber: Optica Publishing Group
DOI: 10.1364/OE.530254

Corrigendum to “MLLess: Achieving Cost Efficiency in Serverless Machine Learning Training

Autoren: Pablo Gimeno Sarroca, Marc Sánchez-Artigas
Veröffentlicht in: Journal of Parallel and Distributed Computing, Ausgabe 183, 2024, ISSN 0743-7315
Herausgeber: Elsevier Inc.
DOI: 10.48550/arXiv.2206.05786

Semantic Segmentation of Solar Radio Spikes at Low Frequencies

Autoren: Pearse C Murphy, Stéphane Aicardi, Baptiste Cecconi, Carine Briand, Thibault Peccoux
Veröffentlicht in: The Open Journal of Astrophysics, Ausgabe 7, 2024, ISSN 0000-0000
Herausgeber: Maynooth Academic Publishing
DOI: 10.48550/ARXIV.2403.08546