A distributed data-mining software platform for extreme data across the compute continuum

Informazioni relative al progetto

EXTRACT

ID dell’accordo di sovvenzione: 101093110

DOI

10.3030/101093110

Progetto chiuso

Data della firma CE 16 Novembre 2022

Data di avvio 1 Gennaio 2023

Data di completamento 31 Dicembre 2025

Finanziato da

• Digital, Industry and Space

Costo totale

€ 4 997 875,00

Contributo UE

€ 4 997 875,00

Coordinato da

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Spain

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (9)

Use-case requirements

Report including the specification of the use-case requirements.

Data infrastructure and data mining framework requirements

Report including the specification of the Data infrastructure and Data mining framework.

First release of the EXTRACT data infrastructure and data mining framework

First release of software components of the data infrastructure and framework. Complete specification and APIs.

Project management plan and quality guidelines

Report of main project procedures (contractual framework, governance, monitoring, internal communication, etc.) and standards and quality procedures.

First release of the data-driven orchestration and monitoring

Prototype of orchestra-tor and monitoring with limited functionality and a report describing it.

Compute Continuum Specification and first integration plan

Requirements and early design of the EXTRACT compute continuum abstraction layer and the initial integration plan.

Dissemination, exploitation and community building report

Description of the activities performed in the first period, and the list of foreseen training materials and actions, based on Phase 1 requirement.

Updated dissemination, exploitation and community building, and first sustainability report

Description of the activities performed and update on the initial plan covering the Phase 2, establishing new objectives and actions if needed.

Data-driven orchestration requirements

Description of: (1) workflow and continuum in-formation for orchestration, (2) orchestration and monitoring architecture and (3) software components selection.

Other (2)

First release of the EXTRACT use-cases

First released of the PER and TASKA use-cases developed with the EXTRACT technology at Phase 2, and a report describing them.

First release of the Compute Continuum and final integration plan

D4.2 defines the first architecture and deployment of the EXTRACT compute continuum abstraction layer and the EXTRACT platform.

Data Management Plan (1)

Data Management Plan

Report data management from internal/external point of view, including a table specifying data exploitation, shared for verification and reuse. Updates will be provided if need.

Pubblicazioni

Conference proceedings (15)

Quantifying Serverless Elasticity: The gumeter Benchmark Suite

Autori: Eizaguirre, Germán T.; Molina-Giménez, Enrique; Finol, Gerard; Molina, Carlos; García-López, Pedro
Pubblicato in: Service-Oriented Computing: 23rd International Conference, 2025
Editore: Springer-Verlag
DOI: 10.5281/ZENODO.17701734

Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows

Autori: Enrique Molina-Giménez, Daniel Barcelona-Pons, Octavio H. Iacoponelli, Pedro García-López
Pubblicato in: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Editore: ACM
DOI: 10.1145/3774899.3775013

Let It Unthread: The Good, the Bad and the Ugly Within Webassembly Portable Multithreading

Autori: Sanchez-Artigas, Marc; Bohoyo-Bengoetxea, Julen
Pubblicato in: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025
Editore: IEEE
DOI: 10.5281/ZENODO.18037245

Temporal Fusion Transformer Based Vertical Scaling Management for Kubernetes

Autori: Bora, Kemalcan; Kartsakli, Elli; Quiñones Moreno, Eduardo
Pubblicato in: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Editore: IEEE
DOI: 10.1109/CLOUD67622.2025.00058

Glider: Serverless Ephemeral Stateful Near-Data Computation

Autori: Daniel Barcelona-Pons, Pedro García-López, and Bernard Metzler.
Pubblicato in: Middleware '23: Proceedings of the 24th International Middleware Conference, 2023, ISBN 979-8-4007-0177-1
Editore: Association for Computing Machinery
DOI: 10.1145/3590140.3629119

Exploring Secure and Efficient Temporary Data Sharing Between Co-Located Kubernetes Containers

Autori: Arjona, Aitor; Metzler, Bernard; Pascal, Spörri
Pubblicato in: 2024 IEEE 32nd International Conference on Network Protocols (ICNP), 2025
Editore: IEEE
DOI: 10.5281/ZENODO.15097004

Manifesting the Elasticity of Serverless Data Pipelines: a Metabolomics Use Case

Autori: Elena Díez-Cuadrado, Germán Telmo Eizaguirre, Enrique Molina-Giménez
Pubblicato in: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Editore: ACM
DOI: 10.1145/3774899.3775018

Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)

Autori: Eizaguirre, Germán T.; Barcelona-Pons, Daniel; Arjona, Aitor; Vernik, Gil; López García, Pedro; Alexandrov, Theodore
Pubblicato in: Proceedings of the 25th International Middleware Conference Industrial Track on ZZZ, 2024
Editore: Association for Computing Machinery
DOI: 10.1145/3700824.3701095

Scaling a Variant Calling Genomics Pipeline with FaaS

Autori: Aitor Arjona, Arnau Gabriel-Atienza, Sara Lanuza-Orna, Xavier Roca-Canals, Ayman Bourramouss, Tyler K. Chafin, Lucio Marcello, Paolo Ribeca, and Pedro García-López
Pubblicato in: 9th International Workshop on Serverless Computing, 2023, ISBN 979-8-4007-0455-0
Editore: ACM
DOI: 10.1145/3631295.3631403

Multi-party Computation for Privacy and Security in Machine Learning: a Practical Review

Autori: Alessandro Bellini, Emanuele Bellini, Massimo Bertini, Doaa Almhaithawi, Stefano Cuomo
Pubblicato in: 2023 IEEE International Conference on Cyber Security and Resilience (CSR), 2023, ISBN 979-8-3503-1170-9
Editore: IEEE
DOI: 10.1109/CSR57506.2023.10224826

Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources

Autori: Barcelona-Pons, Daniel; Arjona, Aitor; Garcia Lopez, Pedro; Molina-Giménez, Enrique; Klymonchuk, Stepan
Pubblicato in: USENIX Annual Technical Conference 2025, 2025
Editore: ACM
DOI: 10.5281/ZENODO.17662627

Serverless Data Analytics (Finally) Bridging the Gap: Introducing the Ortzi DataFrame

Autori: Germán T. Eizaguirre, Marc Hostau, Marc Sánchez-Artigas
Pubblicato in: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Editore: IEEE
DOI: 10.5281/ZENODO.17701352

Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data

Autori: Arjona, Aitor; Garcia-Lopez, Pedro; Barcelona-Pons, Daniel
Pubblicato in: 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2024, ISSN 2993-2114
Editore: IEEE
DOI: 10.5281/ZENODO.14161823

Is Performance of Object Storage Predictable for Serverless I/O Workloads? A Comparative Study

Autori: G. Eizaguirre and M. Sanchez-Artigas
Pubblicato in: Cloud-Edge Continuum Workshop 2023 (IEEE 31st International Conference on Network Protocols, 2023, ISBN 979-8-3503-0322-3
Editore: IEEE Computer Society
DOI: 10.1109/ICNP59255.2023.10355617

A seer knows best

Autori: Marc Sánchez-Artigas, Germán T. Eizaguirre
Pubblicato in: Proceedings of the 23rd ACM/IFIP International Middleware Conference, 2022
Editore: ACM
DOI: 10.1145/3528535.3565241

Peer reviewed articles (3)

Optics Express

Autori: Bartomeu Pou, Jeffrey Smith, Eduardo Quinones, Mario Martin, and Damien Gratadour
Pubblicato in: Optics express, 2024, ISSN 1094-4087
Editore: Optica Publishing Group
DOI: 10.1364/OE.530254

Corrigendum to “MLLess: Achieving Cost Efficiency in Serverless Machine Learning Training

Autori: Pablo Gimeno Sarroca, Marc Sánchez-Artigas
Pubblicato in: Journal of Parallel and Distributed Computing, Numero 183, 2024, ISSN 0743-7315
Editore: Elsevier Inc.
DOI: 10.48550/arXiv.2206.05786

Semantic Segmentation of Solar Radio Spikes at Low Frequencies

Autori: Pearse C Murphy, Stéphane Aicardi, Baptiste Cecconi, Carine Briand, Thibault Peccoux
Pubblicato in: The Open Journal of Astrophysics, Numero 7, 2024, ISSN 0000-0000
Editore: Maynooth Academic Publishing
DOI: 10.48550/ARXIV.2403.08546