A distributed data-mining software platform for extreme data across the compute continuum

Informacje na temat projektu

EXTRACT

Identyfikator umowy o grant: 101093110

DOI

10.3030/101093110

Projekt został zamknięty

Data podpisania przez KE 16 Listopada 2022

Data rozpoczęcia 1 Stycznia 2023

Data zakończenia 31 Grudnia 2025

Finansowanie w ramach

• Digital, Industry and Space

Koszt całkowity

€ 4 997 875,00

Wkład UE

€ 4 997 875,00

Koordynowany przez

BARCELONA SUPERCOMPUTING CENTER CENTRO NACIONAL DE SUPERCOMPUTACION
Spain

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (9)

Use-case requirements

Report including the specification of the use-case requirements.

Data infrastructure and data mining framework requirements

Report including the specification of the Data infrastructure and Data mining framework.

First release of the EXTRACT data infrastructure and data mining framework

First release of software components of the data infrastructure and framework. Complete specification and APIs.

Project management plan and quality guidelines

Report of main project procedures (contractual framework, governance, monitoring, internal communication, etc.) and standards and quality procedures.

First release of the data-driven orchestration and monitoring

Prototype of orchestra-tor and monitoring with limited functionality and a report describing it.

Compute Continuum Specification and first integration plan

Requirements and early design of the EXTRACT compute continuum abstraction layer and the initial integration plan.

Dissemination, exploitation and community building report

Description of the activities performed in the first period, and the list of foreseen training materials and actions, based on Phase 1 requirement.

Updated dissemination, exploitation and community building, and first sustainability report

Description of the activities performed and update on the initial plan covering the Phase 2, establishing new objectives and actions if needed.

Data-driven orchestration requirements

Description of: (1) workflow and continuum in-formation for orchestration, (2) orchestration and monitoring architecture and (3) software components selection.

Other (2)

First release of the EXTRACT use-cases

First released of the PER and TASKA use-cases developed with the EXTRACT technology at Phase 2, and a report describing them.

First release of the Compute Continuum and final integration plan

D4.2 defines the first architecture and deployment of the EXTRACT compute continuum abstraction layer and the EXTRACT platform.

Data Management Plan (1)

Data Management Plan

Report data management from internal/external point of view, including a table specifying data exploitation, shared for verification and reuse. Updates will be provided if need.

Publikacje

Conference proceedings (15)

Quantifying Serverless Elasticity: The gumeter Benchmark Suite

Autorzy: Eizaguirre, Germán T.; Molina-Giménez, Enrique; Finol, Gerard; Molina, Carlos; García-López, Pedro
Opublikowane w: Service-Oriented Computing: 23rd International Conference, 2025
Wydawca: Springer-Verlag
DOI: 10.5281/ZENODO.17701734

Flexecutor: Out-of-the-Box Smart Provisioning for Serverless Workflows

Autorzy: Enrique Molina-Giménez, Daniel Barcelona-Pons, Octavio H. Iacoponelli, Pedro García-López
Opublikowane w: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Wydawca: ACM
DOI: 10.1145/3774899.3775013

Let It Unthread: The Good, the Bad and the Ugly Within Webassembly Portable Multithreading

Autorzy: Sanchez-Artigas, Marc; Bohoyo-Bengoetxea, Julen
Opublikowane w: 2025 IEEE 25th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2025
Wydawca: IEEE
DOI: 10.5281/ZENODO.18037245

Temporal Fusion Transformer Based Vertical Scaling Management for Kubernetes

Autorzy: Bora, Kemalcan; Kartsakli, Elli; Quiñones Moreno, Eduardo
Opublikowane w: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Wydawca: IEEE
DOI: 10.1109/CLOUD67622.2025.00058

Glider: Serverless Ephemeral Stateful Near-Data Computation

Autorzy: Daniel Barcelona-Pons, Pedro García-López, and Bernard Metzler.
Opublikowane w: Middleware '23: Proceedings of the 24th International Middleware Conference, 2023, ISBN 979-8-4007-0177-1
Wydawca: Association for Computing Machinery
DOI: 10.1145/3590140.3629119

Exploring Secure and Efficient Temporary Data Sharing Between Co-Located Kubernetes Containers

Autorzy: Arjona, Aitor; Metzler, Bernard; Pascal, Spörri
Opublikowane w: 2024 IEEE 32nd International Conference on Network Protocols (ICNP), 2025
Wydawca: IEEE
DOI: 10.5281/ZENODO.15097004

Manifesting the Elasticity of Serverless Data Pipelines: a Metabolomics Use Case

Autorzy: Elena Díez-Cuadrado, Germán Telmo Eizaguirre, Enrique Molina-Giménez
Opublikowane w: Proceedings of the 11th International Workshop on Serverless Computing, 2025
Wydawca: ACM
DOI: 10.1145/3774899.3775018

Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)

Autorzy: Eizaguirre, Germán T.; Barcelona-Pons, Daniel; Arjona, Aitor; Vernik, Gil; López García, Pedro; Alexandrov, Theodore
Opublikowane w: Proceedings of the 25th International Middleware Conference Industrial Track on ZZZ, 2024
Wydawca: Association for Computing Machinery
DOI: 10.1145/3700824.3701095

Scaling a Variant Calling Genomics Pipeline with FaaS

Autorzy: Aitor Arjona, Arnau Gabriel-Atienza, Sara Lanuza-Orna, Xavier Roca-Canals, Ayman Bourramouss, Tyler K. Chafin, Lucio Marcello, Paolo Ribeca, and Pedro García-López
Opublikowane w: 9th International Workshop on Serverless Computing, 2023, ISBN 979-8-4007-0455-0
Wydawca: ACM
DOI: 10.1145/3631295.3631403

Multi-party Computation for Privacy and Security in Machine Learning: a Practical Review

Autorzy: Alessandro Bellini, Emanuele Bellini, Massimo Bertini, Doaa Almhaithawi, Stefano Cuomo
Opublikowane w: 2023 IEEE International Conference on Cyber Security and Resilience (CSR), 2023, ISBN 979-8-3503-1170-9
Wydawca: IEEE
DOI: 10.1109/CSR57506.2023.10224826

Burst Computing: Quick, Sudden, Massively Parallel Processing on Serverless Resources

Autorzy: Barcelona-Pons, Daniel; Arjona, Aitor; Garcia Lopez, Pedro; Molina-Giménez, Enrique; Klymonchuk, Stepan
Opublikowane w: USENIX Annual Technical Conference 2025, 2025
Wydawca: ACM
DOI: 10.5281/ZENODO.17662627

Serverless Data Analytics (Finally) Bridging the Gap: Introducing the Ortzi DataFrame

Autorzy: Germán T. Eizaguirre, Marc Hostau, Marc Sánchez-Artigas
Opublikowane w: 2025 IEEE 18th International Conference on Cloud Computing (CLOUD), 2025
Wydawca: IEEE
DOI: 10.5281/ZENODO.17701352

Dataplug: Unlocking extreme data analytics with on-the-fly dynamic partitioning of unstructured data

Autorzy: Arjona, Aitor; Garcia-Lopez, Pedro; Barcelona-Pons, Daniel
Opublikowane w: 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2024, ISSN 2993-2114
Wydawca: IEEE
DOI: 10.5281/ZENODO.14161823

Is Performance of Object Storage Predictable for Serverless I/O Workloads? A Comparative Study

Autorzy: G. Eizaguirre and M. Sanchez-Artigas
Opublikowane w: Cloud-Edge Continuum Workshop 2023 (IEEE 31st International Conference on Network Protocols, 2023, ISBN 979-8-3503-0322-3
Wydawca: IEEE Computer Society
DOI: 10.1109/ICNP59255.2023.10355617

A seer knows best

Autorzy: Marc Sánchez-Artigas, Germán T. Eizaguirre
Opublikowane w: Proceedings of the 23rd ACM/IFIP International Middleware Conference, 2022
Wydawca: ACM
DOI: 10.1145/3528535.3565241

Peer reviewed articles (3)

Optics Express

Autorzy: Bartomeu Pou, Jeffrey Smith, Eduardo Quinones, Mario Martin, and Damien Gratadour
Opublikowane w: Optics express, 2024, ISSN 1094-4087
Wydawca: Optica Publishing Group
DOI: 10.1364/OE.530254

Corrigendum to “MLLess: Achieving Cost Efficiency in Serverless Machine Learning Training

Autorzy: Pablo Gimeno Sarroca, Marc Sánchez-Artigas
Opublikowane w: Journal of Parallel and Distributed Computing, Numer 183, 2024, ISSN 0743-7315
Wydawca: Elsevier Inc.
DOI: 10.48550/arXiv.2206.05786

Semantic Segmentation of Solar Radio Spikes at Low Frequencies

Autorzy: Pearse C Murphy, Stéphane Aicardi, Baptiste Cecconi, Carine Briand, Thibault Peccoux
Opublikowane w: The Open Journal of Astrophysics, Numer 7, 2024, ISSN 0000-0000
Wydawca: Maynooth Academic Publishing
DOI: 10.48550/ARXIV.2403.08546