CORDIS
EU research results

CORDIS

English EN
European Extreme Performing Big Data Stacks

European Extreme Performing Big Data Stacks

Objective

Imagine a Big Data application with the following characteristics: (i) it has to process large amounts of complex streaming data,
(ii) the application logic that processes the incoming data must execute and complete within a strict time limit,
and (iii) there is a limited budget for infrastructure resources.

In today’s world, the data would be streamed from the local network or edge devices to a cloud provider which is rented by a customer to perform the data execution. The Big Data software stack, in an application and hardware agnostic manner, will split the execution stream into multiple tasks and send them for processing on the nodes the customer has paid for. If the outcome does not match the strict three second business requirement, then the customer has two options:
1) scale-up (by upgrading processors at node level),
2) scale-out (by adding nodes to their clusters), or 3) manually implement code optimizations specific to the underlying hardware.

E2Data proposes an end-to-end solution for Big Data deployments that will fully exploit and advance the state-of-the-art in infrastructure services by delivering a performance increase of up to 10x while utilizing up to 50% less cloud resources.
E2Data will provide a new Big Data paradigm, by combining state-of-the-art software components, in order to achieve maximum resource utilization for heterogeneous cloud deployments without affecting current programming norms (i.e. no code changes in the original source).
The E2Data innovations will be driven by the requirements of four resource demanding applications from the finance, health, green buildings, and security domains.
Finally, the evaluation will be conducted on both high-performing x86 and low-power ARM cluster architectures representing realistic execution scenarios of real-world deployments.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

EXUS SOFTWARE LTD

Address

Old Broad Street 25 Tower 42
Ec2n 1pb London

United Kingdom

Activity type

Private for-profit entities (excluding Higher or Secondary Education Establishments)

EU Contribution

€ 503 125

Participants (8)

Sort alphabetically

Sort by EU Contribution

Expand all

THE UNIVERSITY OF MANCHESTER

United Kingdom

EU Contribution

€ 658 750

INSTITUTE OF COMMUNICATION AND COMPUTER SYSTEMS

Greece

EU Contribution

€ 590 750

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH

Germany

EU Contribution

€ 720 750

NEUROCOM LUXEMBOURG SA

Luxembourg

EU Contribution

€ 505 625

KALEAO LIMITED

United Kingdom

EU Contribution

€ 610 750

INSTITOUTO TECHNOLOGIAS YPOLOGISTONKAI EKDOSEON DIOFANTOS

Greece

EU Contribution

€ 287 500

SPARK WORKS ITC

United Kingdom

EU Contribution

€ 315 375

IPROOV LIMITED

United Kingdom

EU Contribution

€ 483 625

Project information

Grant agreement ID: 780245

Status

Ongoing project

  • Start date

    1 January 2018

  • End date

    31 December 2020

Funded under:

H2020-EU.2.1.1.

  • Overall budget:

    € 4 676 250

  • EU contribution

    € 4 676 250

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom