Skip to main content

European Extreme Performing Big Data Stacks

Objective

Imagine a Big Data application with the following characteristics: (i) it has to process large amounts of complex streaming data,
(ii) the application logic that processes the incoming data must execute and complete within a strict time limit,
and (iii) there is a limited budget for infrastructure resources.

In today’s world, the data would be streamed from the local network or edge devices to a cloud provider which is rented by a customer to perform the data execution. The Big Data software stack, in an application and hardware agnostic manner, will split the execution stream into multiple tasks and send them for processing on the nodes the customer has paid for. If the outcome does not match the strict three second business requirement, then the customer has two options:
1) scale-up (by upgrading processors at node level),
2) scale-out (by adding nodes to their clusters), or 3) manually implement code optimizations specific to the underlying hardware.

E2Data proposes an end-to-end solution for Big Data deployments that will fully exploit and advance the state-of-the-art in infrastructure services by delivering a performance increase of up to 10x while utilizing up to 50% less cloud resources.
E2Data will provide a new Big Data paradigm, by combining state-of-the-art software components, in order to achieve maximum resource utilization for heterogeneous cloud deployments without affecting current programming norms (i.e. no code changes in the original source).
The E2Data innovations will be driven by the requirements of four resource demanding applications from the finance, health, green buildings, and security domains.
Finally, the evaluation will be conducted on both high-performing x86 and low-power ARM cluster architectures representing realistic execution scenarios of real-world deployments.

Call for proposal

H2020-ICT-2017-1
See other projects for this call

Coordinator

EXUS SOFTWARE LTD
Address
4 Felstead Gardens Cubitt Town
E14 3BS London
United Kingdom
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
EU contribution
€ 503 125

Participants (8)

THE UNIVERSITY OF MANCHESTER
United Kingdom
EU contribution
€ 658 750
Address
Oxford Road
M13 9PL Manchester
Activity type
Higher or Secondary Education Establishments
INSTITUTE OF COMMUNICATION AND COMPUTER SYSTEMS
Greece
EU contribution
€ 590 750
Address
Patission Str. 42
10682 Athina
Activity type
Research Organisations
DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Germany
EU contribution
€ 720 750
Address
Trippstadter Strasse 122
67663 Kaiserslautern
Activity type
Research Organisations
NEUROCOM LUXEMBOURG SA
Luxembourg
EU contribution
€ 505 625
Address
20 Rue Eugene Ruppert
2453 Luxembourg
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
BAMBOO SYSTEMS GROUP LIMITED
United Kingdom
EU contribution
€ 610 750
Address
Sheraton House Castle Park
CB3 0AX Cambridge
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
INSTITOUTO TECHNOLOGIAS YPOLOGISTON KAI EKDOSEON DIOFANTOS
Greece
EU contribution
€ 287 500
Address
N Kazantzaki Odos
26504 Patras
Activity type
Research Organisations
SPARK WORKS ITC
United Kingdom
EU contribution
€ 315 375
Address
Upper Floor 74 High Street
DE11 8HS Swadlincote Derbyshire
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
IPROOV LIMITED
United Kingdom
EU contribution
€ 483 625
Address
10 York Road
SE1 7ND London
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)