Skip to main content

Serverless Data Analytics Platform

Objective

This project is inspired by the following sentence from a professor of computer graphics at UC Berkeley : “Why is there no cloud button?” He outlined how his students simply wish they could easily “push a button” and have their code – existing, optimized, single-machine code – running on the cloud.

The main goal is to create CloudButton: a Serverless Data Analytics Platform. CloudButton will “democratize big data” by overly simplifying the overall life cycle and programming model thanks to serverless technologies. To demonstrate the impact of the project, we target two settings with large data volumes: bioinformatics (genomics, metabolomics) and geospatial data (LiDAR, satellital).

To achieve these ambitious objectives, CloudButton defines the following goals:

1. High Performance Serverless Run-time: We will create the first FaaS compute run-time for Big Data analytics leveraging Apache OpenWhisk. The proposed serverless big data analytics platform will be based on a mature open source code base (Apache OpenWhisk) augmented with Apache Open Whisk Composer.

2. Mutable Shared Data Middleware for Serverless Computing: We will create Distributed Mutable Data Structures leveraging RedHat Infinispan In-Memory Data Grid. Our middleware will provide language-level constructs for data persistence, dependability and concurrency control to serverless functions.

3. CloudButton Toolkit: Serverless Data Analytics Platform: The toolkit will implement on top of [1] and [2] the Serverless Cloud Programming Abstractions that can express a wide range of existing data-intensive applications with minimal changes. We will develop new tools and methodologies to port existing data-intensive applications from the HPC, data analytics and machine learning domains to the CloudButton toolkit.

Call for proposal

H2020-ICT-2018-2
See other projects for this call

Coordinator

UNIVERSITAT ROVIRA I VIRGILI
Address
Carrer De Escorxador
43003 Tarragona
Spain
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 715 019,20

Participants (10)

IBM ISRAEL - SCIENCE AND TECHNOLOGY LTD
Israel
EU contribution
€ 1 087 000
Address
94 Derech Em-hamoshavot
49527 Petach Tikva
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE
United Kingdom
EU contribution
€ 506 567,50
Address
South Kensington Campus Exhibition Road
SW7 2AZ London
Activity type
Higher or Secondary Education Establishments
INSTITUT MINES-TELECOM
France
EU contribution
€ 423 125
Address
19 Place Marguerite Perey
91120 Palaiseau
Activity type
Higher or Secondary Education Establishments
RED HAT LIMITED
Ireland
EU contribution
€ 436 250
Address
Cork Airport Business Park 6700 Kinsale Road
T12 Cork
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
EUROPEAN MOLECULAR BIOLOGY LABORATORY
Germany
EU contribution
€ 249 565
Address
Meyerhofstrasse 1
69117 Heidelberg
Activity type
Research Organisations
ATOS SPAIN SA
Spain
EU contribution
€ 420 625
Address
Calle De Albarracin 25
28037 Madrid
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
THE PIRBRIGHT INSTITUTE LBG

Participation ended

United Kingdom
EU contribution
€ 5 270
Address
Ash Road Pirbright
GU24 0NF Woking
Activity type
Research Organisations
ANSWARETECH SL

Participation ended

Spain
EU contribution
€ 67 355,80
Address
Calle Fabricas 8 Oficina 2-04
28923 Alcorcon Madrid
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
FUNDACION MATRIX INVESTIGACION Y DESARROLLO SOSTENIBLE
Spain
EU contribution
€ 125 750
Address
Plaza Miralles Local 5A
36310 Vigo
Activity type
Research Organisations
THE JAMES HUTTON INSTITUTE
United Kingdom
EU contribution
€ 240 980
Address
Errol Road Invergowrie
DD2 5DA Dundee
Activity type
Research Organisations