Skip to main content

Designing and Enabling E-infrastructures for intensive Processing in a Hybrid DataCloud

Objective

The key concept proposed in the DEEP Hybrid DataCloud project is the need to support intensive computing techniques that require specialized HPC hardware, like GPUs or low latency interconnects, to explore very large datasets. A Hybrid Cloud approach enables the access to such resources that are not easily reachable by the researchers at the scale needed in the current EU e-infrastructure.

We also propose to deploy under the common label of “DEEP as a Service” a set of building blocks that enable the easy development of applications requiring these techniques: deep learning using neural networks, parallel post-processing of very large data, and analysis of massive online data streams.

Three pilot applications exploiting very large datasets in Biology, Physics and Network Security are proposed, and further pilots for dissemination into other areas like Medicine, Earth Observation, Astrophysics, and Citizen Science will be supported in a testbed with significant HPC resources, including latest generation GPUs, to evaluate the performance and scalability of the solutions.
A DevOps approach will be implemented to provide the chain to ensure the quality of the software and services released, that will also be offered to the developers of research applications.

The project will evolve to TRL8 existing services and technologies at TRL6+, including relevant contributions to the EOSC by the INDIGO-DataCloud H2020 project, that the project will enrich with new functionalities already available as prototypes, notably the support for GPUs and low latency interconnects. These services will be deployed in the project testbed, offered to the research communities linked to the project through pilot applications, and integrated under the EOSC framework, where they can be further scaled up in the future.

Field of science

  • /natural sciences/computer and information sciences/computer security/network security
  • /natural sciences/computer and information sciences/artificial intelligence/computational intelligence
  • /social sciences/sociology/governance/public services
  • /natural sciences/computer and information sciences/artificial intelligence/machine learning/deep learning

Call for proposal

H2020-EINFRA-2017
See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Coordinator

AGENCIA ESTATAL CONSEJO SUPERIOR DEINVESTIGACIONES CIENTIFICAS
Address
Calle Serrano 117
28006 Madrid
Spain
Activity type
Research Organisations
EU contribution
€ 531 250

Participants (9)

LABORATORIO DE INSTRUMENTACAO E FISICA EXPERIMENTAL DE PARTICULAS LIP
Portugal
EU contribution
€ 362 500
Address
Rua Larga 4 Universidade De Coimbra
3004 516 Coimbra
Activity type
Research Organisations
ISTITUTO NAZIONALE DI FISICA NUCLEARE
Italy
EU contribution
€ 375 000
Address
Via Enrico Fermi 54
00044 Frascati
Activity type
Research Organisations
INSTYTUT CHEMII BIOORGANICZNEJ POLSKIEJ AKADEMII NAUK
Poland
EU contribution
€ 242 500
Address
Noskowskiego 12-14
61 704 Poznan
Activity type
Research Organisations
KARLSRUHER INSTITUT FUER TECHNOLOGIE
Germany
EU contribution
€ 241 250
Address
Kaiserstrasse 12
76131 Karlsruhe
Activity type
Higher or Secondary Education Establishments
UNIVERSITAT POLITECNICA DE VALENCIA
Spain
EU contribution
€ 237 500
Address
Camino De Vera Sn Edificio 3A
46022 Valencia
Activity type
Higher or Secondary Education Establishments
CESNET ZAJMOVE SDRUZENI PRAVNICKYCH OSOB
Czechia
EU contribution
€ 233 750
Address
Zikova 4
160 00 Praha 6
Activity type
Research Organisations
USTAV INFORMATIKY, SLOVENSKA AKADEMIA VIED
Slovakia
EU contribution
€ 271 250
Address
Dubravska Cesta 9
845 07 Bratislava
Activity type
Higher or Secondary Education Establishments
ATOS SPAIN SA
Spain
EU contribution
€ 233 750
Address
Calle De Albarracin 25
28037 Madrid
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
HELMHOLTZ ZENTRUM MUENCHEN DEUTSCHES FORSCHUNGSZENTRUM FUER GESUNDHEIT UND UMWELT GMBH
Germany
EU contribution
€ 260 000
Address
Ingolstadter Landstrasse 1
85764 Neuherberg
Activity type
Research Organisations