Skip to main content

Percipient Storage for Exascale Data Centric Computing2

Objective

The landscape for High Performance Computing is changing with the proliferation of enormous volumes of data created by scientific instruments and sensors, in addition to data from simulations. This data needs to be stored, processed and analysed, and existing storage system technologies in the realm of extreme computing need to be adapted to achieve reasonable efficiency in achieving higher scientific throughput. We started on the journey to address this problem with the SAGE project. The HPC use cases and the technology ecosystem is now further evolving and there are new requirements and innovations that are brought to the forefront. It is extremely critical to address them today without “reinventing the wheel” leveraging existing initiatives and know-how to build the pieces of the Exascale puzzle as quickly and efficiently as we can.
The SAGE paradigm already provides a basic framework to address the extreme scale data aspects of High Performance Computing on the path to Exascale. Sage2 (Percipient StorAGe for Exascale Data Centric Computing 2) intends to validate a next generation storage system building on top of the already existing SAGE platform to address new use case requirements in the areas of extreme scale computing scientific workflows and AI/deep learning leveraging the latest developments in storage infrastructure software and storage technology ecosystem.
Sage2 aims to provide significantly enhanced scientific throughput, improved scalability, and, time & energy to solution for the use cases at scale. Sage2 will also dramatically increase the productivity of developers and users of these systems.
This proposal is aligned to FETHPC-02 - 2017:part (c). Sage2 provides a highly performant and resilient, QoS capable multi tiered storage system, with data layouts across the tiers managed by the Mero Object Store, which is capable of handling in-transit/in-situ processing of data within the storage system, accessible through the Clovis API.

Call for proposal

H2020-FETHPC-2017
See other projects for this call

Coordinator

SEAGATE SYSTEMS UK LIMITED
Address
Langstone Road
PO9 1SA Havant
United Kingdom
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
EU contribution
€ 1 037 543,75

Participants (8)

BULL SAS
France
EU contribution
€ 513 062,50
Address
Rue Jean Jaures 68
78340 Les Clayes Sous Bois
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
COMMISSARIAT A L ENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES
France
EU contribution
€ 420 780
Address
Rue Leblanc 25
75015 Paris 15
Activity type
Research Organisations
UNITED KINGDOM ATOMIC ENERGY AUTHORITY
United Kingdom
EU contribution
€ 331 715
Address
Culham Science Centre
OX14 3DB Abingdon
Activity type
Research Organisations
KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden
EU contribution
€ 463 750
Address
Brinellvagen 8
100 44 Stockholm
Activity type
Higher or Secondary Education Establishments
FORSCHUNGSZENTRUM JULICH GMBH
Germany
EU contribution
€ 399 682,50
Address
Wilhelm Johnen Strasse
52428 Julich
Activity type
Research Organisations
THE UNIVERSITY OF EDINBURGH
United Kingdom
EU contribution
€ 311 875
Address
Old College, South Bridge
EH8 9YL Edinburgh
Activity type
Higher or Secondary Education Establishments
KITWARE SAS
France
EU contribution
€ 100 002,50
Address
6 Cours Andre Philip
69100 Villeurbanne
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
ARM LIMITED
United Kingdom
EU contribution
€ 418 706,25
Address
110 Fulbourn Road
CB1 9NJ Cambridge
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)