Skip to main content

IO Software for Exascale Architecture

Objective

IO-SEA aims to provide a novel data management and storage platform for exascale computing based on hierarchical storage management (HSM) and on-demand provisioning of storage services. The platform will efficiently make use of storage tiers spanning NVMe and NVRAM at the top all the way down to tape-based technologies. System requirements are driven by data intensive use-cases, in a very strict co-design approach. The concept of ephemeral data nodes and data accessors is introduced that allow users to flexibly operate the system, using various well-known data access paradigms, such as POSIX namespaces, S3/Swift Interfaces, MPI-IO and other data formats and protocols. These ephemeral resources eliminate the problem of treating storage resources as static and unchanging system components – which is not a tenable proposition for data intensive exascale environments. The methods and techniques are applicable to exascale class data intensive applications and workflows that need to be deployed in highly heterogeneous computing environments.

Critical aspects of intelligent data placement are considered for extreme volumes of data. This ensures that the right resources among the storage tiers are used and accessed by data nodes as close as possible to compute nodes – optimising performance, cost, and energy at extreme scale. Advanced IO instrumentation and monitoring features will be developed to that effect leveraging the latest advancements in AI and machine learning to systematically analyse the telemetry records to make smart decisions on data placement. These ideas coupled with in-storage-computation remove unnecessary data movements within the system.

The IO-SEA project (EuroHPC-2019-1 topic b) has connections to the DEEP-SEA (topic d) and RED-SEA (topic c) project. It leverages technologies developed by the SAGE, SAGE2 and NextGEN-IO projects, and strengthens the TLR of the developed products and technologies.

Call for proposal

H2020-JTI-EuroHPC-2019-1
See other projects for this call

Coordinator

COMMISSARIAT A L ENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES
Address
Rue Leblanc 25
75015 Paris 15
France
Activity type
Research Organisations
EU contribution
€ 683 381,25

Participants (9)

BULL SAS
France
EU contribution
€ 768 006,25
Address
Rue Jean Jaures 68
78340 Les Clayes Sous Bois
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
FORSCHUNGSZENTRUM JULICH GMBH
Germany
EU contribution
€ 755 782,50
Address
Wilhelm Johnen Strasse
52428 Julich
Activity type
Research Organisations
EUROPEAN CENTRE FOR MEDIUM-RANGE WEATHER FORECASTS
United Kingdom
EU contribution
€ 420 156,25
Address
Shinfield Park
RG2 9AX Reading
Activity type
Research Organisations
SEAGATE SYSTEMS UK LIMITED
United Kingdom
EU contribution
€ 521 875
Address
Langstone Road
PO9 1SA Havant
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
NATIONAL UNIVERSITY OF IRELAND GALWAY
Ireland
EU contribution
€ 171 625
Address
University Road
H91 Galway
Activity type
Higher or Secondary Education Establishments
VSB - TECHNICAL UNIVERSITY OF OSTRAVA
Czechia
EU contribution
€ 216 875
Address
17 Listopadu 2172/15
708 00 Ostrava Poruba
Activity type
Higher or Secondary Education Establishments
KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden
EU contribution
€ 164 605
Address
Brinellvagen 8
100 44 Stockholm
Activity type
Higher or Secondary Education Establishments
Masarykova univerzita
Czechia
EU contribution
€ 64 375
Address
Zerotinovo Namesti 9
601 77 Brno
Activity type
Higher or Secondary Education Establishments
JOHANNES GUTENBERG-UNIVERSITAT MAINZ
Germany
EU contribution
€ 231 295
Address
Saarstrasse 21
55122 Mainz
Activity type
Higher or Secondary Education Establishments