Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Next Generation I/O for Exascale

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Final NEXTGenIO Technology Assessment (opens in new window)

Report giving the final assessment and evaluation of the NEXTGenIO solution. This report includes the results from benchmarking the I/O Workload Simulator and an I/O server solution on the NEXTGenIO architecture and we as well as evaluating the test-bed with different storage file systems.

The NEXTGenIO Architecture (opens in new window)

Published report that gives a final description of the NEXTGenIO hardware, systemware, and data architecture.

Final report on energy-aware and data-aware scheduling (opens in new window)

Final report on the job scheduler and data scheduler, with coordination and automatic guidance (using hints, metrics and tools). Evaluation of the benefits achieved using the prototype.

Final Public Project Report (opens in new window)

Final Public Project Report.

Final report on NVRAM data storage (opens in new window)

Dynamic management of the NVRAM layer, providing dynamic partition schemes and support for different applications. Analysis of different services to provide compression, resiliency, and de-duplication on the layer. Final software prototype released.

Final Dissemination and Exploitation Report (opens in new window)

Final Dissemination and Exploitation Report. Public report. If any confidential information is included it will added as a separate confidential annex.

Final report on the NEXTGenIO systemware (opens in new window)

Final report collating all the details on the NEXTGenIO systemware. This includes: the collaboration between the different schedulers developed and PyCOMPSs; a prototype of PyCOMPSs able to communicate I/O aspects of the jobs; details on the Unit Testing employed to validate and verify the hardware.

Basic Benchmark Evaluation Report (opens in new window)

Report evaluating the basic performance of the NEXTGenIO prototype system.

Final Release of Performance Analysis and Debugging Tools (opens in new window)

Release of performance analysis tools with support for NVRAM usage analysis and hardware topology mappings. Release of debugging tools that support the removal of NVRAM related application errors.

NVRAM Supported Tool Prototypes and Techniques (opens in new window)

Prototype implementations and evaluations towards tool improvements that are enabled by NVRAM.

PyCOMPSs Release and Performance Integration (opens in new window)

Final release of PyCOMPSs extensions and report on performance measurements with its profiling interface.

Energy-aware and data-aware job and data schedulers (opens in new window)

Software implementation of the energy- and data-aware schedulers.

Final release of the I/O server software supporting NVRAM (opens in new window)

Release of the updated version of the I/O server.

Final release of the I/O Workload Simulator (opens in new window)

Release of the final version of the I/O Workload Simulator software.

Workflow Monitoring Final Release (opens in new window)

Final release of an implementation for the design in D4.3.

PyCOMPSs for NEXTGenIO (opens in new window)

Release of PyCOMPSs extended with support for the NEXTGenIO architecture.

Publications

NORNS: Extending Slurm to Support Data-Driven Workflows through Asynchronous Data Staging

Author(s): Alberto Miranda Adrian Jackson Tommaso Tocci Iakovos Panourgias Ramon Nou
Published in: 2019 IEEE International Conference on Cluster Computing (CLUSTER), 2019
Publisher: IEEE

ECHOFS: A Scheduler-Guided Temporary Filesystem to Leverage Node-Local NVMS (opens in new window)

Author(s): Alberto Miranda, Ramon Nou, Toni Cortes
Published in: 2018 30th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD), 2018, Page(s) 225-228, ISBN 978-1-5386-7769-8
Publisher: IEEE
DOI: 10.1109/cahpc.2018.8645894

Visualization of Multi-layer I/O Performance in Vampir (opens in new window)

Author(s): Hartmut Mix, Christian Herold, Matthias Weber
Published in: 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2018, Page(s) 387-394, ISBN 978-1-5386-5555-9
Publisher: IEEE
DOI: 10.1109/ipdpsw.2018.00073

GekkoFS - A Temporary Distributed File System for HPC Applications (opens in new window)

Author(s): Marc-Andre Vef, Nafiseh Moti, Tim SuB, Tommaso Tocci, Ramon Nou, Alberto Miranda, Toni Cortes, Andre Brinkmann
Published in: 2018 IEEE International Conference on Cluster Computing (CLUSTER), 2018, Page(s) 319-324, ISBN 978-1-5386-8319-4
Publisher: IEEE
DOI: 10.1109/cluster.2018.00049

A High-Performance Distributed Object-Store for Exascale Numerical Weather Prediction and Climate (opens in new window)

Author(s): Simon D. Smart, Tiago Quintino, Baudouin Raoult
Published in: Proceedings of the Platform for Advanced Scientific Computing Conference on - PASC '19, 2019, Page(s) 1-11, ISBN 9781-450367707
Publisher: ACM Press
DOI: 10.1145/3324989.3325726

A Scalable Object Store for Meteorological and Climate Data (opens in new window)

Author(s): Simon D. Smart, Tiago Quintino, Baudouin Raoult
Published in: Proceedings of the Platform for Advanced Scientific Computing Conference on - PASC '17, 2017, Page(s) 1-8, ISBN 9781-450350624
Publisher: ACM Press
DOI: 10.1145/3093172.3093238

High Performance Computing Enabled Simulation of the Food-Water-Energy System - Simulation of Intensively Managed Landscapes (opens in new window)

Author(s): Harold E.B. Dennis, Adam S. Ward, Tyler Balson, Yuwei Li, Robert Henschel, Shawn Slavin, Stephen Simms, Holger Brunst
Published in: Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact - PEARC17, 2017, Page(s) 1-10, ISBN 9781-450352727
Publisher: ACM Press
DOI: 10.1145/3093338.3093381

A Methodology for Performance Analysis of Applications Using Multi-layer I/O (opens in new window)

Author(s): Ronny Tschüter, Christian Herold, Bert Wesarg, Matthias Weber
Published in: Euro-Par 2018: Parallel Processing - 24th International Conference on Parallel and Distributed Computing, Turin, Italy, August 27 - 31, 2018, Proceedings, Issue 11014, 2018, Page(s) 16-30, ISBN 978-3-319-96982-4
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-96983-1_2

Searching for OpenAIRE data...

There was an error trying to search data from OpenAIRE

No results available

My booklet 0 0