Excellence in Simulation of Weather and Climate in Europe, Phase 2

Informacje na temat projektu

ESiWACE2

Identyfikator umowy o grant: 823988

DOI

10.3030/823988

Projekt został zamknięty

Data podpisania przez KE 12 Listopada 2018

Data rozpoczęcia 1 Stycznia 2019

Data zakończenia 31 Marca 2023

Finansowanie w ramach

• EXCELLENT SCIENCE - Research Infrastructures

Koszt całkowity

€ 8 035 063,75

Wkład UE

€ 8 035 063,75

Koordynowany przez

DEUTSCHES KLIMARECHENZENTRUM GMBH
Germany

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (25)

Report summarising porting the different models to containers, including evaluation of the performance on the supercomputer where the containers are deployed

Due at month 50 PU R Lead ETH Zurich

Exploitation Plan

Plan identifying types of potential pathways of market-oriented exploitation, converting or transforming knowledge will be identified, together with key factors for a successful innovation management. Due at project month 6; PU; R; Lead: DKRZ

Advanced software stack for Earth system data

Documentation and design description along with formal code release of the ensemble code and hardened ESDM software and various backend implementations Due at month 24 PU R Lead UREAD

Report on summer school and its material

Report covering the teaching material and discussing the result of the conducted survey regarding the quality and effectiveness of the summer school and the individual OER materials Due at month 36 PU R Lead UREAD

Report on services offered on weather and climate benchmarks

Provide documentation of new benchmarks and publish benchmark codes where applicable Summarise typical performance measures and accuracy levels for different benchmarks on different hardware Due at month 46 PU R Lead DKRZ

Report on the ESDM runtime extensions for parallel in-flight analytics

Formal documentation of the ESDM parallel runtime strategies and software implemented final release Due at month 36 PU R Lead CMCC

Material and summary of the hackathon experiences

Derived from individual reports by each of the attending partners Due at month 12 PU R Lead ETH Zurich

Simulations of global high-resolution climate and weather models in production mode

Present and compare productionmode configurations that were developed in task 11 Discuss the major challenges for highresolution simulations coupling and model IO Provide information on scalability and performance at different horizontal resolution when running the models on local supercomputing systems Report on IO and storage aspects Due at month 36 PU R Lead ECMWF

Report on the implementation of the ESDM PAV analytical kernels for post-processing, analysis and visualisation

Formal documentation of the implemented ESDM PAV analytical kernels final release Due at month 43 PU R MPIM

To make Europe's Earth system models fit for the exascale

Summarise the work done identify achievements and describe possible future developments Discuss the main bottlenecks for Europes models towards exascale simulations and how to address them Due at month 50 PU R Lead NLeSC

Report on the final implementation of key selected post-processing, analytics and visualisation applications and main outcomes

Report on the main technical portingtoESDM aspects outcomes and guidelines related to key community applications Due at month 49 PU R Lead MPIM

First white paper on community guidelines on the use, value and applicability of emerging technologies in climate and weather applications

First white paper on community guidelines on the use, value and applicability of emerging technologies in climate and weather applications Due at month 20; PU; R; Lead: CMCC

Report on the different trainings

Report describing the different online or facetoface training on IO DSLs C coupling HPDA containerisation held during the project Due at month 42 PU R Lead CERFACS

Software documentation and roadmap

Formal documentation of software produced description of any ongoing issues discovered during this work with a forwardlooking data handling roadmap Due at month 49 PU R Lead UREAD

Scalability on pre-exascale EuroHPC systems

Discuss challenges encountered when porting the models of task 11 to the new supercomputing systems Discuss scalability of all models when running on the new systems with different horizontal resolution Extrapolate performance and data requirements to exascale and discuss potential resolutions that could be realised on future exascale machines when perfect scalability is assumed Due at month 50 PU R Lead DKRZ

Training OER material made available under a permissive CC-by licence

Report describing the OER material Due at month 36 PU R Lead CERFACS

Report on the performance of DSL compilers with the proposed models

Due at month 50 PU R Lead UKRI

Dissemination, Engagement and Communication Plan

It explains the strategy behind the project for disseminating to relevant stakeholders and communicating to the society at large. Due at project month 4; PU; R; Lead: DKRZ

Report on services offered on IO, coupling and workflow

A document summarizing the services offered on IO coupling and workflow to the different modelling groups analysing the benefits and the longterm sustainability of the improvements achieved during the service period Due at month 49 PU R Lead CERFACS

Strategy for the Intellectual Property Exploitation

Strategy for defining measures for exploitation after the project phase providing evidence of best practices in capturing and assessing Due at project month 50 PU R Lead DKRZ

Sustainability Plan

Defines the longterm strategy for sustainability Due at project month 36 PU R Lead DKRZ

Report summarising the adaptation of the proposed DSLs and the evaluation of the benchmarks and models proposed in this project

Due at month 48 PU R

Report on services in portability and refactoring

Summarise results from porting applications Discuss how to move forward and advance the codes towards exascale Due at month 46 PU R Lead BULL

Report on appliances available for testing

Report on appliance configurations and performance Due at month 45 PU R Lead SEAGATE

Second white paper on community guidelines on the use, value and applicability of emerging technologies in climate and weather applications

Due at month 47 PU R Lead CMCC

Other (2)

Machine learning workshop

Due at month 24 PU OTHER Lead UNIMAN

6th ENES HPC-workshop in Hamburg

Three day Workshop continuing the successful series of HPC workshops (Hamburg, Toulouse (2x) and Lecce (2x)) on weather and climate-related subjects. Due at month 18; PU; OTHER; Lead: DKRZ

Websites, patent fillings, videos etc. (2)

Project Public website

The website of ESiWACE2 will be based on the existing website of ESiWACE1 (www.esiwace.eu). Modifications and extensions with regard to the description of both projects on this website will be carried out. Due at project month 2; PU; DEC; Lead: DKRZ

Model inter-comparison for global high-resolution simulations

A webpage that presents guidelines for model intercomparison including data management sharing of input files as well as the conversion of output files to standard file formats will be published Due at month 24 PU DEC Lead DKRZ

Open Research Data Pilot (1)

Data Management Plan (DMP)

DMP sets up the requirements of the “Guidelines on FAIR Data Management in Horizon 2020”. Due at project month 6, PU; R; Lead: DKRZ

Publikacje

Peer reviewed articles (35)

Atmospheric Energy Spectra in Global Kilometre-Scale Models

Autorzy: C. C. Stephan, J. Duras, L. Harris, D. Klocke, W. M. Putman, M. Taylor, N. P. Wedi, N. Žagar, F. Ziemen
Opublikowane w: Tellus A: Dynamic Meteorology and Oceanography, Numer Volume 74, Numer 1, 2022, Strona(/y) 280-299, ISSN 1600-0870
Wydawca: Stockholm University Press
DOI: 10.16993/tellusa.26

Tropical Cirrus in Global Storm-Resolving Models: 2. Cirrus Life Cycle and Top-of-Atmosphere Radiative Fluxes

Autorzy: S. M. Turbeville,  J. M. Nugent,  T. P. Ackerman,  C. S. Bretherton,  P. N. Blossey
Opublikowane w: Earth and Space Science, Numer Volume 9, Numer 2, 2022, ISSN 2333-5084
Wydawca: American Geophysical Union (AGU)
DOI: 10.1029/2021ea001978

Single-Precision in the Tangent-Linear and Adjoint Models of Incremental 4D-Var

Autorzy: Sam Hatfield, Andrew McRae, Tim Palmer, Peter Düben
Opublikowane w: Monthly Weather Review, Numer 148/4, 2020, Strona(/y) 1541-1552, ISSN 0027-0644
Wydawca: American Meteorological Society
DOI: 10.1175/mwr-d-19-0291.1

Tropical Cyclones in Global Storm-Resolving Models

Autorzy: Falko JUDT, Daniel KLOCKE, Rosimar RIOS-BERRIOS, Benoit VANNIERE, Florian ZIEMEN, Ludovic AUGER, Joachim BIERCAMP, Christopher BRETHERTON, Xi CHEN, Peter DÜBEN, Cathy HOHENEGGER, Marat KHAIROUTDINOV, Chihiro KODAMA, Luis KORNBLUEH, Shian-Jiann LIN, Masuo NAKANO, Philipp NEUMANN, William PUTMAN, Niklas RÖBER, Malcolm ROBERTS, Masaki SATOH, Ryosuke SHIBUYA, Bjorn STEVENS, Pier Luigi VIDALE, Nils W
Opublikowane w: Journal of the Meteorological Society of Japan. Ser. II, Numer Volume 99, Numer 3, 2021, Strona(/y) 579-602, ISSN 0026-1165
Wydawca: Meteorological Society of Japan/Nihon Kisho Gakkai
DOI: 10.2151/jmsj.2021-029

Bridging observations, theory and numerical simulation of the ocean using machine learning

Autorzy: Maike Sonnewald, Redouane Lguensat, Daniel C Jones, Peter D Dueben, Julien Brajard and V Balaji
Opublikowane w: Environmental Research Letters, Numer Volume 16, Number 7, 2021, ISSN 1748-9326
Wydawca: Institute of Physics Publishing
DOI: 10.1088/1748-9326/ac0eb0

Evaluation and optimisation of the I/O scalability for the next generation of Earth system models: IFS CY43R3 and XIOS 2.0 integration as a case study

Autorzy: Xavier Yepes-Arbós, Gijs van den Oord, Mario C. Acosta, and Glenn D. Carver
Opublikowane w: Geoscientific Model Development, Numer 15, 2022, Strona(/y) 379–394, ISSN 1991-959X
Wydawca: Copernicus Gesellschaft mbH
DOI: 10.5194/gmd-15-379-2022

A Comparison of Data-Driven Approaches to Build Low-Dimensional Ocean Models

Autorzy: Niraj Agarwal, D. Kondrashov, P. Dueben, E. Ryzhov, P. Berloff
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 13, Numer 9, 2021, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002537

ICON-Sapphire: simulating the components of the Earth system and their interactions at kilometer and subkilometer scales

Autorzy: Hohenegger, C., Korn, P., Linardakis, L., Redler, R., Schnur, R., Adamidis, P., Bao, J., Bastin, S., Behravesh, M., Bergemann, M., Biercamp, J., Bockelmann, H., Brokopf, R., Brüggemann, N., Casaroli, L., Chegini, F., Datseris, G., Esch, M., George, G., Giorgetta, M., Gutjahr, O., Haak, H., Hanke, M., Ilyina, T., Jahns, T., Jungclaus, J., Kern, M., Klocke, D., Kluft, L., Kölling, T., Kornblueh, L
Opublikowane w: Geoscientific Model Development, Numer Volume 16, Numer 2, 2023, Strona(/y) 779–811, ISSN 1991-9603
Wydawca: European Geosciences Union
DOI: 10.5194/gmd-16-779-2023

Compressing atmospheric data into its real information content

Autorzy: Milan Klöwer, Miha Razinger, Juan J. Dominguez, Peter D. Düben and Tim N. Palmer
Opublikowane w: Nature Computational Science, Numer 1, 2021, Strona(/y) 713–724, ISSN 2662-8457
Wydawca: Nature Research
DOI: 10.1038/s43588-021-00156-2

A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts

Autorzy: L. Harris, A. T. T. McRae, M. Chantry, P. D. Dueben, & T. N. Palmer
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 14, Numer 10, 2022, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2022ms003120

The Landscape of Exascale Research

Autorzy: Stijn Heldens, Pieter Hijma, Ben Van Werkhoven, Jason Maassen, Adam S. Z. Belloum, Rob V. Van Nieuwpoort
Opublikowane w: ACM Computing Surveys, Numer 53/2, 2020, Strona(/y) 1-43, ISSN 0360-0300
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3372390

The Elements of the Thermodynamic Structure of the Tropical Atmosphere

Autorzy: Jiawei BAO, Bjorn STEVENS
Opublikowane w: Journal of the Meteorological Society of Japan. Ser. II, Numer Volume 99 Numer 6, 2021, Strona(/y) 1483-1499, ISSN 0026-1165
Wydawca: Meteorological Society of Japan/Nihon Kisho Gakkai
DOI: 10.2151/jmsj.2021-072

Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction

Autorzy: Tommaso Benacchio, Luca Bonaventura, Mirco Altenbernd, Chris D Cantwell, Peter D Dueben, Mike Gillard, Luc Giraud, Dominik Goeddeke, Erwan Raffin, Keita Teranishi and Nils Wedi
Opublikowane w: The International Journal of High Performance Computing Applications, Numer 35(4), 2021, Strona(/y) 285-311, ISSN 1094-3420
Wydawca: SAGE Publications
DOI: 10.1177/1094342021990433

Towards HPC and Big Data Analytics Convergence: Design and Experimental Evaluation of a HPDA Framework for eScience at Scale

Autorzy: D. Elia, S. Fiore and G. Aloisio
Opublikowane w: IEEE Access, Numer vol. 9, 2021, Strona(/y) pp. 73307-73326, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2021.3079139

The Relationship between Numerical Precision and Forecast Lead Time in the Lorenz’95 System

Autorzy: Fenwick C. Cooper, Peter D. Düben, Christophe Denis, Andrew Dawson, Peter Ashwin
Opublikowane w: Monthly Weather Review, Numer 148/2, 2020, Strona(/y) 849-855, ISSN 0027-0644
Wydawca: American Meteorological Society
DOI: 10.1175/mwr-d-18-0200.1

Machine Learning Emulation of Gravity Wave Drag in Numerical Weather Forecasting

Autorzy: Matthew Chantry, Sam Hatfield, Peter Dueben, Inna Polichtchouk, and Tim Palmer
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume13, Numer7, 2021, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002477

Link between the time-space behavior of rainfall and 3D dynamical structures of equatorial waves in global convection-permitting simulations

Autorzy: H. Jung, and P. Knippertz
Opublikowane w: Geophysical Research Letters, Numer Volume 50, Numer 2, 2022, ISSN 1944-8007
Wydawca: American Geophysical Union
DOI: 10.1029/2022gl100973

Deep learning for post-processing ensemble weather forecasts

Autorzy: Peter Grönquist, Chengyuan Yao, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Shigang Li and Torsten Hoefler
Opublikowane w: Philosophical Transactions of the Royal Society A, Numer Volume 379, Numer 2194, 2021, ISSN 1364-503X
Wydawca: Royal Society of London
DOI: 10.1098/rsta.2020.0092

TRU-NET: a deep learning approach to high resolution prediction of rainfall

Autorzy: Rilwan A. Adewoyin, Peter Dueben, Peter Watson, Yulan He, Ritabrata Dutta
Opublikowane w: Machine Learning, Numer 110, 2021, Strona(/y) 2035–2062, ISSN 0885-6125
Wydawca: Kluwer Academic Publishers
DOI: 10.1007/s10994-021-06022-6

Global Simulations of the Atmosphere at 1.45 km Grid-Spacing with the Integrated Forecasting System

Autorzy: Peter Düben; Nils Wedi; Sami Saarinen; Christian Zeman
Opublikowane w: Journal of the Meteorological Society of Japan, Numer 98 (3), 2020, Strona(/y) 551-572, ISSN 2186-9057
Wydawca: Meteorological Society of Japan
DOI: 10.3929/ethz-b-000425651

Machine Learning Emulation of 3D Cloud Radiative Effects

Autorzy: D. Meyer, R. J. Hogan, P.D. Dueben, S.L. Mason
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 14, Numer 3, 2022, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002550

The Fractal Nature of Clouds in Global Storm-Resolving Models

Autorzy: Hannah M. Christensen, Oliver G. A. Driver
Opublikowane w: Geophysical Research Letters, Numer Volume 48, Numer 23, 2021, ISSN 0094-8276
Wydawca: American Geophysical Union
DOI: 10.1029/2021gl095746

Number Formats, Error Mitigation, and Scope for 16-Bit Arithmetics in Weather and Climate Modeling Analyzed With a Shallow Water Model

Autorzy: M. Klöwer, P. D. Düben, T. N. Palmer
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer 12, 2020, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2020ms002246

litstudy: A Python package for literature reviews

Autorzy: Stijn Heldens, Alessio Sclocco, Henk Dreuning, Ben van Werkhoven, Pieter Hijma, Jason Maassen, Rob V. van Nieuwpoort
Opublikowane w: SoftwareX, Numer Volume 20, 2022, ISSN 2352-7110
Wydawca: Elsevier
DOI: 10.1016/j.softx.2022.101207

A Baseline for Global Weather and ClimateSimulations at 1 km Resolution

Autorzy: Nils P. Wedi, Inna Polichtchouk, Peter Dueben, Valentine G. Anantharaj, Peter Bauer, Souhail Boussetta, Philip Browne, Willem Deconinck, Wayne Gaudin, Ioan Hadade, Sam Hatfield, Olivier Iffrig, Philippe Lopez, Pedro Maciel, Andreas Mueller, Sami Saarinen, Irina Sandu, Tiago Quintino, Frederic Vitart
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer 12, 2020, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2020ms002192

The ICON Earth System Model version 1.0

Autorzy: J. H. Jungclaus, S. J. Lorenz, H. Schmidt, V. Brovkin, N. Brüggemann, F. Chegini, T. Crüger, P. De-Vrese, V. Gayler, M. A. Giorgetta, O. Gutjahr, H. Haak, S. Hagemann, M. Hanke, T. Ilyina, P. Korn, J. Kröger, L. Linardakis, C. Mehlmann, U. Mikolajewicz, W. A. Müller, J. E. M. S. Nabel, D. Notz, H. Pohlmann, D. A. Putrasahan, T. Raddatz, L. Ramme, R. Redler, C. H. Re
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 14, Numer 4, 2022, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002813

Inter-model Variability in Convection-Resolving Simulations of Subtropical Marine Low Clouds

Autorzy: Christoph HEIM, Laureline HENTGEN, Nikolina BAN, Christoph SCHÄR
Opublikowane w: Journal of the Meteorological Society of Japan. Ser. II, Numer Volume 99 Numer 5, 2021, Strona(/y) 1271-1295, ISSN 0026-1165
Wydawca: Meteorological Society of Japan/Nihon Kisho Gakkai
DOI: 10.2151/jmsj.2021-062

Building Tangent-Linear and Adjoint Models for Data Assimilation With Neural Networks

Autorzy: Sam Hatfield, Matthew Chantry, Peter Dueben, Philippe Lopez, Alan Geer, Tim Palmer
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 13, Numer 9, 2021, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002521

Air-Sea Interactions and Water Mass Transformation During a Katabatic Storm in the Irminger Sea

Autorzy: O. Gutjahr,  J. H. Jungclaus,  N. Brüggemann,  H. Haak,  J. Marotzke
Opublikowane w: Journal of Geophysical Research: Oceans, Numer Volume 127, Numer 5, 2022, ISSN 2169-9291
Wydawca: American Geophysical Union
DOI: 10.1029/2021jc018075

WeatherBench: A Benchmark Data Set for Data-Driven Weather Forecasting

Autorzy: Stephan Rasp; Peter Dueben; Sebastian Scher; Jonathan A. Weyn; Soukayna Mouatadid; Nils Thuerey
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer 12, 2020, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2020ms002203

Tropical Free-Tropospheric Humidity Differences and Their Effect on the Clear-Sky Radiation Budget in Global Storm-Resolving Models

Autorzy: Theresa Lang, Ann Kristin Naumann, Bjorn Stevens, Stefan A. Buehler
Opublikowane w: Journal of Advances in Modeling Earth Systems, Numer Volume 13, Numer 11, 2021, ISSN 1942-2466
Wydawca: American Geophysical Union
DOI: 10.1029/2021ms002514

Model intercomparison of COSMO 5.0 and IFS 45r1 at kilometer-scale grid spacing

Autorzy: Christian Zeman; Nils Wedi; Peter Dueben; Nikolina Ban; Christoph Schär
Opublikowane w: Geoscientific Model Development, Numer 14 (7), 2021, ISSN 1991-959X
Wydawca: Copernicus Gesellschaft mbH
DOI: 10.5194/gmd-14-4617-2021

Tropical Cirrus in Global Storm-Resolving Models: 1. Role of Deep Convection

Autorzy: J. M. Nugent,  S. M. Turbeville,  C. S. Bretherton,  P. N. Blossey,  T. P. Ackerman
Opublikowane w: Earth and Space Science, Numer Volume 9, Numer 2, 2022, ISSN 2333-5084
Wydawca: American Geophysical Union (AGU)
DOI: 10.1029/2021ea001965

Potential of I/O Aware Workflows in Climate and Weather

Autorzy: Julian M. Kunkel, Luciana R. Pedro
Opublikowane w: Supercomputing Frontiers and Innovations, Numer 7/2, 2020, ISSN 2313-8734
Wydawca: Publishing Center of South Ural State University
DOI: 10.14529/jsfi200203

Assessing uncertainties from physical parameters and modelling choices in an atmospheric large eddy simulation model

Autorzy: Fredrik Jansson,, Wouter Edeling, Jisk Attema, and Daan Crommelin
Opublikowane w: Philosophical Transactions of the Royal Society A, Numer Volume 379, Numer 2197, 2021, ISSN 1364-503X
Wydawca: Royal Society of London
DOI: 10.1098/rsta.2020.0073