Data-centric Parallel Programming

Información del proyecto

DAPP

Identificador del acuerdo de subvención: 678880

DOI

10.3030/678880

Proyecto cerrado

Fecha de la firma de la CE 16 Marzo 2016

Fecha de inicio 1 Junio 2016

Fecha de finalización 30 Septiembre 2021

Financiado con arreglo a

• EXCELLENT SCIENCE - European Research Council (ERC)

Coste total

€ 1 499 672,00

Aportación de la UE

€ 1 499 672,00

Coordinado por

EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
Switzerland

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Publicaciones

Conference proceedings (36)

A Modular Benchmarking Infrastructure for High-Performance and Reproducible Deep Learning

Autores: Tal Ben-Nun, Maciej Besta, Simon Huber, Alexandros Nikolaos Ziogas, Daniel Peter, Torsten Hoefler
Publicado en: 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2019, Página(s) 66-77, ISBN 978-1-7281-1246-6
Editor: IEEE
DOI: 10.1109/ipdps.2019.00018

Mitigating network noise on Dragonfly networks through application-aware routing

Autores: Daniele De Sensi, Salvatore Di Girolamo, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-32, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356196

Productivity, portability, performance - data-centric Python

Autores: Alexandros Nikolaos Ziogas, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Tiziano De Matteis, Johannes de Fine Licht, Luca Lavarini, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2021, Página(s) 1-13, ISBN 9781450384421
Editor: ACM
DOI: 10.1145/3458817.3476176

Taming unbalanced training workloads in deep learning with partial collective operations

Autores: Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo, Dan Alistarh, Torsten Hoefler
Publicado en: Proceedings of the 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2020, Página(s) 45-61, ISBN 9781450368186
Editor: ACM
DOI: 10.1145/3332466.3374528

Predicting Weather Uncertainty with Deep Convnets

Autores: Grönquist, Peter; Ben-Nun, Tal; Dryden, Nikoli; Dueben, Peter; Lavarini, Luca; Li, Shigang; Hoefler, Torsten
Publicado en: Edición 1, 2019
Editor: Arxiv

Naos: Serialization-free RDMA networking in Java

Autores: Taranov, Konstantin Bruno, Rodrigo Alonso, Gustavo Hoefler, Torsten
Publicado en: 2021
Editor: USENIX Association

ProGraML: A Graph-based Program Representation for Data Flow Analysis and Compiler Optimizations

Autores: Chris Cummins, Zacharias V. Fisches, Tal Ben-Nun, Torsten Hoefler, Michael F P O’Boyle, Hugh Leather
Publicado en: 2021
Editor: International Conference on Machine Learning

On the parallel I/O optimality of linear algebra kernels - near-optimal LU factorization

Autores: Grzegorz Kwasniewski, Tal Ben-Nun, Alexandros Nikolaos Ziogas, Timo Schneider, Maciej Besta, Torsten Hoefler
Publicado en: Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2021, Página(s) 463-464, ISBN 9781450382946
Editor: ACM
DOI: 10.1145/3437801.3441590

SparCML - high-performance sparse communication for machine learning

Autores: Cedric Renggli, Saleh Ashkboos, Mehdi Aghagolzadeh, Dan Alistarh, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-15, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356222

Streaming message interface - high-performance distributed memory programming on reconfigurable hardware

Autores: Tiziano De Matteis, Johannes de Fine Licht, Jakub Beránek, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-33, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356201

SeBS - a serverless benchmark suite for function-as-a-service computing

Autores: Marcin Copik, Grzegorz Kwasniewski, Maciej Besta, Michal Podstawski, Torsten Hoefler
Publicado en: Proceedings of the 22nd International Middleware Conference, 2021, Página(s) 64-78, ISBN 9781450385343
Editor: ACM
DOI: 10.1145/3464298.3476133

An In-Depth Analysis of the Slingshot Interconnect

Autores: De Sensi, Daniele; Di Girolamo, Salvatore; McMahon, Kim H.; Roweth, Duncan; Hoefler, Torsten
Publicado en: Edición 1, 2020
Editor: IEEE

Chimera: efficiently training large-scale neural networks with bidirectional pipelines

Autores: Shigang Li, Torsten Hoefler
Publicado en: 2021
Editor: ACM

Stateful dataflow multigraphs - a data-centric model for performance portability on heterogeneous architectures

Autores: Tal Ben-Nun, Johannes de Fine Licht, Alexandros N. Ziogas, Timo Schneider, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-14, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356173

NPBench - a benchmarking suite for high-performance NumPy

Autores: Alexandros Nikolaos Ziogas, Tal Ben-Nun, Timo Schneider, Torsten Hoefler
Publicado en: Proceedings of the ACM International Conference on Supercomputing, 2021, Página(s) 63-74, ISBN 9781450383356
Editor: ACM
DOI: 10.1145/3447818.3460360

CoRM - Compactable Remote Memory over RDMA

Autores: Konstantin Taranov, Salvatore Di Girolamo, Torsten Hoefler
Publicado en: Proceedings of the 2021 International Conference on Management of Data, 2021, Página(s) 1811-1824, ISBN 9781450383431
Editor: ACM
DOI: 10.1145/3448016.3452817

Absinthe: Learning an Analytical Performance Model to Fuse and Tile Stencil Codes in One Shot

Autores: Tobias Gysi, Tobias Grosser, Torsten Hoefler
Publicado en: 2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT), 2019, Página(s) 370-382, ISBN 978-1-7281-3613-4
Editor: IEEE
DOI: 10.1109/pact.2019.00036

Log(graph) - a near-optimal high-performance graph representation

Autores: Maciej Besta, Dimitri Stanojevic, Tijana Zivic, Jagpreet Singh, Maurice Hoerold, Torsten Hoefler
Publicado en: Proceedings of the 27th International Conference on Parallel Architectures and Compilation Techniques, 2018, Página(s) 1-13, ISBN 9781450359863
Editor: ACM
DOI: 10.1145/3243176.3243198

Red-blue pebbling revisited - near optimal parallel matrix-matrix multiplication

Autores: Grzegorz Kwasniewski, Marko Kabić, Maciej Besta, Joost VandeVondele, Raffaele Solcà, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-22, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356181

Pebbles, Graphs, and a Pinch of Combinatorics - Towards Tight I/O Lower Bounds for Statically Analyzable Programs

Autores: Grzegorz Kwasniewski, Tal Ben-Nun, Lukas Gianinazzi, Alexandru Calotoiu, Timo Schneider, Alexandros Nikolaos Ziogas, Maciej Besta, Torsten Hoefler
Publicado en: Proceedings of the 33rd ACM Symposium on Parallelism in Algorithms and Architectures, 2021, Página(s) 328-339, ISBN 9781450380706
Editor: ACM
DOI: 10.1145/3409964.3461796

Designing scalable FPGA architectures using high-level synthesis

Autores: J. de Fine Licht, M. Blott, T. Hoefler
Publicado en: 2018
Editor: ACM

Neural Code Comprehension: A Learnable Representation of Code Semantics

Autores: Tal Ben-Nun, Alice Shoshana Jakobovits, Torsten Hoefler
Publicado en: Advances in Neural Information Processing Systems 31, 2018
Editor: Curran Associates

A data-centric approach to extreme-scale ab initio dissipative quantum transport simulations

Autores: Alexandros Nikolaos Ziogas, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '19, 2019, Página(s) 1-13, ISBN 9781450362290
Editor: ACM Press
DOI: 10.1145/3295500.3357156

Optimizing the data movement in quantum transport simulations via data-centric parallel programming

Autores: Alexandros Nikolaos Ziogas, Tal Ben-Nun, Guillermo Indalecio Fernández, Timo Schneider, Mathieu Luisier, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '19, 2019, Página(s) 1-17, ISBN 9781450362290
Editor: ACM Press
DOI: 10.1145/3295500.3356200

A fast analytical model of fully associative caches

Autores: Tobias Gysi, Tobias Grosser, Laurin Brandner, Torsten Hoefler
Publicado en: Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation - PLDI 2019, 2019, Página(s) 816-829, ISBN 9781-450367127
Editor: ACM Press
DOI: 10.1145/3314221.3314606

Embedding Functions Into Reversible Circuits - A Probabilistic Approach to the Number of Lines

Autores: Niels Gleinig, Frances Ann Hubis, Torsten Hoefler
Publicado en: Proceedings of the 56th Annual Design Automation Conference 2019 on - DAC '19, 2019, Página(s) 1-6, ISBN 9781-450367257
Editor: ACM Press
DOI: 10.1145/3316781.3317814

Substream-Centric Maximum Matchings on FPGA

Autores: Maciej Besta, Marc Fischer, Tal Ben-Nun, Johannes De Fine Licht, Torsten Hoefler
Publicado en: Proceedings of the 2019 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays - FPGA '19, 2019, Página(s) 152-161, ISBN 9781-450361378
Editor: ACM Press
DOI: 10.1145/3289602.3293916

sPIN - High-performance streaming Processing In the Network

Autores: Torsten Hoefler, Salvatore Di Girolamo, Konstantin Taranov, Ryan E. Grant, Ron Brightwell
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2017, Página(s) 1-16, ISBN 9781450351140
Editor: ACM
DOI: 10.1145/3126908.3126970

Slim graph - practical lossy graph compression for approximate graph processing, storage, and analytics

Autores: Maciej Besta, Simon Weber, Lukas Gianinazzi, Robert Gerstenberger, Andrey Ivanov, Yishai Oltchik, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-25, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356182

Corrected trees for reliable group communication

Autores: Martin Küttler, Maksym Planeta, Jan Bierbaum, Carsten Weinhold, Hermann Härtig, Amnon Barak, Torsten Hoefler
Publicado en: Proceedings of the 24th Symposium on Principles and Practice of Parallel Programming, 2019, Página(s) 287-299, ISBN 9781450362252
Editor: ACM
DOI: 10.1145/3293883.3295721

Data Movement Is All You Need: A Case Study on Optimizing Transformers

Autores: Ivanov, Andrei; Dryden, Nikoli; Ben-Nun, Tal; Li, Shigang; Hoefler, Torsten
Publicado en: ETH ZÜRICH, Edición 1, 2020
Editor: Arxiv

Network-accelerated non-contiguous memory transfers

Autores: Salvatore Di Girolamo, Konstantin Taranov, Andreas Kurth, Michael Schaffner, Timo Schneider, Jakub Beránek, Maciej Besta, Luca Benini, Duncan Roweth, Torsten Hoefler
Publicado en: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2019, Página(s) 1-14, ISBN 9781450362290
Editor: ACM
DOI: 10.1145/3295500.3356189

StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems

Autores: J. de Fine Licht, A. Kuster, T. De Matteis, T. Ben-Nun, D. Hofer, T. Hoefler
Publicado en: 2021
Editor: tbc

Flexible Communication Avoiding Matrix Multiplication on FPGA with High-Level Synthesis

Autores: Johannes de Fine Licht, Grzegorz Kwasniewski, Torsten Hoefler
Publicado en: Proceedings of the 2020 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, 2020, Página(s) 244-254, ISBN 9781450370998
Editor: ACM
DOI: 10.1145/3373087.3375296

An Efficient Algorithm for Sparse Quantum State Preparation

Autores: Niels Gleinig, Torsten Hoefler
Publicado en: 2021 58th ACM/IEEE Design Automation Conference (DAC), 2021, Página(s) 433-438, ISBN 978-1-6654-3274-0
Editor: IEEE
DOI: 10.1109/dac18074.2021.9586240

SlimSell: A Vectorizable Graph Representation for Breadth-First Search

Autores: Maciej Besta, Florian Marending, Edgar Solomonik, Torsten Hoefler
Publicado en: 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2017, Página(s) 32-41, ISBN 978-1-5386-3914-6
Editor: IEEE
DOI: 10.1109/ipdps.2017.93

Peer reviewed articles (6)

Transformations of High-Level Synthesis Codes for High-Performance Computing

Autores: Johannes de Fine Licht, Maciej Besta, Simon Meierhans, Torsten Hoefler
Publicado en: IEEE Transactions on Parallel and Distributed Systems, Edición 32/5, 2021, Página(s) 1014-1029, ISSN 1045-9219
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpds.2020.3039409

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging

Autores: Shigang Li, Tal Ben-Nun, Giorgi Nadiradze, Salvatore Digirolamo, Nikoli Dryden, Dan Alistarh, Torsten Hoefler
Publicado en: IEEE Transactions on Parallel and Distributed Systems, 2020, Página(s) 1-1, ISSN 1045-9219
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpds.2020.3040606

Deep learning for post-processing ensemble weather forecasts

Autores: Peter Grönquist, Chengyuan Yao, Tal Ben-Nun, Nikoli Dryden, Peter Dueben, Shigang Li, Torsten Hoefler
Publicado en: Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Edición 379/2194, 2021, Página(s) 20200092, ISSN 1364-503X
Editor: Royal Society of London
DOI: 10.1098/rsta.2020.0092

Trends in Data Locality Abstractions for HPC Systems

Autores: Didem Unat, Anshu Dubey, Torsten Hoefler, John Shalf, Mark Abraham, Mauro Bianco, Bradford L. Chamberlain, Romain Cledat, H. Carter Edwards, Hal Finkel, Karl Fuerlinger, Frank Hannig, Emmanuel Jeannot, Amir Kamil, Jeff Keasler, Paul H J Kelly, Vitus Leung, Hatem Ltaief, Naoya Maruyama, Chris J. Newburn, Miquel Pericas
Publicado en: IEEE Transactions on Parallel and Distributed Systems, Edición 28/10, 2017, Página(s) 3007-3020, ISSN 1045-9219
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpds.2017.2703149

Substream-Centric Maximum Matchings on FPGA

Autores: Maciej Besta, Marc Fischer, Tal Ben-Nun, Dimitri Stanojevic, Johannes De Fine Licht, Torsten Hoefler
Publicado en: ACM Transactions on Reconfigurable Technology and Systems, Edición 13/2, 2020, Página(s) 1-33, ISSN 1936-7406
Editor: Association for Computing Machinery (ACM)
DOI: 10.1145/3377871

Demystifying Parallel and Distributed Deep Learning

Autores: Tal Ben-Nun, Torsten Hoefler
Publicado en: ACM Computing Surveys, Edición 52/4, 2019, Página(s) 1-43, ISSN 0360-0300
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3320060

Other (4)

Stateful Dataflow Multigraphs: A Data-Centric Model for Performance Portability on Heterogeneous Architectures

Autores: Ben-Nun, Tal; Licht, Johannes de Fine; Ziogas, Alexandros Nikolaos; Schneider, Timo; Hoefler, Torsten
Publicado en: arXiv, Edición 4, 2019
Editor: arXiv

Predicting Weather Uncertainty with Deep Convnets

Autores: P. Grönquist, T. Ben-Nun, N. Dryden, P. Dueben, L. Lavarini, S. Li, T. Hoefler
Publicado en: arXiv, 2019
Editor: arXiv

Streaming Message Interface: High-Performance DistributedMemory Programming on Reconfigurable Hardware

Autores: T. De Matteis, J. de Fine Licht, J. Beránek, T. Hoefler
Publicado en: arXiv, 2019
Editor: arXiv

FBLAS: Streaming Linear Algebra on FPGA

Autores: De Matteis, Tiziano; Licht, Johannes de Fine; Hoefler, Torsten
Publicado en: arXiv, Edición 5, 2019
Editor: arXiv