Productive Spatial Accelerator Programming

Project Information

PSAP

Grant agreement ID: 101002047

DOI

10.3030/101002047

EC signature date 5 March 2021

Start date 1 January 2022

End date 31 December 2026

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 980 917,00

EU contribution

€ 1 980 917,00

Coordinated by

EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH
Switzerland

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (28)

Low-Depth Spatial Tree Algorithms

Author(s): Yves Baumann, Tal Ben-Nun, Maciej Besta, Lukas Gianinazzi, Torsten Hoefler, Piotr Luczynski
Published in: 2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2024
Publisher: IEEE
DOI: 10.1109/ipdps57955.2024.00024

Network-Offloaded Bandwidth-Optimal Broadcast and Allgather for Distributed AI

Author(s): Mikhail Khalilov, Salvatore Di Girolamo, Marcin Chrapek, Rami Nudelman, Gil Bloch, Torsten Hoefler
Published in: SC24: International Conference for High Performance Computing, Networking, Storage and Analysis, 2024, Page(s) 1-17
Publisher: IEEE
DOI: 10.1109/sc41406.2024.00109

High-Performance and Programmable Attentional Graph Neural Networks with Global Tensor Formulations

Author(s): Maciej Besta, Pawel Renc, Robert Gerstenberger, Paolo Sylos Labini, Alexandros Ziogas, Tiancheng Chen, Lukas Gianinazzi, Florian Scheidl, Kalman Szenes, Armon Carigiet, Patrick Iff, Grzegorz Kwasniewski, Raghavendra Kanakagiri, Chio Ge, Sammy Jaeger, Jarosław Wąs, Flavio Vella, Torsten Hoefler
Published in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2024, Page(s) 1-16
Publisher: ACM
DOI: 10.1145/3581784.3607067

Productive Performance Engineering for Weather and Climate Modeling with Python

Author(s): Ben-Nun, Tal; Groner, Linus; Deconinck, Florian; Wicky, Tobias; Davis, Eddie; Dahm, Johann; Elbert, Oliver D.; George, Rhea; McGibbon, Jeremy; Trümper, Lukas; Wu, Elynn; Fuhrer, Oliver; Schulthess, Thomas; Hoefler, Torsten
Published in: SC'22: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, Issue 1, 2022
Publisher: SC
DOI: 10.1109/sc41404.2022.00078

Bridging Control-Centric and Data-Centric Optimization

Author(s): Tal Ben-Nun; Berke Ates; Alexandru Calotoiu; Torsten Hoefler
Published in: 2023
Publisher: 21st ACM/IEEE International Symposium on Code Generation and Optimization
DOI: 10.1145/3579990.3580018

VENOM: A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores

Author(s): Roberto L. Castro, Andrei Ivanov, Diego Andrade, Tal Ben-Nun, Basilio B. Fraguela, Torsten Hoefler
Published in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2024, Page(s) 1-14
Publisher: ACM
DOI: 10.1145/3581784.3607087

User-guided Page Merging for Memory Deduplication in Serverless Systems

Author(s): Wei Qiu, Marcin Copik, Yun Wang, Alexandru Calotoiu, Torsten Hoefler
Published in: 2023 IEEE International Conference on Big Data (BigData), 2024, Page(s) 159-169
Publisher: IEEE
DOI: 10.1109/bigdata59044.2023.10386487

HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement

Author(s): Iff, Patrick; Besta, Maciej; Cavalcante, Matheus; Fischer, Tim; Benini, Luca; Hoefler, Torsten
Published in: Issue 1, 2023
Publisher: 60th Annual Design Automation Conference
DOI: 10.48550/arxiv.2211.13989

HammingMesh: A Network Topology for Large-Scale Deep Learning

Author(s): T. Hoefler, T. Bonato, D. De Sensi, S. Di Girolamo, S. Li, M. Heddes, J. Belk, D. Goel, M. Castro, S. Scott
Published in: 2022
Publisher: International Conference for High Performance Computing, Networking, Storage and Analysis
DOI: 10.48550/arxiv.2209.01346

Sparse Hamming Graph: A Customizable Network-on-Chip Topology

Author(s): P. Iff, M. Besta, M. Cavalcante, T. Fischer, L. Benini, T. Hoefler
Published in: 2023
Publisher: 60th Annual Design Automation Conference
DOI: 10.48550/arxiv.2211.13980

KafkaDirect: Zero-copy Data Access for Apache Kafka over RDMA Networks

Author(s): K. Taranov, S. Byan, V. Marathe, T. Hoefler
Published in: 2022
Publisher: ACM SIGMOD International Conference on Management of Data
DOI: 10.1145/3514221.3526056

Performance-detective

Author(s): Larissa Schmid, Marcin Copik, Alexandru Calotoiu, Dominik Werle, Andreas Reiter, Michael Selzer, Anne Koziolek, Torsten Hoefler
Published in: Proceedings of the 36th ACM International Conference on Supercomputing, 2023, Page(s) 1-13
Publisher: ACM
DOI: 10.1145/3524059.3532391

ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations

Author(s): M. Besta, C. Miglioli, P. Sylos Labini, J. Tětek, P. Iff, R. Kanakagiri, S. Ashkboos, K. Janda, M. Podstawski, G. Kwasniewski, N. Gleinig, F. Vella, O. Mutlu, T. Hoefler
Published in: 2022
Publisher: SC'22
DOI: 10.48550/arxiv.2208.11469

DiffDA: a Diffusion model for weather-scale Data Assimilation

Author(s): Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D. Dueben, Torsten Hoefler
Published in: DiffDA, 2024
Publisher: ICML

Boosting Performance Optimization with Interactive Data Movement Visualization

Author(s): P. Schaad, T. Ben-Nun, T. Hoefler
Published in: 2022
Publisher: SC'22
DOI: 10.1109/sc41404.2022.00069

STen: An Interface for Efficient Sparsity in PyTorch

Author(s): A. Ivanov, N. Dryden, T. Hoefler
Published in: 2022
Publisher: In Sparsity in Neural Networks workshop
DOI: 10.48550/arxiv.2304.07613

Process-as-a-Service: Unifying Elastic and Stateful Clouds with Serverless Processes

Author(s): Marcin Copik, Alexandru Calotoiu, Gyorgy Rethy, Roman Böhringer, Rodrigo Bruno, Torsten Hoefler
Published in: Proceedings of the ACM Symposium on Cloud Computing, 2024, Page(s) 223-242
Publisher: ACM
DOI: 10.1145/3698038.3698567

automatic deduction of cheap and accurate performance models

Author(s): Larissa Schmid; Marcin Copik; Alexandru Calotoiu; Dominik Werle; Andreas Reiter; Michael Selzer; Anne Koziolek; Torsten Hoefler
Published in: ICS '22: Proceedings of the 36th ACM International Conference on Supercomputing, Issue 1, 2022
Publisher: ICS'22
DOI: 10.5445/ir/1000146623

The Graph Database Interface: Scaling Online Transactional and Analytical Graph Workloads to Hundreds of Thousands of Cores

Author(s): Maciej Besta, Robert Gerstenberger, Marc Fischer, Michal Podstawski, Nils Blach, Berke Egeli, Georgy Mitenkov, Wojciech Chlapek, Marek Michalewicz, Hubert Niewiadomski, Juergen Mueller, Torsten Hoefler
Published in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2024, Page(s) 1-18
Publisher: ACM
DOI: 10.1145/3581784.3607068

Streaming Task Graph Scheduling for Dataflow Architectures

Author(s): Tiziano De Matteis, Lukas Gianinazzi, Johannes de Fine Licht, Torsten Hoefler
Published in: Proceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing, 2024, Page(s) 225-237
Publisher: ACM
DOI: 10.1145/3588195.3592999

Deinsum: Practically I/O Optimal Multilinear Algebra

Author(s): A. Nikolaos Ziogas, G. Kwasniewski, T. Ben-Nun, T. Schneider, T. Hoefler
Published in: 2022
Publisher: SC'22
DOI: 10.48550/arxiv.2206.08301

Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching

Author(s): Andras Strausz; Flavio Vella; Salvatore Di Girolamo; Maciej Besta; Torsten Hoefler
Published in: 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Issue 2, 2022
Publisher: IEEE
DOI: 10.48550/arxiv.2202.13976

A data-centric optimization framework for machine learning

Author(s): Rausch, Oliver; Ben-Nun, Tal; Dryden, Nikoli; Ivanov, Andrei; Li, Shigang; Hoefler, Torsten
Published in: Proceedings of the 36th ACM International Conference on Supercomputing, Issue 7, 2022
Publisher: ACM International Conference on Supercomputing
DOI: 10.48550/arxiv.2110.10802

Maximum Flows in Parametric Graph Templates

Author(s): T. Ben-Nun, L. Gianinazzi, T. Hoefler, Y. Oltchik
Published in: 2023
Publisher: In Algorithms and Complexity - 13th International Conference
DOI: 10.48550/arxiv.2307.08420

Near-Optimal Wafer-Scale Reduce

Author(s): Piotr Luczynski, Lukas Gianinazzi, Patrick Iff, Leighton Wilson, Daniele De Sensi, Torsten Hoefler
Published in: Proceedings of the 33rd International Symposium on High-Performance Parallel and Distributed Computing, 2024, Page(s) 334-347
Publisher: ACM
DOI: 10.1145/3625549.3658693

High Performance Unstructured SpMM Computation Using Tensor Cores

Author(s): Patrik Okanovic, Grzegorz Kwasniewski, Paolo Sylos Labini, Maciej Besta, Flavio Vella, Torsten Hoefler
Published in: SC24: International Conference for High Performance Computing, Networking, Storage and Analysis, 2024, Page(s) 1-14
Publisher: IEEE
DOI: 10.1109/sc41406.2024.00060

FMI: Fast and Cheap Message Passing for Serverless Functions

Author(s): Marcin Copik, Roman Böhringer, Alexandru Calotoiu, Torsten Hoefler
Published in: Proceedings of the 37th International Conference on Supercomputing, 2023, Page(s) 373-385
Publisher: ACM
DOI: 10.1145/3577193.3593718

Lifting C semantics for dataflow optimization

Author(s): Alexandru Calotoiu; Tal Ben-Nun; Grzegorz Kwasniewski; Johannes de Fine Licht; Timo Schneider; Philipp Schaad; Torsten Hoefler
Published in: Proceedings of the 36th ACM International Conference on Supercomputing, Issue 1, 2022
Publisher: 36th ACM International Conference on Supercomputing
DOI: 10.1145/3524059.3532389

Peer reviewed articles (3)

Deep learning and a changing economy in weather and climate prediction

Author(s): Peter Bauer, Peter Dueben, Matthew Chantry, Francisco Doblas-Reyes, Torsten Hoefler, Amy McGovern, Bjorn Stevens
Published in: Nature Reviews Earth & Environment, Issue 4, 2023, Page(s) 507-509, ISSN 2662-138X
Publisher: Springer Nature
DOI: 10.1038/s43017-023-00468-z

Graph of Thoughts: Solving Elaborate Problems with Large Language Models

Author(s): Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler
Published in: Proceedings of the AAAI Conference on Artificial Intelligence, Issue 38, 2024, Page(s) 17682-17690, ISSN 2374-3468
Publisher: AAAI Press
DOI: 10.1609/aaai.v38i16.29720

Influence of Network Performance Variability on Application Scalability

Author(s): Daniele De Sensi; Tiziano De Matteis; Konstantin Taranov; Salvatore Di Girolamo; Tobias Rahn; Torsten Hoefler
Published in: Proceedings of the ACM on Measurement and Analysis of Computing Systems, 6 (3), Issue 1, 2022, ISSN 0000-0000
Publisher: Proc. ACM Meas. Anal. Comput. Syst.. Vol 6, Nr. 3, Association for Computing Machinery, Dec. 2022)
DOI: 10.1145/3570609

Other (1)

FMI: Fast and Cheap Message Passing for Serverless Functions

Author(s): M. Copik, R. Böhringer, A. Calotoiu, T. Hoefler
Published in: 2023
Publisher: ICS
DOI: 10.48550/arxiv.2305.08763