Integrated Data Analysis Pipelines for Large-Scale Data Management, HPC, and Machine Learning

Leistungen

Report on the initial design of distribution primitives and existing framework integration

Report on requirements of endtoend data analysis pipelines and design of the initial system architecture

Scheduler design for pipelines and tasks

Report on the initial overall design of the scheduling components scheduling of pipelines and workflows as well as task and data placement

SotA survey of benchmarks from DM, HPC, and ML Sys

Report on the stateoftheart of benchmarks for database systems data management highperformance computing and ML systems

Initial pipeline definition all use cases

Report on use case studies with technical details and the definition of initial pipelines that can be used for testing

Language Design Specification

Report on the language abstractions APIs and DSL as well as the central internal representation

Design of integration HW accelerators

Report on the planned overall design of integration HW accelerators as well as details on accelerated operations and primitives as well as its compiler and runtime support

Report on search space analysis, automatic capability configuration

Report on stateoftheart techniques for computational storage neardata processing and potential side effects as well as an overview of automatically determining the capabilities of a storage configuration

1st Annual Project Report

Public report describing the project progress until M12 achievements and impact as well as a calculation of efforts and costs

Compiler Prototype

Software artifact of the initial compiler prototype

Veröffentlichungen

DaphneSched: A Scheduler for Integrated Data Analysis Pipelines

Autoren: Ahmed Eleliemy, Florina M. Ciorba
Veröffentlicht in: ISPDC23; IEEE, 2023
Herausgeber: ISPDC23; IEEE

I/O Interface Independence with xNVMe

Autoren: Simon Lund, Philippe Bonnet, Klaus Jensen, Javier Gonzalez
Veröffentlicht in: Proceedings of the 15th ACM International Systems and Storage Conference, Issue annually, 2022
Herausgeber: ACM - Association for Computing Machinery

DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines

Autoren: Patrick Damme, Marius Birkenbach, Constantinos Bitsakos, Matthias Boehm, Philippe Bonnet, Florina Ciorba, Mark Dokter, Pawel Dowgiallo, Ahmed Eleliemy, Christian Faerber, Georgios Goumas, Dirk Habich, Niclas Hedam, Marlies Hofer, Wenjun Huang, Kevin Innerebner, Vasileios Karakostas, Roman Kern, Tomaž Kosar, Daniel Krems, Andreas Laber, Wolfgang Lehner, Eric Mier, Marcus Paradies, Bernhard Peischl
Veröffentlicht in: Conference on Innovative Data Systems Research, CIDR, Issue 9.1.2022-12.1.2022, 2022
Herausgeber: Conference on Innovative Data Systems Research, CIDR

Micro-architectural Analysis of a Learned Index

Autoren: Mikkel Møller Andersen, Pınar Tözün
Veröffentlicht in: Proceedings of the International Workshop on Exploiting Artificial Intelligence Techniques for Data Management, Issue annually, 2022
Herausgeber: ACM - Association for Computing Machinery
DOI: 10.1145/3533702.3534917

Not your Grandpa's SSD: The Era of Co-Designed Storage Devices

Autoren: Alberto Lerner, Philippe Bonnet
Veröffentlicht in: Proceedings of the 2021 International Conference on Management of Data, 2021
Herausgeber: ACM

Evaluating Multi-GPU Sorting with Modern Interconnects

Autoren: Tobias Maltenberger, Ivan Ilic, Ilin Tolovski, Tilmann Rabl
Veröffentlicht in: Proceedings of the 2022 International Conference on Management of Data (SIGMOD ’22), Issue annually, 2022
Herausgeber: ACM - Association for Computing Machinery

Efficient Multi-Model Management

Autoren: Nils Strassenburg, Dominic Kupfer, Julia Kowal, Tilmann Rabl
Veröffentlicht in: 26th International Conference on Extending Database Technology (EDBT), Issue annually, 2023
Herausgeber: OpenProceedings.org

Enabling Integrated Data Analysis Pipelines on Heterogeneous Hardware through Holistic Extensibility

Autoren: Patrick Damme, Matthias Boehm
Veröffentlicht in: 2nd Workshop on Novel Data Management Ideas on Heterogeneous Hardware Architectures (NoDMC), 2023
Herausgeber: Gesellschaft für Informatik

A Survey of Big Data, High Performance Computing, and Machine Learning Benchmarks

Autoren: Nina Ihde, Paula Marten, Ahmed Eleliemy, Gabrielle Poerwawinata, Pedro Silva, Ilin Tolovski, Florina M. Ciorba, Tilmann Rabl
Veröffentlicht in: Proceedings of the Thirteenth TPC Technology Conference on Performance Evaluation & Benchmarking, 2021
Herausgeber: Springer

Delilah: eBPF-offload on computational storage

Autoren: Niclas Hedam, Morten Tychsen Clausen, Philippe Bonnet, Sangjin Lee, Ken Friis Larsen
Veröffentlicht in: 19th International Workshop on Data Management on New Hardware (DaMoN), Issue annually, 2023
Herausgeber: ACM

Parallelization of benchmarking using HPC: text summarization in natural language processing (NLP), glider piloting in deep-sea missions, and search algorithms in computational intelligence (CI)

Autoren: Aleš Zamuda
Veröffentlicht in: Proceedings of the Austrian-Slovenian HPC Meeting 2021 - ASHPC21, 2021, ISBN 978-961-6980-77-7
Herausgeber: University of Ljubljana

DeGNN: Improving Graph Neural Networks with Graph Decomposition

Autoren: Miao, Xupeng; Gürel, Nezihe Merve; id_orcid0000-0002-4747-2406; Zhang, Wentao; Han, Zhichao; Li, Bo; Min, Wei; Rao, Susie; id_orcid0000-0003-2379-1506; Ren, Hansheng; Shan, Yinan; Shao, Yingxia; Wang, Yujie; Wu, Fan; Xue, Hui; Yang, Yaming; Zhang, Zitao; Zhao, Yang; Zhang, Shuai; id_orcid0000-0002-7866-4611; Wang, Yujing; Cui, Bin; Zhang, Ce
Veröffentlicht in: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (KDD '21), Issue annually, 2021
Herausgeber: ACM

Evaluating In-Memory Hash Joins on Persistent Memory

Autoren: Tobias Maltenberger, Till Lehmann, Lawrence Benson, Tilmann Rabl
Veröffentlicht in: 25th International Conference on Extending Database Technology (EDBT), Issue annually, 2022
Herausgeber: OpenProceedings.org
DOI: 10.48786/edbt.2022.23

Evaluating SIMD Compiler-Intrinsics for Database Systems

Autoren: Lawrence Benson, Richard Ebeling and Tilmann Rabl
Veröffentlicht in: VLDBW -- ADMS 23, 2023
Herausgeber: ACM - Association for Computing Machinery

TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems

Autoren: Christoph Brücke, Philipp Härtling, Rodrigo D Escobar Palacios, Hamesh Patel and Tilmann Rabl
Veröffentlicht in: 2023
Herausgeber: VLDB23; ACM - Association for Computing Machinery

Desis: Efficient Window Aggregation in Decentralized Networks

Autoren: Wang Yue, Lawrence Benson, Tilmann Rabl
Veröffentlicht in: 26th International Conference on Extending Database Technology (EDBT), Issue annually, 2023
Herausgeber: OpenProceedings.org

Darwin: Scale-In Stream Processing

Autoren: Lawrence Benson, Tilmann Rabl
Veröffentlicht in: Conference on Innovative Data Systems Research, CIDR 22, Issue annually, 2022
Herausgeber: Conference on Innovative Data Systems Research, CIDR 22

Considering a Fear and Greed Index in Bitcoin Price Prediction Through Long Short-Term Memory

Autoren: Nataša Ošep Ferš, Aleš Zamuda
Veröffentlicht in: IEEE Slovenia Section, Issue annually, 2021
Herausgeber: IEEE

Maximizing Persistent Memory Bandwidth Utilization for OLAP Workloads

Autoren: Björn Daase, Lars Jonas Bollmeier, Lawrence Benson, Tilmann Rabl
Veröffentlicht in: Proceedings of the 2021 International Conference on Management of Data (SIGMOD 2021), 2021
Herausgeber: ACM

DaphneSched: A Scheduler for Integrated Data Analysis Pipelines

Autoren: Ahmed Eleliemy, Florina M. Ciorba, Jonas H. Müller Korndörfer
Veröffentlicht in: ISPDC23, 2023
Herausgeber: ISPDC23

How Do OS and Application Schedulers Interact? An Investigation with Multithreaded Applications

Autoren: Jonas H. Müller Korndorfer, Ahmed Eleliemy, Osman Simsek, Thomas Ilsche, Robert Schöne, Florina M. Ciorba
Veröffentlicht in: Springer, 2023, ISBN 978-3-031-39697-7
Herausgeber: Euro-Par 2023

PerMA-Bench: Benchmarking Persistent Memory Access

Autoren: Benson, Lawrence and Papke, Leon and Rabl, Tilmann
Veröffentlicht in: Proceedings of the Very Large Data Base Endowment (VLDB) Endowment, Issue annually, 2022
Herausgeber: ACM - Association for Computing Machinery
DOI: 10.14778/3551793.3551807

Predicting Ion Beam Tuning in Semiconductor Manufacturing

Autoren: Andreas Laber, Martin Gebser, Konstantin Schekotihin, Yao Yang
Veröffentlicht in: IEEE Electron Devices Society, Issue bi-annually, 2022
Herausgeber: IEEE

BabelMR: A Polyglot Framework for Serverless MapReduce

Autoren: Fabian Mahling, Paul Rößler, Thomas Bodner and Tilmann Rabl
Veröffentlicht in: VLDBW -- SDA 23, 2023
Herausgeber: ACM - Association for Computing Machinery

VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition

Autoren: Li, Yang; Shen, Yu; Zhang, Wentao; Jiang, Jiawei; Ding, Bolin; Li, Yaliang; Zhou, Jingren; Yang, Zhi; Wu, Wentao; Zhang, Ce; Cui, Bin
Veröffentlicht in: Proceedings of the VLDB Endowment, 14 (11), Issue annually, 2021
Herausgeber: PVLDB

Ease. ML: A Lifecycle Management System for Machine Learning

Autoren: Aguilar Melgar, Leonel; id_orcid0000-0001-6864-4492; Dao, David; Gan, Shaoduo; Gürel, Nezihe M.; Hollenstein, Nora; id_orcid0000-0001-7936-4170; Jiang, Jiawei; Karlaš, Bojan; Lemmin, Thomas; id_orcid0000-0001-5705-4964; Li, Tian; Li, Yang; Rao, Susie; id_orcid0000-0003-2379-1506; Rausch, Johannes; Renggli, Cedric; Rimanic, Luka; Weber, Maurice; Zhang, Shuai; id_orcid0000-0002-7866-4611; Zhao, Zh
Veröffentlicht in: Proceedings of the Annual Conference on Innovative Data Systems Research (CIDR), 2021, Issue 1, 2021
Herausgeber: CIDR 2021
DOI: 10.3929/ethz-b-000458916

Drop It In Like It’s Hot: An Analysis of Persistent Memory as a Drop-in Replacement for NVMe SSDs

Autoren: Maximilian Böther, Otto Kißig, Lawrence Benson, Tilmann Rabl
Veröffentlicht in: International Workshop on Data Management on New Hardware (DAMON’21), 2021
Herausgeber: ACM SIGMOD/PODS

Efficiently Managing Deep Learning Models in a Distributed Environment

Autoren: Nils Strassenburg, Ilin Tolovski, Tilmann Rabl
Veröffentlicht in: 25th International Conference on Extending Database Technology (EDBT), Issue annually, 2022
Herausgeber: OpenProceedings.org
DOI: 10.48786/edbt.2022.12

DaxVM: Stressing the Limits of Memory as a File Interface

Autoren: Chloe Averti, Vasileios Karakostas, Nikhita Kunati, Georgios Goumas, Michael Swift
Veröffentlicht in: MICRO 2022 - 55th IEEE/ACM International Synopsium on Microarchitecture, Issue annually, 2022
Herausgeber: ACM/IEEE

A Resourceful Coordination Approach for Multilevel Scheduling

Autoren: Eleliemy, Ahmed; Ciorba, Florina M.
Veröffentlicht in: International Conference on High Performance Computing & Simulation (HPCS) 2021, Issue annual, 2021
Herausgeber: HPCS

TPCx-AI on NVIDIA Jetsons

Autoren: Robert Bayer, Jon Voigt Tøttrup, and Pınar Tözün
Veröffentlicht in: Proceedings of the Fourteenth TPC Technology Conference on Performance Evaluation & Benchmarking, 2022
Herausgeber: ACM - Association for Computing Machinery

RMG Sort: Radix-Partitioning-Based Multi-GPU Sorting

Autoren: Ivan Ilic, Ilin Tolovski, Tilmann Rabl
Veröffentlicht in: Datenbanksysteme für Business, Technologie und Web (BTW 2023), Issue bi-annually, 2023
Herausgeber: Springer

Viper: An Efficient Hybrid PMem-DRAM Key-Value Store

Autoren: Lawrence Benson, Hendrik Makait, Tilmann Rabl
Veröffentlicht in: 2021
Herausgeber: ACM

Analyzing Vectorized Hash Tables Across CPU Architectures

Autoren: Maximilian Böther, Lawrence Benson, Ana Klimovic, Tilmann Rabl
Veröffentlicht in: VLDB23, 2023
Herausgeber: ACM - Association for Computer Machinery

DocParser: Hierarchical Document Structure Parsing from Renderings

Autoren: Rausch, Johannes; Martinez, Octavio; Bissig, Fabian; Zhang, Ce; Feuerriegel, Stefan
Veröffentlicht in: Proceedings of the AAAI Conference on Artificial Intelligence, 35 (5), 2021, Page(s) 4328-4338, ISSN 2159-5399
Herausgeber: AAAI Press
DOI: 10.13039/501100000780

Speeding up Vectorized Benchmarking of Optimization Algorithms

Autoren: Aleš Zamuda
Veröffentlicht in: Austrian-Slovenian HPC Meeting 2022 – ASHPC22, Issue annually, 2022
Herausgeber: EuroCC Austria

Don’t Compete, Let’s Cooperate: A Cooperative Scheduling Approach

Autoren: Ahmed Eleliemy, Florina M. Ciorba
Veröffentlicht in: Platform for Advancing Scientific Computing Conference, 2021
Herausgeber: PASC

CleanML: A Study for Evaluating the Impact of Data Cleaning on ML Classification Tasks

Autoren: Li Peng, Rao Xi, Jennifer Blase, Xu Chu, Yue Zhang, Ce Zhang
Veröffentlicht in: DeGNN, 2020
Herausgeber: ETH Zurich, Institute for Computing Platforms
DOI: 10.13039/501100001711

Single- and Two-Level Dynamic Load Balancing of Scientific Applications

Autoren: Ahmed Eleliemy, Florina M. Ciorba
Veröffentlicht in: Platform for Advancing Scientific Computing Conference, 2021
Herausgeber: PASC

The urban morphology on our planet – Global perspectives from space

Autoren: Xiao Xiang Zhu,Chunping, Qiu, Jingliang Hua, Yilei Shi, Yuanyuan Wang, Michael Schmitta, Hannes Taubenböck
Veröffentlicht in: Remote Sensing of Environment, Issue 16 volumes / year, 2021, ISSN 0034-4257
Herausgeber: Elsevier BV
DOI: 10.1016/j.rse.2021.112794

Micro-architectural analysis of in-memory OLTP: Revisited

Autoren: Utku Sirin, Pınar Tözün, Danica Porobic, Ahmad Yasin, Anastasia Ailamaki
Veröffentlicht in: The VLDB Journal, Volume 30, Issue every other month, July 2021, 2021, ISSN 1066-8888
Herausgeber: Springer Verlag
DOI: 10.1007/s00778-021-00663-8

Better Database Cost/Performance via Batched I/O on Programmable SSD

Autoren: Jaeyoung Do, Ivan Luiz Picoli, David Lomet, Philippe Bonnet
Veröffentlicht in: Conference on Very Large Data Bases (VLDB Journal), Issue 18.2.2021, 2021, ISSN 1066-8888
Herausgeber: Springer Verlag
DOI: 10.1007/s00778-020-00648-z

LB4OMP: A Dynamic Load Balancing Library for Multithreaded Applications

Autoren: Jonas H. Müller Korndörfer; Ahmed Eleliemy; Ali Mohammed; Florina M. Ciorba
Veröffentlicht in: IEEE Transactions on Parallel and Distributed Systems, Volume 33, Issue 4, 2021, Page(s) 830 - 841, ISSN 1045-9219
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpds.2021.3107775

Automated Scheduling Algorithm Selection and Chunk Parameter Calculation in OpenMP

Autoren: Ali Mohammed, Jonas H. Müller Kornörfer, Ahmed Eleliemy, Florina M. Ciorba
Veröffentlicht in: IEEE Transactions on Parallel and Distributed Systems, Issue Volume: 33, Issue: 12, December 2022, 2022, ISSN 1045-9219
Herausgeber: Institute of Electrical and Electronics Engineers

Leistungen

Veröffentlichungen

Diese Seite teilen

Herunterladen