BigStorage: Storage-based Convergence between HPC and Cloud to handle Big Data

Risultati finali

Report that describes the state-of-the-art of Data Science.

Report that describes the requirements of the different use cases in detail.

WP5. Intermediate Report on Achieved Milestones

Report that shows the characterization of storage systems and applications in HPC and clouds concerning energy consumption.

WP1. Proposal evaluation

Report providing details of the viability of the BigStorage architecture.

WP3. Intermediate Report

Report that presents a complete overview of current cloud and HPC storage systems.

WP4. Intermediate Report

Report that describes the state-of-the-art related to storage solutions for WP4.

WP4. Final Report

Summarizes activities and results, introducing new techniques for accelerating storage through I/O optimizations.

WP3. HPC / Cloud Convergence – Final

Report that summarizes the final outcome of the WP, presenting a unified architecture for cloud and HPC storage backends.

WP5. Energy savings – Final Report

Report that presents the implementation of energy saving techniques and analyses their impact for datacentres.

WP2. Data Science – Final Report

Report on the final outcome of the WP tasks, presenting new solutions for data transfer and streaming and energy-efficient task scheduling.

WP6. Coordination Management Final Report

Summarizes the final outcome of the coordination and management activities in the network, and the guidelines for future training networks.

WP1. Benchmarks defined & tested

Report that describes the tools and benchmarks studied to emulate BigStorage use cases.

WP7 - Final Report

Summarizes the communication, dissemination and training activities in the network.

Pubblicazioni

Could Blobs Fuel Storage-Based Convergence Between HPC and Big Data?

Autori: Pierre Matri, Yevhen Alforov, Alvaro Brandon, Michael Kuhn, Philip Carns, Thomas Ludwig
Pubblicato in: 2017 IEEE International Conference on Cluster Computing (CLUSTER), 2017, Pagina/e 81-86, ISBN 978-1-5386-2326-8
Editore: IEEE
DOI: 10.1109/CLUSTER.2017.63

HetFS: A Heterogeneous File System for Everyone

Autori: Georgios Koloventzos, Ramon Nou, Alberto Miranda, Toni Cortes
Pubblicato in: ISC High Performance Computing, 2017, Pagina/e 691-700, ISBN 978-3-319-67630-2
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-67630-2_49

Towards a unified storage and ingestion architecture for stream processing

Autori: Ovidiu-Cristian Marcu, Alexandru Costan, Gabriel Antoniu, Maria S. Perez-Hernandez, Radu Tudoran, Stefano Bortoli, Bogdan Nicolae
Pubblicato in: 2017 IEEE International Conference on Big Data (Big Data), 2017, Pagina/e 2402-2407, ISBN 978-1-5386-2715-0
Editore: IEEE
DOI: 10.1109/BigData.2017.8258196

An Empirical Evaluation of How the Network Impacts the Performance and Energy Efficiency in RAMCloud

Autori: Yacine Taleb, Shadi Ibrahim, Gabriel Antoniu, Toni Cortes
Pubblicato in: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2017, Pagina/e 1027-1034, ISBN 978-1-5090-6611-7
Editore: IEEE
DOI: 10.1109/CCGRID.2017.127

Machine Learning-based Query Augmentation for SPARQL Endpoints

Autori: Mariano Rico, Rizkallah Touma, Anna Queralt, María S. Pérez
Pubblicato in: Proceedings of the 14th International Conference on Web Information Systems and Technologies, 2018, Pagina/e 57-67, ISBN 978-989-758-324-7
Editore: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006925300570067

Towards Efficient Location and Placement of Dynamic Replicas for Geo-Distributed Data Stores

Autori: Pierre Matri, Alexandru Costan, Gabriel Antoniu, Jesús Montes, María S. Pérez
Pubblicato in: Proceedings of the ACM 7th Workshop on Scientific Cloud Computing - ScienceCloud '16, 2016, Pagina/e 3-9, ISBN 9781-450343534
Editore: ACM Press
DOI: 10.1145/2913712.2913715

Spark Versus Flink: Understanding Performance in Big Data Analytics Frameworks

Autori: Ovidiu-Cristian Marcu, Alexandru Costan, Gabriel Antoniu, Maria S. Perez-Hernandez
Pubblicato in: 2016 IEEE International Conference on Cluster Computing (CLUSTER), 2016, Pagina/e 433-442, ISBN 978-1-5090-3653-0
Editore: IEEE
DOI: 10.1109/cluster.2016.22

Týr: Blob Storage Meets Built-In Transactions

Autori: Pierre Matri, Alexandru Costan, Gabriel Antoniu, Jesus Montes, Maria S. Perez
Pubblicato in: SC16: International Conference for High Performance Computing, Networking, Storage and Analysis, 2016, Pagina/e 573-584, ISBN 978-1-4673-8815-3
Editore: IEEE
DOI: 10.1109/SC.2016.48

KerA: Scalable Data Ingestion for Stream Processing

Autori: Ovidiu-Cristian Marcu, Alexandru Costan, Gabriel Antoniu, Maria Perez-Hernandez, Bogdan Nicolae, Radu Tudoran, Stefano Bortoli
Pubblicato in: 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS), 2018, Pagina/e 1480-1485, ISBN 978-1-5386-6871-9
Editore: IEEE
DOI: 10.1109/ICDCS.2018.00152

TýrFS: Increasing Small Files Access Performance with Dynamic Metadata Replication

Autori: Pierre Matri, Maria S Perez, Alexandru Costan, Gabriel Antoniu
Pubblicato in: 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2018, Pagina/e 452-461, ISBN 978-1-5386-5815-4
Editore: IEEE
DOI: 10.1109/CCGRID.2018.00072

SLoG: Large-Scale Logging Middleware for HPC and Big Data Convergence

Autori: Pierre Matri, Philip Carns, Robert Ross, Alexandru Costan, Maria S. Perez, Gabriel Antoniu
Pubblicato in: 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS), 2018, Pagina/e 1507-1512, ISBN 978-1-5386-6871-9
Editore: IEEE
DOI: 10.1109/ICDCS.2018.00156

GekkoFS - A Temporary Distributed File System for HPC Applications

Autori: Marc-Andre Vef, Nafiseh Moti, Tim SuB, Tommaso Tocci, Ramon Nou, Alberto Miranda, Toni Cortes, Andre Brinkmann
Pubblicato in: 2018 IEEE International Conference on Cluster Computing (CLUSTER), 2018, Pagina/e 319-324, ISBN 978-1-5386-8319-4
Editore: IEEE
DOI: 10.1109/CLUSTER.2018.00049

Towards a TRansparent I/O Solution

Autori: Fotios Nikolaidis, Nick Kossifidis, Thomas Leibovici, Soraya Zertal
Pubblicato in: 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2018, Pagina/e 1221-1228, ISBN 978-1-5386-5555-9
Editore: IEEE
DOI: 10.1109/IPDPSW.2018.00189

"Next Stop ""NoOps"": Enabling Cross-System Diagnostics Through Graph-Based Composition of Logs and Metrics"

Autori: Michal Zasadzinski, Marc Sole, Alvaro Brandon, Victor Muntes-Mulero, David Carrera
Pubblicato in: 2018 IEEE International Conference on Cluster Computing (CLUSTER), 2018, Pagina/e 212-222, ISBN 978-1-5386-8319-4
Editore: IEEE
DOI: 10.1109/cluster.2018.00039

Virtual Machine Boot Time Model

Autori: Thuy Linh Nguyen, Adrien Lebre
Pubblicato in: 2017 25th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP), 2017, Pagina/e 430-437, ISBN 978-1-5090-6058-0
Editore: IEEE
DOI: 10.1109/PDP.2017.58

Actor Based Root Cause Analysis in a Distributed Environment

Autori: Michal Zasadzinski, Victor Muntes-Mulero, Marc Soe Simo
Pubblicato in: 2017 IEEE/ACM 3rd International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS), 2017, Pagina/e 14-17, ISBN 978-1-5386-4043-2
Editore: IEEE
DOI: 10.1109/SEsCPS.2017.3

Characterizing Performance and Energy-Efficiency of the RAMCloud Storage System

Autori: Yacine Taleb, Shadi Ibrahim, Gabriel Antoniu, Toni Cortes
Pubblicato in: 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), 2017, Pagina/e 1488-1498, ISBN 978-1-5386-1792-2
Editore: IEEE
DOI: 10.1109/ICDCS.2017.51

Exploring Shared State in Key-Value Store for Window-Based Multi-pattern Streaming Analytics

Autori: Ovidiu-Cristian Marcu, Radu Tudoran, Bogdan Nicolae, Alexandru Costan, Gabriel Antoniu, Maria S. Perez-Hernandez
Pubblicato in: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2017, Pagina/e 1044-1052, ISBN 978-1-5090-6611-7
Editore: IEEE
DOI: 10.1109/CCGRID.2017.126

Predicting Access to Persistent Objects through Static Code Analysis

Autori: Rizkallah Touma, Anna Queralt, Toni Cortes, María S. Pérez
Pubblicato in: New Trends in Databases and Information Systems (ADBIS 2017), 2017, Pagina/e 54-62, ISBN 978-3-319-67161-1
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-67162-8_7

A Simulation Optimisation Tool and Its Production/Inventory Control Application

Autori: D. Katsios, A. S. Xanthopoulos, D. E. Koulouriotis, A. Kiatipis
Pubblicato in: International Journal of Simulation Modelling, Numero 17/2, 2018, Pagina/e 257-270, ISSN 1726-4529
Editore: DAAAM International Vienna
DOI: 10.2507/ijsimm17(2)425

Using machine learning to optimize parallelism in big data applications

Autori: Álvaro Brandón Hernández, María S. Perez, Smrati Gupta, Victor Muntés-Mulero
Pubblicato in: Future Generation Computer Systems, Numero 86, 2018, Pagina/e 1076-1092, ISSN 0167-739X
Editore: Elsevier BV
DOI: 10.1016/j.future.2017.07.003

Survey of Storage Systems for High-Performance Computing

Autori: Jakob Lüttgau, Michael Kuhn, Kira Duwe, Yevhen Alforov, Eugen Betke, Julian Kunkel, Thomas Ludwig
Pubblicato in: Supercomputing Frontiers and Innovations, Numero 5/1, 2018, Pagina/e 31–58, ISSN 2313-8734
Editore: Publishing Center of South Ural State University
DOI: 10.14529/jsfi180103

Keeping up with storage: Decentralized, write-enabled dynamic geo-replication

Autori: Pierre Matri, María S. Pérez, Alexandru Costan, Luc Bougé, Gabriel Antoniu
Pubblicato in: Future Generation Computer Systems, Numero 86, 2018, Pagina/e 1093-1105, ISSN 0167-739X
Editore: Elsevier BV
DOI: 10.1016/j.future.2017.06.009

FMonE: A Flexible Monitoring Solution at the Edge

Autori: Álvaro Brandón, María S. Pérez, Jesus Montes, Alberto Sanchez
Pubblicato in: Wireless Communications and Mobile Computing, Numero 2018, 2018, Pagina/e 1-15, ISSN 1530-8669
Editore: John Wiley & Sons Inc.
DOI: 10.1155/2018/2068278

Reinforcement Learning-Based and Parametric Production-Maintenance Control Policies for a Deteriorating Manufacturing System

Autori: A. S. Xanthopoulos, Athanasios Kiatipis, D. E. Koulouriotis, Sepp Stieger
Pubblicato in: IEEE Access, Numero 6, 2018, Pagina/e 576-588, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2017.2771827

Early Termination of Failed HPC Jobs Through Machine and Deep Learning

Autori: Michał Zasadziński, Victor Muntés-Mulero, Marc Solé, David Carrera, Thomas Ludwig
Pubblicato in: Euro-Par 2018: Parallel Processing - 24th International Conference on Parallel and Distributed Computing, Turin, Italy, August 27 - 31, 2018, Proceedings, Numero 11014, 2018, Pagina/e 163-177, ISBN 978-3-319-96982-4
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-96983-1_12

Diritti di proprietà intellettuale

MODEL BASED ROOT CAUSE ANALYSIS

Numero candidatura/pubblicazione: US 20170372212A1
Data: 2016-06-28
Candidato/i: CA TECHNOLOGIES DEVELOPMENT SPAIN SA

Risultati finali

Pubblicazioni

Diritti di proprietà intellettuale

Condividi questa pagina

Scarica