Skip to main content

Multi-cloud Execution-ware for Large-scale Optimized Data-Intensive Computing

Deliverables

Provider agnostic interface definition & mapping cycle

This deliverable focuses on the provider agnostic interface definition and mapping to the system requirement analysis of D2.1. Representing the first iteration this definition and mapping cycle a first prototype of the provider agnostic interface mapper is developed. This prototype builds the starting point for the resource management framework and it is also evaluated against the the first draft of the resource management framework.

Dissemination and communication plan

This deliverable will provide a roadmap for the dissemination activities carried out by all partners throughout and beyond the project, including scientific publications, Internet, media and social channels.

Report on data placement and migration methodologies

This report will start with a review of existing data management techniques for clouds, before reporting on the novel MELODIC methodologies for data placement, data migration, and post-migration handling of data in a distributed multi-cloud infrastructure.

Integration and adaptation strategy

This deliverable will specify the requirements for adaptation of available OSS components. It will provide a catalogue of possible integration issues along with relevant mitigation measures.

Final Report

This is a public report starting from the objectives, approach and challenges addressed by MELODIC, and documenting the resoults achieved, the lessons learned, and the recommendations for the future both with respect to technology, access and governance of the open source MELODIC platform, and promotes the use cases as examples for others to follow.

Evaluation Framework and Use Case Planning

This report will document the MELODIC evaluation framework, the validation scenario definitions and the organization and planning of the use case demonstrations.

Architecture and initial feature definitions

The Architecture definition will detail and explain the overall architecture of the MELODIC middleware, and in particular describe the key components of MELODIC, and how these components are to interact and collaborate in order to realise an efficient multi-cloud middleware platform for data-intensive applications. In addition, the initial feature definition of MELODIC will be provided.

Updates to OSS frameworks

This deliverable will provide the results of the review of underpinning OSS frameworks (PaaSage, PaaSword, CACTOS) with a list of neccessary changes in these frameworks, especially related to security.

Resource management framework prototype

This deliverable focuses on the first prototype of the resource management framework. It revisits the provider agnostic interface definition to provide an interface for the Upperware, including management and monitoring capabilities. This first iteration of the resource management framework also includes the completed integration of PaaSage and CACTOS components.

Resource Management Framework

This deliverable finalises the resource management framework. It revisits the prototype of D4.3 and refines the resource management framework due to lessons lerned during the development of the data processing layer and the Upperware. The resource management framework is evaluated using of the data processing layer.

Final framework and external APIs

This report will describe the final MELODIC framework and the external APIs for MELODIC, developed and defined as part of the iterative MELODIC development phases. The APIs represent the interfaces for developers to utilise the MELODIC middleware platform.

Quality Assurance Guide

This deliverable will provide the description of expectations, guidelines and measures for assuring the quality of architecture, code and documentation across all work packages.

Guidebooks

This deliverable will comprise a practical guide for the transfer, application and deployment of MELODIC results in new and existing environments for practitioners from industry.

Integration & testing requirements

This deliverable will specify the requirements for integration of all technical components and testing integrated MELODIC framework.

Report on dissemination and comminication activities

This deliverable will report all the dissemination activities taken up during the project. It will include actions taken up by academic partners (list and brief presentation of scientific publications, list of scientific conferences and EC workshops attended ) and commercial partners (list of trade fairs and brief presentation of activities using different communication channels specified in D7.3).

Final features

This document will provide a comprehensive feature list of the complete MELODIC middleware platform, and conclude the last development phase for Architecture and Data management in correlation with the MELODIC final release, D5.09.

Provider agnostic interface mapper

This deliverable describes the finalisation of the provider agnostic interface mapper. Basing on D4.1 and the validation with the first prototype of the resource management framework (D4.3) necessary refinements and extension are applied to the agnostic interface mapper.

Continuous integration platform & guidelines

This deliverable will provide a dedicated continuous integration platform for development and testing pourposes. It will also include guidelines for using the platform during development and testing process.

Metadata schema

This deliverable will provide scheme definitions, and detail related concepts regarding metadata management for both data stored in the cloud as well as user defined data annotations, including the security vocabulary needed to support appropriate access control mechanisms.

Explanation and education materials

This deliverable will provide explanation and training materials supporting technical and business users of the framework and encouraging user participation.

Test strategy and environment

This deliverable will provide a description of platform testing strategy, detailed testing plan, the final version of the testing infrastructure and a set of test cases.

Data processing layer prototype

This deliverable describes the first iteration of the data processing layer resulting in a first prototype. Based on D4.1 and the parallel development of the resource management framework it lifts a first data processing engine on top of the resource management framework and implements a first version of the data storage infrastructure. This first prototype is evaluated against the first iteration of use case implementation (D6.2).

System specification document

This report will represent the initial system specification of the MELODIC middleware platform. The specification will be based on the identified requirements of different stakeholders in a multi-cloud ecosystem, as well as constraints imposed by private and public clouds. D2.1 will serve as input to the tasks of D4.1.

Security requirements & design

This deliverable will provide a specification of security requirements of the MELODIC framework and the design of the security technical component.

MELODIC Upper Ware

A report on the research and development of the MELODIC Adaptation Manager. In addition, it discusses the final iterations of all the relevant tools that constitute the MELODIC Upper Ware.

IDE-plugin for data-aware design and development of multi-cloud data-intensive applications

The first iteration of a design support tool for data-intensive application annotation will be developed in the form of a plugin for integrated development environments (IDE).

Platform prototype release

This deliverable will be the second release of integrated MELODIC framework along with the security technical component. It will include the feedback from testing the v.01 release. It will also provide the report of integration and technical testing activites (regression, funcionality, performance and security tests) for release v.02 based on test strategy and plan included in D5.6.

Workload optimisation recommendation and adaptation enactment

A report on the research and development of an expert system that optimizes multi-cloud resources allocation through means of detecting reconfiguration opportunities and finding the optimal configuration in each situation. This work will constitute the first iteration of the MELODIC Reasoner.

MELODIC portal

The MELODIC portal will be an online space gathering all the parties interested in using the framework. It will include the repository with the open source code along with relevant technical documentation as well as explanation and education materials and tools for interaction with the community.

Metadata schema management

A report on the first iteration of the MELODIC editor and the metadata schema management for maintaining all the MELODIC design-time artefacts. The necessary GUIs will be developed and made available to administrator(s) for editing and managing all the MELODIC models.

Integration release and initial test environment

This deliverable will be the first release of integrated MELODIC framework. It will also provide a report of integration and technical testing activites (regression, funcionality, performance and security tests) based on test strategy and test plan included in D4.6 as well as the description of the initial version of testing infrastructure.

MELODIC final release

This deliverable will be the final release of integrated MELODIC framework along with the security technical component. It will include the feedback from testing the v.02 release. It will also provide the report of integration and technical testing activites (regression, funcionality, performance and security tests) for final release based on test strategy and plan included in D5.06.

Business logic for supporting the complete data and data-intensive application life-cycle management

An analysis of the MELODIC pre-migration, migration and post-migration phase methodologies to be considered for supporting the complete data and data-intensive application life-cycle management. It will provide the appropriate business logic for supporting this life-cycle management in distributed cloud environments.

Searching for OpenAIRE data...

Publications

Gibbon: An Availability Evaluation Framework for Distributed Databases

Author(s): Daniel Seybold, Christopher B. Hauser, Simon Volpert, Jörg Domaschka
Published in: On the Move to Meaningful Internet Systems. OTM 2017 Conferences: Confederated International Conferences: CoopIS, C&TC, and ODBASE 2017, Rhodes, Greece, October 23-27, 2017, Proceedings, Part II, 2017, Page(s) 31-49
DOI: 10.1007/978-3-319-69459-7_3

A Provider-Agnostic Approach to Multi-cloud Orchestration Using a Constraint Language

Author(s): Daniel Baur, Daniel Seybold, Frank Griesinger, Hynek Masata, Jorg Domaschka
Published in: 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2018, Page(s) 173-182
DOI: 10.1109/CCGRID.2018.00032

MELODIC: Utility Based Cross Cloud Deployment Optimisation

Author(s): Geir Horn, Pawel Skrzypek
Published in: 2018 32nd International Conference on Advanced Information Networking and Applications Workshops (WAINA), 2018, Page(s) 360-367
DOI: 10.1109/WAINA.2018.00112

Is Distributed Database Evaluation Cloud-Ready?

Author(s): Daniel Seybold, Jörg Domaschka
Published in: New Trends in Databases and Information Systems: ADBIS 2017 Short Papers and Workshops, AMSD, BigNovelTI, DAS, SW4CH, DC, Nicosia, Cyprus, September 24–27, 2017, Proceedings, 2017, Page(s) 100-108
DOI: 10.1007/978-3-319-67162-8_12

Towards a Framework for Orchestrated Distributed Database Evaluation in the Cloud

Author(s): Daniel Seybold
Published in: Middleware '17 Proceedings of the 18th Doctoral Symposium of the 18th International Middleware Conference, 2017, Page(s) 13-14
DOI: 10.18725/OPARU-7820

Done Yet? A Critical Introspective of the Cloud Management Toolbox

Author(s): Mark Leznik, Simon Volpert, Frank Griesinger, Daniel Seybold, Jorg Domaschka
Published in: 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC), 2018, Page(s) 1-8
DOI: 10.1109/ICE.2018.8436348

A cloud-centric survey on distributed database evaluation

Author(s): Seybold, Daniel; Domaschka, Jörg.
Published in: 21. European Conference on Advances in Databases and Information Systems (ADBIS), 2017-09-24 - 2017-09-27, Nicosia, 2017
DOI: 10.18725/oparu-4382

Towards the Modelling of Adaptation Rules and Histories for Multi-Cloud Applications

Author(s): Kyriakos Kritikos, Chrysostomos Zeginis, Eleni Politaki, Dimitris Plexousakis
Published in: Proceedings of the 9th International Conference on Cloud Computing and Services Science, 2019, Page(s) 300-307
DOI: 10.5220/0007706503000307

Mowgli - Finding Your Way in the DBMS Jungle

Author(s): Daniel Seybold, Moritz Keppler, Daniel Gründler, Jörg Domaschka
Published in: Proceedings of the 2019 ACM/SPEC International Conference on Performance Engineering - ICPE '19, 2019, Page(s) 321-332
DOI: 10.1145/3297663.3310303

Metadata Schema for Data-Aware Multi-Cloud Computing

Author(s): Yiannis Verginadis, Ioannis Patiniotakis, Gregoris Mentzas
Published in: 2018 Innovations in Intelligent Systems and Applications (INISTA), 2018, Page(s) 1-9
DOI: 10.1109/inista.2018.8466270

Towards Dynamic and Optimal Big Data Placement

Author(s): Kyriakos Kritikos
Published in: 2018 17th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/ 12th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE), 2018, Page(s) 1730-1737
DOI: 10.1109/trustcom/bigdatase.2018.00262

A Model Driven Engineering Approach for Flexible and Distributed Monitoring of Cross-Cloud Applications

Author(s): Daniel Baur, Frank Griesinger, Yiannis Verginadis, Vasilis Stefanidis, Ioannis Patiniotakis
Published in: 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC), 2018, Page(s) 31-40
DOI: 10.1109/ucc.2018.00012

A Review of Serverless Frameworks

Author(s): Kyriakos Kritikos, Pawel Skrzypek
Published in: 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion), 2018, Page(s) 161-168
DOI: 10.1109/ucc-companion.2018.00051

Mobile Edge as Part of the Multi-Cloud Ecosystem: A Performance Study

Author(s): Thomas Dreibholz, Somnath Mazumdar, Feroz Zahid, Amir Taherkordi, Ernst Gunnar Gran
Published in: 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), 2019, Page(s) 59-66
DOI: 10.1109/empdp.2019.8671599

Towards the Modelling of Hybrid Cloud Applications

Author(s): Kyriakos Kritikos, Pawel Skrzypek, Alexandru Moga, Oliviu Matei
Published in: 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), 2019, Page(s) 291-295
DOI: 10.1109/cloud.2019.00056

Simulation-as-a-Service with Serverless Computing

Author(s): Kyriakos Kritikos, Pawel Skrzypek
Published in: 2019 IEEE World Congress on Services (SERVICES), 2019, Page(s) 200-205
DOI: 10.1109/services.2019.00056

Kaa: Evaluating Elasticity of Cloud-Hosted DBMS

Author(s): Daniel Seybold, Simon Volpert, Stefan Wesner, Andre Bauer, Nikolas Herbst, Jorg Domaschka
Published in: 2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 2019, Page(s) 54-61
DOI: 10.1109/cloudcom.2019.00020

Towards Understanding the Performance of Distributed Database Management Systems in Volatile Environments

Author(s): Jörg Domaschka and Daniel Seybold
Published in: 10th Symposium on Software Performance 2019, 4.-6. November 2019, Würzburg, Germany, 2019

Good Bye Vendor Lock-in - Getting your Cloud Applications Multi-Cloud Ready!

Author(s): Marta Różańska, Kyriakos Kritikos
Published in: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion - UCC '19 Companion, 2019, Page(s) 171-173
DOI: 10.1145/3368235.3370267

Affine Scalarization of Two-Dimensional Utility Using the Pareto Front

Author(s): Geir Horn, Marta Rozanska
Published in: 2019 IEEE International Conference on Autonomic Computing (ICAC), 2019, Page(s) 147-156
DOI: 10.1109/icac.2019.00026

Towards an Integration Methodology for Multi-Cloud Application Management Platforms

Author(s): Kyriakos Kritikos, Paweł Skrzypek, Marta Różańska
Published in: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion - UCC '19 Companion, 2019, Page(s) 21-28
DOI: 10.1145/3368235.3368833

A Self-Adaptive Network for HPC Clouds: Architecture, Framework, and Implementation

Author(s): Feroz Zahid, Amir Taherkordi, Ernst Gunnar Gran, Tor Skeie, Bjorn Dag Johnsen
Published in: IEEE Transactions on Parallel and Distributed Systems, 2018, Page(s) 1-1, ISSN 1045-9219
DOI: 10.1109/TPDS.2018.2842224

Future Cloud Systems Design: Challenges and Research Directions

Author(s): Amir Taherkordi, Feroz Zahid, Yiannis Verginadis, Geir Horn
Published in: IEEE Access, 2018, Page(s) 1-1, ISSN 2169-3536
DOI: 10.1109/ACCESS.2018.2883149

A survey on data storage and placement methodologies for Cloud-Big Data ecosystem

Author(s): Somnath Mazumdar, Daniel Seybold, Kyriakos Kritikos, Yiannis Verginadis
Published in: Journal of Big Data, Issue 6/1, 2019, ISSN 2196-1115
DOI: 10.1186/s40537-019-0178-3

Multi-cloud provisioning of business processes

Author(s): Kyriakos Kritikos, Chrysostomos Zeginis, Joaquin Iranzo, Roman Sosa Gonzalez, Daniel Seybold, Frank Griesinger, Jörg Domaschka
Published in: Journal of Cloud Computing, Issue 8/1, 2019, ISSN 2192-113X
DOI: 10.1186/s13677-019-0143-x

Cost Benefits of Multi-cloud Deployment of Dynamic Computational Intelligence Applications

Author(s): Geir Horn, Paweł Skrzypek, Katarzyna Materka, Tomasz Przeździȩk
Published in: Web, Artificial Intelligence and Network Applications - Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Issue 927, 2019, Page(s) 1041-1054
DOI: 10.1007/978-3-030-15035-8_102

Data Center Clustering for Geographically Distributed Cloud Deployments

Author(s): Dipesh Pradhan, Feroz Zahid
Published in: Web, Artificial Intelligence and Network Applications - Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Issue 927, 2019, Page(s) 1030-1040
DOI: 10.1007/978-3-030-15035-8_101

IaaS Service Selection Revisited

Author(s): Kyriakos Kritikos, Geir Horn
Published in: Service-Oriented and Cloud Computing - 7th IFIP WG 2.14 European Conference, ESOCC 2018, Como, Italy, September 12-14, 2018, Proceedings, Issue 11116, 2018, Page(s) 170-184
DOI: 10.1007/978-3-319-99819-0_13

Distributed Complex Event Processing in Multiclouds

Author(s): Vassilis Stefanidis, Yiannis Verginadis, Ioannis Patiniotakis, Gregoris Mentzas
Published in: Service-Oriented and Cloud Computing - 7th IFIP WG 2.14 European Conference, ESOCC 2018, Como, Italy, September 12-14, 2018, Proceedings, Issue 11116, 2018, Page(s) 105-119
DOI: 10.1007/978-3-319-99819-0_8

The Impact of the Storage Tier: A Baseline Performance Analysis of Containerized DBMS

Author(s): Daniel Seybold, Christopher B. Hauser, Georg Eisenhart, Simon Volpert, Jörg Domaschka
Published in: Euro-Par 2018: Parallel Processing Workshops - Euro-Par 2018 International Workshops, Turin, Italy, August 27-28, 2018, Revised Selected Papers, Issue 11339, 2019, Page(s) 93-105
DOI: 10.1007/978-3-030-10549-5_8

A Context-Aware Service for Authorizing Multi-cloud Deployments

Author(s): Yiannis Verginadis, Ioannis Patiniotakis, Gregoris Mentzas
Published in: Web, Artificial Intelligence and Network Applications - Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Issue 927, 2019, Page(s) 996-1006
DOI: 10.1007/978-3-030-15035-8_98

Building an Open-Source Cross-Cloud DevOps Stack for a CRM Enterprise Application: A Case Study

Author(s): Sebastian Schork, Feroz Zahid, Dipesh Pradhan, Sébastien Kicin, Antonia Schwichtenberg
Published in: Open Source Systems - 15th IFIP WG 2.13 International Conference, OSS 2019, Montreal, QC, Canada, May 26–27, 2019, Proceedings, Issue 556, 2019, Page(s) 3-11
DOI: 10.1007/978-3-030-20883-7_1

Towards Realistic Simulations of Arbitrary Cross-Cloud Workloads

Author(s): Nicolay Mohebi, Feroz Zahid
Published in: Web, Artificial Intelligence and Network Applications - Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), Issue 927, 2019, Page(s) 1020-1029
DOI: 10.1007/978-3-030-15035-8_100

Towards an Optimized, Cloud-Agnostic Deployment of Hybrid Applications

Author(s): Kyriakos Kritikos, Paweł Skrzypek
Published in: Business Information Systems - 22nd International Conference, BIS 2019, Seville, Spain, June 26–28, 2019, Proceedings, Part I, Issue 353, 2019, Page(s) 435-449
DOI: 10.1007/978-3-030-20485-3_34

MELODIC: Selection and Integration of Open Source to Build an Autonomic Cross-Cloud Deployment Platform

Author(s): Geir Horn, Paweł Skrzypek, Marcin Prusiński, Katarzyna Materka, Vassilis Stefanidis, Yiannis Verginadis
Published in: Software Technology: Methods and Tools - 51st International Conference, TOOLS 2019, Innopolis, Russia, October 15–17, 2019, Proceedings, Issue 11771, 2019, Page(s) 364-377
DOI: 10.1007/978-3-030-29852-4_31

Dynamic Patterns for Cloud Application Life-Cycle Management

Author(s): Geir Horn, Leire Orue-Echevarria Arrieta, Beniamino Di Martino, Paweł Skrzypek, Dimosthenis Kyriazis
Published in: Advances on P2P, Parallel, Grid, Cloud and Internet Computing - Proceedings of the 14th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC-2019), Issue 96, 2020, Page(s) 626-637
DOI: 10.1007/978-3-030-33509-0_59