CORDIS

EU research results

CORDIS

ElasTest: an elastic platform for testing complex distributed large software systems

Fact Sheet

Reporting

Results

Objective

The demand for larger and more interconnected software systems is constantly increasing, but the ability of developers to satisfy it is not evolving accordingly. The most limiting factor is software validation, which typically requires very costly and complex testing processes. This project aims at significantly improving the efficiency and effectiveness of the testing process and, with it, the overall quality of large software systems. For this, we propose to apply the “divide-and-conquer” principle, which is commonly used for architecting complex software, to testing by developing a novel test orchestration theory and toolbox enabling the creation of complex test suites as the composition of simple testing units. This test orchestration mechanism is complemented with a number of tools that include: (1) Capabilities for the instrumentation of the Software under Test enabling to reproduce real-world operational conditions thanks to features such as Packet Loss as a Service, Network Latency as a Service, Failure as a Service, etc. (2) Reusable testing services solving common testing problems including Browser Automation as a Service, Sensor Emulator as a Service, Monitoring as a Service, Security Check as a Service, Log Ingestion and Analysis as a Service, Cost Modeling as a Service, etc. (3) Cognitive computing and machine learning mechanisms suitable for ingesting large amounts of knowledge (e.g. specifications, logs, software engineering documents, etc.) and capable of using it for generating testing recommendations and answering natural language questions about the testing process. The ElasTest platform thus created shall be released basing on a flexible Free Open Source Software and a community of users, stakeholders and contributors shall be grown around it with the objective of transforming ElasTest into a worldwide reference in the area of large software systems testing and of guaranteeing the long term sustainability of the project generated results.

Programme(s)

H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Topic(s)

ICT-10-2016 - Software Technologies

Call for proposal

H2020-ICT-2016-1

See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSIDAD REY JUAN CARLOS

Address

Calle Tulipan
28933 Mostoles

Spain

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 797 625

Website

Contact the organisation

Participants (10)

Sort alphabetically

Sort by EU Contribution

Expand all

FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

Germany

EU Contribution

€ 332 125

TECHNISCHE UNIVERSITAT BERLIN

Germany

EU Contribution

€ 795 250

TELECOM ITALIA SPA

Italy

CONSIGLIO NAZIONALE DELLE RICERCHE

Italy

EU Contribution

€ 411 875

FUNDACION IMDEA SOFTWARE

Spain

EU Contribution

€ 288 875

ATOS SPAIN SA

Spain

EU Contribution

€ 497 625

ZURCHER HOCHSCHULE FUR ANGEWANDTE WISSENSCHAFTEN

Switzerland

TIKAL TECHNOLOGIES SL

Spain

EU Contribution

€ 436 375

IBM IRELAND LIMITED

Ireland

EU Contribution

€ 440 687

PRODUCTION TRADE AND SUPPORT OF MACHINABLE PRODUCTS OF SOFTWARE AND INFORMATICS - RELATIONAL TECHNOLOGY AE

Greece

EU Contribution

€ 269 750

Project information

ELASTEST

Grant agreement ID: 731535

Project website

Status

Ongoing project

Start date

1 January 2017
End date

31 December 2019

Funded under:

H2020-EU.2.1.1.

Overall budget:

€ 5 031 187,50
EU contribution

€ 4 270 187

Coordinated by:

UNIVERSIDAD REY JUAN CARLOS

Spain

Periodic Reporting for period 1 - ELASTEST (ElasTest: an elastic platform for testing complex distributed large software systems)

Reporting period: 2017-01-01 to 2018-06-30

Summary of the context and overall objectives of the project

Large distributed software is promised to be fault-tolerant, elastic (it scales in and out) and cost-efficient, among other features. However, it is difficult to assess that distributed software complies with the quality demanded by users. For example, whenever developers want to validate non-functional features such as scalability, fault-tolerance or data consistency, they need to create complex testing architectures customizing the cloud orchestration mechanisms and to manage test scalability by themselves. Things become even more complex when trying to reproduce real-world operational conditions.

ElasTest proposes to apply the “divide-and-conquer” principle, which is commonly used for architecting complex software, to testing by developing a novel test orchestration theory and toolbox enabling the creation of complex test suites as the composition of simple testing units. This test orchestration mechanism is complemented with tools that include:

* Capabilities for collecting metrics (see Figure 1) and reproducing real-world operational conditions.
* Reusable testing services including Browsers, Emulation of Sensors and Actuators, Monitoring, Security Checks, Big Data Analysis, Cost Modeling, etc.
* Generating testing recommendations through cognitive computing and machine learning mechanisms.

All in all, ElasTest will make any software development team capable of delivering software faster, more confidently, more securely and with fewer defects.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

ElasTest provides tools for log analysis

ElasTest collects metrics and logs

ElasTest helps IT teams to increase user satisfaction and decrease software costs

Logs and metrics are collected from the system under test, the tests themselves and the services

Project information

ELASTEST

Grant agreement ID: 731535

Project website

Status

Ongoing project

Start date

1 January 2017
End date

31 December 2019

Funded under:

H2020-EU.2.1.1.

Overall budget:

€ 5 031 187,50
EU contribution

€ 4 270 187

Coordinated by:

UNIVERSIDAD REY JUAN CARLOS

Deliverables

Websites, patent fillings, videos etc. (2)

Project Website

Public Website of ElasTest which fresh information for promotion and dissemination

ElasTest Open Source Software Community v1

This deliverable contains the activities carried out in the context of the ElasTest community during one reporting period as well as the planning for such activities for the subsequent period

Documents, reports (4)

ElasTest requirements, use-cases and architecture v1

This document specifies the consolidated requirements and use-cases for ElasTest obtained after every reporting period as well as the architecture and analysis information describing how to implement ElasTest

ElasTest dissemination plan and activities v1

This deliverable contains a description of the communication, dissemination and standardization activities carried out in the context of ElasTest during a reporting period as well as the planning for the subsequent period

ElasTest validation methodology and its results v1

This deliverable contains the description of the ElasTest validation methodology as well as the results of the surveys, studies and quasi- experiments performed in WP7. This document shall be updated every reporting period updatong the methodology and with the metrics gathered through WP7 activities

SotA revision document v1

This deliverable contains the SotA revision conclusions obtained during the review period

Other (5)

ElasTest Continuous Integration and Validation System v1

This deliverable contains the artifacts and documentation for the ElasTest CI system and its validating tests. Given our agile methodology, several versions with increasing maturity degrees will be generated.

Test Orchestration basic toolbox v1

This deliverable accounts for a basic toolbox which includes all the software artifacts and documentation for the TORM, for the programmable engines and for the cost, energy and resource consumption engines. Given our agile methodology, several versions with increasing maturity degrees will be generated

ElasTest Test Support Services v1

This deliverable contains the software artifacts and documentation providing all the ElasTest Test Support Services. Given our methodology, several version with increasing maturity degrees will be generated.

ElasTest Platform cloud modules v1

Software artifacts and documentation of the Platform modules: Platform Manager, Services Manager, Instrumentation Agents, Instrumentation Manager and the tools for their installation and management. Given our agile methodology, several versions with increasing maturity degrees will be generated

ElasTest platform toolbox and integrations v1

This deliverable contains all the software artifacts of the ElasTest platform toolbox and the integrations enabling the seamless installation and administration of ElasTest stand-alone and integrated into a CI tool. Given our agile methodology, several version with increasing maturity degrees will be generated.

Open Research Data Pilot (1)

Publications

Peer reviewed articles (4)

An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testing

Author(s): Breno Miranda; Antonia Bertolino

Published in: Software Quality Journal, Issue 2, 2017, ISSN 0963-9314

DOI: 10.13039/100010661

Kurento: The Swiss Army Knife of WebRTC Media Servers

Author(s): Boni Garcia, Luis Lopez-Fernandez, Micael Gallego, Francisco Gortazar

Published in: IEEE Communications Standards Magazine, Issue 1/2, 2017, Page(s) 44-51, ISSN 2471-2825

DOI: 10.1109/MCOMSTD.2017.1700006

Costly Freeware: A Systematic Analysis of Abuse in Download Portals

Author(s): Richard Rivera, Platon Kotzias, Avinash Sudhodanan, Juan Caballero

Published in: IET Information Security, 2018, ISSN 1751-8709

DOI: 10.1049/iet-ifs.2017.0585

WebRTC Testing: Challenges and Practical Solutions

Author(s): Boni Garcia, Francisco Gortazar, Luis Lopez-Fernandez, Micael Gallego, Miguel Paris

Published in: IEEE Communications Standards Magazine, Issue 1/2, 2017, Page(s) 36-42, ISSN 2471-2825

DOI: 10.1109/MCOMSTD.2017.1700005

Other (1)

Blip: JIT and Footloose On The Edge

Author(s): Edmonds, Andy; Woods, Chris; Ferrer, Ana Juan; Ribera, Juan Francisco; Bohnert, Thomas Micheal

Published in: Issue 1, 2018

Conference proceedings (1)

FAST Approaches to Scalable Similarity-based Test Case Prioritization

Author(s): Breno Miranda; Emilio Cruciani; Roberto Verdecchia; Antonia Bertolino

Published in: Proceedings of 40th International Conference in Software Engineering, Issue 1, 2018

DOI: 10.5281/zenodo.1208195

Project information

ELASTEST

Grant agreement ID: 731535

Project website

Status

Ongoing project

Start date

1 January 2017
End date

31 December 2019

Funded under:

H2020-EU.2.1.1.

Overall budget:

€ 5 031 187,50
EU contribution

€ 4 270 187

Coordinated by:

UNIVERSIDAD REY JUAN CARLOS

Project information

ELASTEST

Grant agreement ID: 731535

Project website

Status

Ongoing project

Start date

1 January 2017
End date

31 December 2019

Funded under:

H2020-EU.2.1.1.

Overall budget:

€ 5 031 187,50
EU contribution

€ 4 270 187

Coordinated by:

UNIVERSIDAD REY JUAN CARLOS

Download

PDF

XML

Last update: 4 August 2017

Record number: 205931

CORDIS

Objective

Coordinator

Participants (10)

Project information

Periodic Reporting for period 1 - ELASTEST (ElasTest: an elastic platform for testing complex distributed large software systems)

Project information

Deliverables

Publications

Project information

Project information

Share this page

Download