Software Testing AMPlification

Project Information

STAMP

Grant agreement ID: 731529

DOI

10.3030/731529

Project closed

EC signature date 26 October 2016

Start date 1 December 2016

End date 30 November 2019

Funded under

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Total cost

€ 4 307 070,00

EU contribution

€ 4 307 070,00

Coordinated by

KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (15)

Final report on configuration testing amplification
Final report for online-test amplification
Report on the state of practices for configuration testing
UC validation report final
Industrial requirements and metrics V2
Survey on logging practices and tools
Report on the state of practice for unit testing and test assessment
Initial prototype on configuration test amplification
Validation Roadmap and framework V2
Exploitation Plan
Communication Material
Business Plan
Market Analysis
Dissemination and Communication Plan
Final report about the amplification process for unit test suites

Other (4)

Second public version of the API and implementation of services and courseware
STAMP Collaborative Software Engineering Platform
Final public version of the API and implementation of services and courseware
First public version of the API and initial implementation of services and courseware

Demonstrators, pilots, prototypes (8)

Crash replication benchmark

Crash replication benchmark tool

Enhanced prototype of the unit test amplification tool and report on the performance
Enhanced prototype of the configuration amplification and report on the performance
Initial prototype of the unit test amplification tool
Prototype of amplification tool for common and anomaly behaviors
Consolidated tool for the configuration amplification, selection and execution
Consolidated services for online-test amplification
Consolidated tool for the unit test amplification, selection and execution

Publications

Conference proceedings (20)

Oops, My Tests Broke the Build: An Explorative Analysis of Travis CI with GitHub

Author(s): Moritz Beller, Georgios Gousios, Andy Zaidman
Published in: 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR), 2017, Page(s) 356-367, ISBN 978-1-5386-1544-7
Publisher: IEEE
DOI: 10.1109/msr.2017.62

An Investigation of Compression Techniques to Speed up Mutation Testing

Author(s): Qianqian Zhu, Annibale Panichella, Andy Zaidman
Published in: 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), 2018, Page(s) 274-284, ISBN 978-1-5386-5012-7
Publisher: IEEE
DOI: 10.1109/icst.2018.00035

Does Refactoring of Test Smells Induce Fixing Flaky Tests?

Author(s): Fabio Palomba, Andy Zaidman
Published in: 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2017, Page(s) 1-12, ISBN 978-1-5386-0992-7
Publisher: IEEE
DOI: 10.1109/icsme.2017.12

TECOR: Automate the Testing of One Product on Many Configurations

Author(s): Anatoly Vasilevskiy, Hui Song, Brice Morin
Published in: ICST 2018, 2018
Publisher: IEEE

TravisTorrent: Synthesizing Travis CI and GitHub for Full-Stack Research on Continuous Integration

Author(s): Moritz Beller, Georgios Gousios, Andy Zaidman
Published in: 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR), 2017, Page(s) 447-450, ISBN 978-1-5386-1544-7
Publisher: IEEE
DOI: 10.1109/msr.2017.24

Deep customization of multi-tenant SaaS using intrusive microservices

Author(s): Hui Song, Franck Chauvel, Arnor Solberg
Published in: Proceedings of the 40th International Conference on Software Engineering New Ideas and Emerging Results - ICSE-NIER '18, 2018, Page(s) 97-100, ISBN 9781-450356626
Publisher: ACM Press
DOI: 10.1145/3183399.3183407

Detection and analysis of behavioral T-patterns in debugging activities

Author(s): César Soto-Valero, Johann Bourcier, Benoit Baudry
Published in: Proceedings of the 15th International Conference on Mining Software Repositories - MSR '18, 2018, Page(s) 110-113, ISBN 9781-450357166
Publisher: ACM Press
DOI: 10.1145/3196398.3196452

AbsCon: A Test Concretizer for Model-Based Testing

Author(s): Jeremy Vanhecke, Xavier Devroey, Gilles Perrouin
Published in: 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2019, Page(s) 15-22, ISBN 978-1-7281-0888-9
Publisher: IEEE
DOI: 10.1109/icstw.2019.00027

The Maven Dependency Graph: A Temporal Graph-Based Representation of Maven Central

Author(s): Amine Benelallam, Nicolas Harrand, Cesar Soto-Valero, Benoit Baudry, Olivier Barais
Published in: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), 2019, Page(s) 344-348, ISBN 978-1-7281-3412-3
Publisher: IEEE
DOI: 10.1109/MSR.2019.00060

The Emergence of Software Diversity in Maven Central

Author(s): Cesar Soto-Valero, Amine Benelallam, Nicolas Harrand, Olivier Barais, Benoit Baudry
Published in: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), 2019, Page(s) 333-343, ISBN 978-1-7281-3412-3
Publisher: IEEE
DOI: 10.1109/MSR.2019.00059

Search-based test data generation for SQL queries

Author(s): Jeroen Castelein, Maurício Aniche, Mozhan Soltani, Annibale Panichella, Arie van Deursen
Published in: Proceedings of the 40th International Conference on Software Engineering - ICSE '18, 2018, Page(s) 1220-1230, ISBN 9781-450356381
Publisher: ACM Press
DOI: 10.1145/3180155.3180202

Uniform Sampling of SAT Solutions for Configurable Systems: Are We There Yet?

Author(s): Quentin Plazar, Mathieu Acher, Gilles Perrouin, Xavier Devroey, Maxime Cordy
Published in: 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST), 2019, Page(s) 240-251, ISBN 978-1-7281-1736-2
Publisher: IEEE
DOI: 10.1109/ICST.2019.00032

A spoonful of DevOps helps the GI go down

Author(s): Benoit Baudry, Nicolas Harrand, Eric Schulte, Chris Timperley, Shin Hwei Tan, Marija Selakovic, Emamurho Ugherughe
Published in: Proceedings of the 4th International Workshop on Genetic Improvement Workshop - GI '18, 2018, Page(s) 35-36, ISBN 9781-450357531
Publisher: ACM Press
DOI: 10.1145/3194810.3194818

Exhaustive Exploration of the Failure-Oblivious Computing Search Space

Author(s): Thomas Durieux, Youssef Hamadi, Zhongxing Yu, Benoit Baudry, Martin Monperrus
Published in: 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), 2018, Page(s) 139-149, ISBN 978-1-5386-5012-7
Publisher: IEEE
DOI: 10.1109/icst.2018.00023

A Tale of CI Build Failures: An Open Source and a Financial Organization Perspective

Author(s): Vassallo, Carmine; Schermann, Gerald; Zampetti, Fiorella; Romano, Daniele; Leitner, Philipp; Zaidman, Andy; Penta, Massimiliano Di; Panichella, Sebastiano
Published in: Proceedings - 2017 IEEE International Conference on Software Maintenance and Evolution, ICSME 2017, Issue 1, 2017
Publisher: IEEE
DOI: 10.5167/uzh-146809

Amplifying Integration Tests with CAMP

Author(s): Franck Chauvel, Brice Morin, Enrique Garcia-Ceja
Published in: 2019
Publisher: ISSRE 2019

Effective and efficient API misuse detection via exception propagation and search-based testing

Author(s): Maria Kechagia, Xavier Devroey, Annibale Panichella, Georgios Gousios, Arie van Deursen
Published in: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2019, 2019, Page(s) 192-203, ISBN 9781-450362245
Publisher: ACM Press
DOI: 10.1145/3293882.3330552

A Guided Genetic Algorithm for Automated Crash Reproduction

Author(s): Mozhan Soltani, Annibale Panichella, Arie van Deursen
Published in: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), 2017, Page(s) 209-220, ISBN 978-1-5386-3868-2
Publisher: IEEE
DOI: 10.1109/icse.2017.27

Descartes: a PITest engine to detect pseudo-tested methods: tool demonstration

Author(s): Oscar Luis Vera-Pérez, Martin Monperrus, Benoit Baudry
Published in: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering - ASE 2018, 2018, Page(s) 908-911, ISBN 9781-450359375
Publisher: ACM Press
DOI: 10.1145/3238147.3240474

A Test-Suite Diagnosability Metric for Spectrum-Based Fault Localization Approaches

Author(s): Alexandre Perez, Rui Abreu, Arie van Deursen
Published in: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), 2017, Page(s) 654-664, ISBN 978-1-5386-3868-2
Publisher: IEEE
DOI: 10.1109/icse.2017.66

Peer reviewed articles (11)

Test them all, is it worth it? Assessing configuration sampling on the JHipster Web development stack

Author(s): Axel Halin, Alexandre Nuttinck, Mathieu Acher, Xavier Devroey, Gilles Perrouin, Benoit Baudry
Published in: Empirical Software Engineering, 2018, ISSN 1382-3256
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10664-018-9635-4

A systematic literature review of how mutation testing supports quality assurance processes

Author(s): Qianqian Zhu, Annibale Panichella, Andy Zaidman
Published in: Software Testing, Verification and Reliability, 2018, Page(s) e1675, ISSN 0960-0833
Publisher: John Wiley & Sons Inc.
DOI: 10.1002/stvr.1675

Correctness attraction: a study of stability of software behavior under runtime perturbation

Author(s): Benjamin Danglot, Philippe Preux, Benoit Baudry, Martin Monperrus
Published in: Empirical Software Engineering, Issue 23/4, 2018, Page(s) 2086-2119, ISSN 1382-3256
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10664-017-9571-8

Model-based mutant equivalence detection using automata language equivalence and simulations

Author(s): Xavier Devroey, Gilles Perrouin, Mike Papadakis, Axel Legay, Pierre-Yves Schobbens, Patrick Heymans
Published in: Journal of Systems and Software, Issue 141, 2018, Page(s) 1-15, ISSN 0164-1212
Publisher: Elsevier BV
DOI: 10.1016/j.jss.2018.03.010

Developer Testing in The IDE: Patterns, Beliefs, And Behavior?

Author(s): Moritz Beller, Georgios Gousios, Annibale Panichella, Sebastian Proksch, Sven Amann, Andy Zaidman
Published in: IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2017, ISSN 0098-5589
Publisher: Institute of Electrical and Electronics Engineers

A benchmark-based evaluation of search-based crash reproduction

Author(s): Mozhan Soltani, Pouria Derakhshanfar, Xavier Devroey, Arie van Deursen
Published in: Empirical Software Engineering, Issue 25/1, 2020, Page(s) 96-138, ISSN 1382-3256
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10664-019-09762-1

A snowballing literature study on test amplification

Author(s): Benjamin Danglot, Oscar Vera-Perez, Zhongxing Yu, Andy Zaidman, Martin Monperrus, Benoit Baudry
Published in: Journal of Systems and Software, Issue 157, 2019, Page(s) 110398, ISSN 0164-1212
Publisher: Elsevier BV
DOI: 10.1016/j.jss.2019.110398

CAMP: A tool to amplify software configuration tests

Author(s): Franck Chauvel, Brice Morin, Enrique Garcia-Ceja
Published in: Software Impacts, 2019, Page(s) 100013, ISSN 2665-9638
Publisher: Elsevier
DOI: 10.1016/j.simpa.2019.100013

Automatic test improvement with DSpot: a study with ten mature open-source projects

Author(s): Benjamin Danglot, Oscar Luis Vera-Pérez, Benoit Baudry, Martin Monperrus
Published in: Empirical Software Engineering, Issue 24/4, 2019, Page(s) 2603-2635, ISSN 1382-3256
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10664-019-09692-y

A journey among Java neutral program variants

Author(s): Nicolas Harrand, Simon Allier, Marcelino Rodriguez-Cancio, Martin Monperrus, Benoit Baudry
Published in: Genetic Programming and Evolvable Machines, Issue 20/4, 2019, Page(s) 531-580, ISSN 1389-2576
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10710-019-09355-3

A comprehensive study of pseudo-tested methods

Author(s): Oscar Luis Vera-Pérez, Benjamin Danglot, Martin Monperrus, Benoit Baudry
Published in: Empirical Software Engineering, Issue 24/3, 2019, Page(s) 1195-1225, ISSN 1382-3256
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s10664-018-9653-2

Book chapters (1)

Single-objective Versus Multi-objectivized Optimization for Evolutionary Crash Reproduction

Author(s): Mozhan Soltani, Pouria Derakhshanfar, Annibale Panichella, Xavier Devroey, Andy Zaidman, Arie van Deursen
Published in: Search-Based Software Engineering - 10th International Symposium, SSBSE 2018, Montpellier, France, September 8-9, 2018, Proceedings, Issue 11036, 2018, Page(s) 325-340, ISBN 978-3-319-99240-2
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-99241-9_18

Thesis and dissertations (2)

Dynamic program analysis for suggesting test improvements to developers

Author(s): Oscar Luis Vera Pérez
Published in: 2019
Publisher: INRIA

Automatic Unit Test Amplification for DevOps

Author(s): Benjamin Danglot
Published in: 2019
Publisher: INRIA

Other (3)

An Approach and Benchmark to Detect Behavioral Changes of Commits in Continuous Integration

Author(s): Benjamin Danglot, Martin Monperrus, WalterRudametkin, Benoit Baudry
Published in: Empirical Software Engineering, Springer Verlag 2020, 2019
Publisher: Springer US

How Bugs Are Born: A Model to Identify How Bugs Are Introduced in Software Components

Author(s): Gema Rodríguez-Pérez, Gregorio Robles, Alexander Serebrenik, Andy Zaidman, Daniel M. Germán, Jesus M. Gonzalez-Barahona
Published in: Empirical Software Engineering, Springer Verlag 2020, 2019
Publisher: Springer US

Automatic Quality Assurance and Release

Author(s): Bram Adams, Benoit Baudry, Sigrid Eldh, Andy Zaidman
Published in: 2018
Publisher: Dagstuhl seminar