Software Testing AMPlification

Informations projet

STAMP

N° de convention de subvention: 731529

DOI

10.3030/731529

Projet clôturé

Date de signature de la CE 26 Octobre 2016

Date de début 1 Decembre 2016

Date de fin 30 Novembre 2019

Financé au titre de

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coût total

€ 4 307 070,00

Contribution de l’UE

€ 4 307 070,00

Coordonné par

KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (15)

Final report on configuration testing amplification
Final report for online-test amplification
Report on the state of practices for configuration testing
UC validation report final
Industrial requirements and metrics V2
Survey on logging practices and tools
Report on the state of practice for unit testing and test assessment
Initial prototype on configuration test amplification
Validation Roadmap and framework V2
Exploitation Plan
Communication Material
Business Plan
Market Analysis
Dissemination and Communication Plan
Final report about the amplification process for unit test suites

Other (4)

Second public version of the API and implementation of services and courseware
STAMP Collaborative Software Engineering Platform
Final public version of the API and implementation of services and courseware
First public version of the API and initial implementation of services and courseware

Demonstrators, pilots, prototypes (8)

Crash replication benchmark

Crash replication benchmark tool

Enhanced prototype of the unit test amplification tool and report on the performance
Enhanced prototype of the configuration amplification and report on the performance
Initial prototype of the unit test amplification tool
Prototype of amplification tool for common and anomaly behaviors
Consolidated tool for the configuration amplification, selection and execution
Consolidated services for online-test amplification
Consolidated tool for the unit test amplification, selection and execution

Publications

Conference proceedings (20)

Oops, My Tests Broke the Build: An Explorative Analysis of Travis CI with GitHub

Auteurs: Moritz Beller, Georgios Gousios, Andy Zaidman
Publié dans: 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR), 2017, Page(s) 356-367, ISBN 978-1-5386-1544-7
Éditeur: IEEE
DOI: 10.1109/msr.2017.62

An Investigation of Compression Techniques to Speed up Mutation Testing

Auteurs: Qianqian Zhu, Annibale Panichella, Andy Zaidman
Publié dans: 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), 2018, Page(s) 274-284, ISBN 978-1-5386-5012-7
Éditeur: IEEE
DOI: 10.1109/icst.2018.00035

Does Refactoring of Test Smells Induce Fixing Flaky Tests?

Auteurs: Fabio Palomba, Andy Zaidman
Publié dans: 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2017, Page(s) 1-12, ISBN 978-1-5386-0992-7
Éditeur: IEEE
DOI: 10.1109/icsme.2017.12

TECOR: Automate the Testing of One Product on Many Configurations

Auteurs: Anatoly Vasilevskiy, Hui Song, Brice Morin
Publié dans: ICST 2018, 2018
Éditeur: IEEE

TravisTorrent: Synthesizing Travis CI and GitHub for Full-Stack Research on Continuous Integration

Auteurs: Moritz Beller, Georgios Gousios, Andy Zaidman
Publié dans: 2017 IEEE/ACM 14th International Conference on Mining Software Repositories (MSR), 2017, Page(s) 447-450, ISBN 978-1-5386-1544-7
Éditeur: IEEE
DOI: 10.1109/msr.2017.24

Deep customization of multi-tenant SaaS using intrusive microservices

Auteurs: Hui Song, Franck Chauvel, Arnor Solberg
Publié dans: Proceedings of the 40th International Conference on Software Engineering New Ideas and Emerging Results - ICSE-NIER '18, 2018, Page(s) 97-100, ISBN 9781-450356626
Éditeur: ACM Press
DOI: 10.1145/3183399.3183407

Detection and analysis of behavioral T-patterns in debugging activities

Auteurs: César Soto-Valero, Johann Bourcier, Benoit Baudry
Publié dans: Proceedings of the 15th International Conference on Mining Software Repositories - MSR '18, 2018, Page(s) 110-113, ISBN 9781-450357166
Éditeur: ACM Press
DOI: 10.1145/3196398.3196452

AbsCon: A Test Concretizer for Model-Based Testing

Auteurs: Jeremy Vanhecke, Xavier Devroey, Gilles Perrouin
Publié dans: 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2019, Page(s) 15-22, ISBN 978-1-7281-0888-9
Éditeur: IEEE
DOI: 10.1109/icstw.2019.00027

The Maven Dependency Graph: A Temporal Graph-Based Representation of Maven Central

Auteurs: Amine Benelallam, Nicolas Harrand, Cesar Soto-Valero, Benoit Baudry, Olivier Barais
Publié dans: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), 2019, Page(s) 344-348, ISBN 978-1-7281-3412-3
Éditeur: IEEE
DOI: 10.1109/MSR.2019.00060

The Emergence of Software Diversity in Maven Central

Auteurs: Cesar Soto-Valero, Amine Benelallam, Nicolas Harrand, Olivier Barais, Benoit Baudry
Publié dans: 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR), 2019, Page(s) 333-343, ISBN 978-1-7281-3412-3
Éditeur: IEEE
DOI: 10.1109/MSR.2019.00059

Search-based test data generation for SQL queries

Auteurs: Jeroen Castelein, Maurício Aniche, Mozhan Soltani, Annibale Panichella, Arie van Deursen
Publié dans: Proceedings of the 40th International Conference on Software Engineering - ICSE '18, 2018, Page(s) 1220-1230, ISBN 9781-450356381
Éditeur: ACM Press
DOI: 10.1145/3180155.3180202

Uniform Sampling of SAT Solutions for Configurable Systems: Are We There Yet?

Auteurs: Quentin Plazar, Mathieu Acher, Gilles Perrouin, Xavier Devroey, Maxime Cordy
Publié dans: 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST), 2019, Page(s) 240-251, ISBN 978-1-7281-1736-2
Éditeur: IEEE
DOI: 10.1109/ICST.2019.00032

A spoonful of DevOps helps the GI go down

Auteurs: Benoit Baudry, Nicolas Harrand, Eric Schulte, Chris Timperley, Shin Hwei Tan, Marija Selakovic, Emamurho Ugherughe
Publié dans: Proceedings of the 4th International Workshop on Genetic Improvement Workshop - GI '18, 2018, Page(s) 35-36, ISBN 9781-450357531
Éditeur: ACM Press
DOI: 10.1145/3194810.3194818

Exhaustive Exploration of the Failure-Oblivious Computing Search Space

Auteurs: Thomas Durieux, Youssef Hamadi, Zhongxing Yu, Benoit Baudry, Martin Monperrus
Publié dans: 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST), 2018, Page(s) 139-149, ISBN 978-1-5386-5012-7
Éditeur: IEEE
DOI: 10.1109/icst.2018.00023

A Tale of CI Build Failures: An Open Source and a Financial Organization Perspective

Auteurs: Vassallo, Carmine; Schermann, Gerald; Zampetti, Fiorella; Romano, Daniele; Leitner, Philipp; Zaidman, Andy; Penta, Massimiliano Di; Panichella, Sebastiano
Publié dans: Proceedings - 2017 IEEE International Conference on Software Maintenance and Evolution, ICSME 2017, Numéro 1, 2017
Éditeur: IEEE
DOI: 10.5167/uzh-146809

Amplifying Integration Tests with CAMP

Auteurs: Franck Chauvel, Brice Morin, Enrique Garcia-Ceja
Publié dans: 2019
Éditeur: ISSRE 2019

Effective and efficient API misuse detection via exception propagation and search-based testing

Auteurs: Maria Kechagia, Xavier Devroey, Annibale Panichella, Georgios Gousios, Arie van Deursen
Publié dans: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis - ISSTA 2019, 2019, Page(s) 192-203, ISBN 9781-450362245
Éditeur: ACM Press
DOI: 10.1145/3293882.3330552

A Guided Genetic Algorithm for Automated Crash Reproduction

Auteurs: Mozhan Soltani, Annibale Panichella, Arie van Deursen
Publié dans: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), 2017, Page(s) 209-220, ISBN 978-1-5386-3868-2
Éditeur: IEEE
DOI: 10.1109/icse.2017.27

Descartes: a PITest engine to detect pseudo-tested methods: tool demonstration

Auteurs: Oscar Luis Vera-Pérez, Martin Monperrus, Benoit Baudry
Publié dans: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering - ASE 2018, 2018, Page(s) 908-911, ISBN 9781-450359375
Éditeur: ACM Press
DOI: 10.1145/3238147.3240474

A Test-Suite Diagnosability Metric for Spectrum-Based Fault Localization Approaches

Auteurs: Alexandre Perez, Rui Abreu, Arie van Deursen
Publié dans: 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE), 2017, Page(s) 654-664, ISBN 978-1-5386-3868-2
Éditeur: IEEE
DOI: 10.1109/icse.2017.66

Peer reviewed articles (11)

Test them all, is it worth it? Assessing configuration sampling on the JHipster Web development stack

Auteurs: Axel Halin, Alexandre Nuttinck, Mathieu Acher, Xavier Devroey, Gilles Perrouin, Benoit Baudry
Publié dans: Empirical Software Engineering, 2018, ISSN 1382-3256
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10664-018-9635-4

A systematic literature review of how mutation testing supports quality assurance processes

Auteurs: Qianqian Zhu, Annibale Panichella, Andy Zaidman
Publié dans: Software Testing, Verification and Reliability, 2018, Page(s) e1675, ISSN 0960-0833
Éditeur: John Wiley & Sons Inc.
DOI: 10.1002/stvr.1675

Correctness attraction: a study of stability of software behavior under runtime perturbation

Auteurs: Benjamin Danglot, Philippe Preux, Benoit Baudry, Martin Monperrus
Publié dans: Empirical Software Engineering, Numéro 23/4, 2018, Page(s) 2086-2119, ISSN 1382-3256
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10664-017-9571-8

Model-based mutant equivalence detection using automata language equivalence and simulations

Auteurs: Xavier Devroey, Gilles Perrouin, Mike Papadakis, Axel Legay, Pierre-Yves Schobbens, Patrick Heymans
Publié dans: Journal of Systems and Software, Numéro 141, 2018, Page(s) 1-15, ISSN 0164-1212
Éditeur: Elsevier BV
DOI: 10.1016/j.jss.2018.03.010

Developer Testing in The IDE: Patterns, Beliefs, And Behavior?

Auteurs: Moritz Beller, Georgios Gousios, Annibale Panichella, Sebastian Proksch, Sven Amann, Andy Zaidman
Publié dans: IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2017, ISSN 0098-5589
Éditeur: Institute of Electrical and Electronics Engineers

A benchmark-based evaluation of search-based crash reproduction

Auteurs: Mozhan Soltani, Pouria Derakhshanfar, Xavier Devroey, Arie van Deursen
Publié dans: Empirical Software Engineering, Numéro 25/1, 2020, Page(s) 96-138, ISSN 1382-3256
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10664-019-09762-1

A snowballing literature study on test amplification

Auteurs: Benjamin Danglot, Oscar Vera-Perez, Zhongxing Yu, Andy Zaidman, Martin Monperrus, Benoit Baudry
Publié dans: Journal of Systems and Software, Numéro 157, 2019, Page(s) 110398, ISSN 0164-1212
Éditeur: Elsevier BV
DOI: 10.1016/j.jss.2019.110398

CAMP: A tool to amplify software configuration tests

Auteurs: Franck Chauvel, Brice Morin, Enrique Garcia-Ceja
Publié dans: Software Impacts, 2019, Page(s) 100013, ISSN 2665-9638
Éditeur: Elsevier
DOI: 10.1016/j.simpa.2019.100013

Automatic test improvement with DSpot: a study with ten mature open-source projects

Auteurs: Benjamin Danglot, Oscar Luis Vera-Pérez, Benoit Baudry, Martin Monperrus
Publié dans: Empirical Software Engineering, Numéro 24/4, 2019, Page(s) 2603-2635, ISSN 1382-3256
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10664-019-09692-y

A journey among Java neutral program variants

Auteurs: Nicolas Harrand, Simon Allier, Marcelino Rodriguez-Cancio, Martin Monperrus, Benoit Baudry
Publié dans: Genetic Programming and Evolvable Machines, Numéro 20/4, 2019, Page(s) 531-580, ISSN 1389-2576
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10710-019-09355-3

A comprehensive study of pseudo-tested methods

Auteurs: Oscar Luis Vera-Pérez, Benjamin Danglot, Martin Monperrus, Benoit Baudry
Publié dans: Empirical Software Engineering, Numéro 24/3, 2019, Page(s) 1195-1225, ISSN 1382-3256
Éditeur: Kluwer Academic Publishers
DOI: 10.1007/s10664-018-9653-2

Book chapters (1)

Single-objective Versus Multi-objectivized Optimization for Evolutionary Crash Reproduction

Auteurs: Mozhan Soltani, Pouria Derakhshanfar, Annibale Panichella, Xavier Devroey, Andy Zaidman, Arie van Deursen
Publié dans: Search-Based Software Engineering - 10th International Symposium, SSBSE 2018, Montpellier, France, September 8-9, 2018, Proceedings, Numéro 11036, 2018, Page(s) 325-340, ISBN 978-3-319-99240-2
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-99241-9_18

Thesis and dissertations (2)

Dynamic program analysis for suggesting test improvements to developers

Auteurs: Oscar Luis Vera Pérez
Publié dans: 2019
Éditeur: INRIA

Automatic Unit Test Amplification for DevOps

Auteurs: Benjamin Danglot
Publié dans: 2019
Éditeur: INRIA

Other (3)

An Approach and Benchmark to Detect Behavioral Changes of Commits in Continuous Integration

Auteurs: Benjamin Danglot, Martin Monperrus, WalterRudametkin, Benoit Baudry
Publié dans: Empirical Software Engineering, Springer Verlag 2020, 2019
Éditeur: Springer US

How Bugs Are Born: A Model to Identify How Bugs Are Introduced in Software Components

Auteurs: Gema Rodríguez-Pérez, Gregorio Robles, Alexander Serebrenik, Andy Zaidman, Daniel M. Germán, Jesus M. Gonzalez-Barahona
Publié dans: Empirical Software Engineering, Springer Verlag 2020, 2019
Éditeur: Springer US

Automatic Quality Assurance and Release

Auteurs: Bram Adams, Benoit Baudry, Sigrid Eldh, Andy Zaidman
Publié dans: 2018
Éditeur: Dagstuhl seminar