Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Testing Program Analyzers Ad Absurdum

Project description

Time to check the software checkers

Modern aeroplanes, medical devices and power grids rely on advanced software to function safely. Engineers use programme analysers to scan code for errors and verify its correctness before software goes live. But if an analyser makes a mistake, the results can be dangerous. The ERC-funded MirandaTesting project tests the analysers themselves. Specifically, it will create a framework to investigate how analysers reach their conclusions. It will then challenge them with carefully constructed queries designed to expose hidden flaws and contradictions in their reasoning. This method can reveal critical bugs that other testing approaches may miss. This could improve the reliability of software analysis tools and help prevent failures in some of the systems we use every day.

Objective

Program analyzers act as guards for ensuring reliability of modern-day
software. But who guards the guards themselves? Due to their high
complexity and sophisticated algorithms, analyzers are likely to
contain critical bugs, which we define as those leading to wrong
results, e.g. returning `correct' for incorrect software. Such bugs
may have detrimental consequences, especially in safety-critical
settings. It is, therefore, imperative to be able to detect them.

Verifying the absence of critical bugs in a program analyzer is
prohibitively expensive. Contrary to verification, automated test
generation can be used to effectively find such bugs. Existing testing
approaches, however, are still in their infancy for this application
domain.

To address this issue, MirandaTesting will develop the first
principled methodology for testing a wide range of program
analyzers. At its core, our methodology exposes more information about
why an analyzer computes a particular result; it then uses this
information to interrogate the analyzer aiming to force it into a
contradiction, thus revealing a critical bug. The project has the
following goals:

1. Design a general framework for testing program analyzers using the
MirandaTesting methodology;

2. Develop interrogation strategies pertaining to eleven prevalent
classes of program analyzers;

3. Demonstrate the effectiveness of concrete instantiations of the
general framework and interrogation strategies for several popular
program analyzers from each class;

4. Focus on disseminating our methodology and infrastructure.

If successful, MirandaTesting will enable systematic testing of entire
program-analyzer classes. As a result, analyzers will exhibit fewer
critical bugs, potentially preventing catastrophic outcomes in
safety-critical domains.

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2022-STG

See all projects funded under this call

Host institution

TECHNISCHE UNIVERSITAET WIEN
Net EU contribution
€ 1 499 991,00
Address
KARLSPLATZ 13
1040 Wien
Austria
Region
Ostösterreich Wien Wien
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 499 991,00

Beneficiaries (1)