Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Intelligence-Oriented Verification&Controller Synthesis

Project description

Trustworthy smart systems

From self-driving cars to robot medical devices, software is making increasingly life-or-death decisions. As systems grow more elaborate, however, machine learning introduces new challenges: black-box models that are powerful but hard to verify and explain. In this context, the ERC-funded InOVationCS project will combine verification breakthroughs with learning-based approaches. The goal is to deliver controllers that are scalable, dependable, correct by design, and transparent enough to be trusted. The result could be a milestone towards making intelligent, data-driven systems safe to apply in the real world.

Objective

Software making decisions or controlling cyber-physical systems is ubiquitous, hence its correctness is of paramount importance. While the increasing complexity makes manual implementation extremely error-prone, verification can provide formal guarantees on correctness. Verification of hardware and software has seen many successes and industrialization, making systems safe and reliable and their development more efficient. Controller synthesis goes one step further and avoids the manual implementation, providing a correct-by-construction controller directly. Despite considerable advances, scalable solutions remain elusive here.

Artificial intelligence and machine learning (AI/ML) provide scalable solutions to decision making, but at the cost of their reliability, making their verification even more pressing. Besides, the use of AI/ML gives rise to fundamentally new challeges since models, properties and controllers are now often based on data rather than design. Due to their “black-box” nature, the resulting systems are (i) even harder to verify, and (ii) not explainable enough to be responsibly deployed.

The PI has been pioneering the use of learning in verification to bring together the best of both worlds, scalability and reliability. The main objective of InOVation&CS is to utilize the power of learning in verification and controller-synthesis to overcome both the traditional scalability challenges as well as the recent, data-driven ones. The key to bringing the two closer than ever is a paradigm shift towards explainability and utilizing structure stemming from the presence of intelligence (human or artificial) in the definition, analysis and solution of real problems, thus providing more information to the learning parts. InOVation&CS shall provide new, more applicable and more scalable methodology for producing guaranteed reliable controllers.

Keywords: verification, model checking, Markov decision processes, stochastic games, temporal logics

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2024-COG

See all projects funded under this call

Host institution

Masarykova univerzita
Net EU contribution
€ 1 995 000,00
Address
Zerotinovo namesti 9
601 77 Brno
Czechia
Region
Česko Jihovýchod Jihomoravský kraj
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 1 995 000,00

Beneficiaries (1)