Formal Reasoning About Probabilistic Programs: Breaking New Ground for Automation

Project Information

FRAPPANT

Grant agreement ID: 787914

DOI 10.3030/787914

Project closed

EC signature date 3 May 2018

Start date 1 November 2018

End date 31 October 2024

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost € 2 491 250,00

EU contribution € 2 491 250,00

Coordinated by

RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN
Germany

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Book chapters (12)

Weakest Preexpectation Semantics for Bayesian Inference

Author(s): Szymczak, Marcin; Katoen, Joost-Pieter
Published in: Tutorial Lectures 5th International School on Engineering Trustworthy Software Systems, Issue 12154, 2019, Page(s) 44--121
Publisher: Springer
DOI: 10.1007/978-3-030-55089-9_3

Symbolic Quantitative Information Flow for Probabilistic Programs

Author(s): Philipp Schröer, Francesca Randone, Raúl Pardo, Andrzej Wa̧sowski
Published in: Lecture Notes in Computer Science, Principles of Verification: Cycling the Probabilistic Landscape, Issue 15260, 2024, Page(s) 128-154
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-75783-9_6

Parameter Synthesis in Markov Models: A Gentle Survey

Author(s): Nils Jansen, Sebastian Junges, Joost-Pieter Katoen
Published in: Lecture Notes in Computer Science, Principles of Systems Design, Issue 13660, 2024, Page(s) 407-437
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-22337-2_20

J-P: MDP. FP. PP

Author(s): Kevin Batz, Benjamin Lucien Kaminski, Christoph Matheja, Tobias Winkler
Published in: Lecture Notes in Computer Science, Principles of Verification: Cycling the Probabilistic Landscape, Issue 15260, 2024, Page(s) 255-302
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-75783-9_11

Search and Explore: Symbiotic Policy Synthesis in POMDPs

Author(s): Roman Andriushchenko, Alexander Bork, Milan Češka, Sebastian Junges, Joost-Pieter Katoen, Filip Macák
Published in: Lecture Notes in Computer Science, Computer Aided Verification, 2024, Page(s) 113-135, ISSN 2331-8422
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-37709-9_6

Certificates for Probabilistic Pushdown Automata via Optimistic Value Iteration

Author(s): Tobias Winkler, Joost-Pieter Katoen
Published in: Lecture Notes in Computer Science, Tools and Algorithms for the Construction and Analysis of Systems, Issue 13994, 2024, Page(s) 391-409
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-30820-8_24

Unbounded-Time Safety Verification of Stochastic Differential Dynamics

Author(s): Feng, Shenghua; Chen, Mingshuai; Xue, Bai; Sankaranarayanan, Sriram; Zhan, Naijun
Published in: Computer Aided Verification : 32nd International Conference, CAV 2020, Issue 12225, 2020, Page(s) 327--348
Publisher: Springer
DOI: 10.18154/rwth-2020-07595

Model Checking Temporal Properties of Recursive Probabilistic Programs

Author(s): Tobias Winkler, Christina Gehnen, Joost-Pieter Katoen
Published in: Lecture Notes in Computer Science, Foundations of Software Science and Computation Structures, Issue 13242, 2022, Page(s) 449-469
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-99253-8_23

Counterexample-Driven Synthesis for Probabilistic Program Sketches

Author(s): Milan Češka, Christian Hensel, Sebastian Junges, Joost-Pieter Katoen
Published in: Formal Methods – The Next 30 Years - Third World Congress, FM 2019, Porto, Portugal, October 7–11, 2019, Proceedings, Issue 11800, 2019, Page(s) 101-120, ISBN 978-3-030-30941-1
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-30942-8_8

Model Repair Revamped - — On the Automated Synthesis of Markov Chains —

Author(s): Milan Češka, Christian Dehnert, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen
Published in: From Reactive Systems to Cyber-Physical Systems - Essays Dedicated to Scott A. Smolka on the Occasion of His 65th Birthday, Issue 11500, 2019, Page(s) 107-125, ISBN 978-3-030-31513-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-31514-6_7

Learning One-Clock Timed Automata

Author(s): Jie An, Mingshuai Chen, Bohua Zhan, Naijun Zhan, Miaomiao Zhang
Published in: Tools and Algorithms for the Construction and Analysis of Systems - 26th International Conference, TACAS 2020, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2020, Dublin, Ireland, April 25–30, 2020, Proceedings, Part I, Issue 12078, 2020, Page(s) 444-462, ISBN 978-3-030-45189-9
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-45190-5_25

Gradient-Descent for Randomized Controllers Under Partial Observability

Author(s): Linus Heck, Jip Spel, Sebastian Junges, Joshua Moerman, Joost-Pieter Katoen
Published in: Lecture Notes in Computer Science, Verification, Model Checking, and Abstract Interpretation, Issue 13182, 2023, Page(s) 127-150
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-94583-1_7

Peer reviewed articles (20)

Lower Bounds for Possibly Divergent Probabilistic Programs

Author(s): Shenghua Feng, Mingshuai Chen, Han Su, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Naijun Zhan
Published in: Proceedings of the ACM on Programming Languages, Issue 7, 2023, Page(s) 696-726, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3586051

Encoding inductive invariants as barrier certificates: Synthesis via difference-of-convex programming

Author(s): Qiuye Wang; Mingshuai Chen; Bai Xue; Naijun Zhan; Joost-Pieter Katoen
Published in: Information and Computation, Issue 289, 2022, Page(s) 104965, ISSN 0890-5401
Publisher: Academic Press
DOI: 10.1016/j.ic.2022.104965

The probabilistic model checker Storm

Author(s): Christian Hensel, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann, Matthias Volk
Published in: International Journal on Software Tools for Technology Transfer, Issue 24, 2022, Page(s) 589-610, ISSN 1433-2779
Publisher: Springer Verlag
DOI: 10.1007/s10009-021-00633-z

Weighted programming : a programming paradigm for specifying mathematical models

Author(s): Kevin Batz; Adrian Gallus; Benjamin Lucien Kaminski; Joost-Pieter Katoen; Tobias Winkler
Published in: Proceedings of the ACM on Programming Languages, Issue 2 (OOPSLA), 2022, Page(s) 1-30, ISSN 2475-1421
Publisher: ACM
DOI: 10.18154/rwth-2022-04445

A Calculus for Amortized Expected Runtimes

Author(s): Joost-Pieter Katoen; Christoph Matheja; Benjamin Lucien Kaminski; Kevin Batz; Lena Verscht
Published in: ACM Proceedings on Programming Languages, Issue 7 (POPL), 2023, Page(s) 1957-1986, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3571260

Scenario-based verification of uncertain parametric MDPs

Author(s): Thom Badings, Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ufuk Topcu
Published in: International Journal on Software Tools for Technology Transfer, Issue 24, 2022, Page(s) 803-819, ISSN 1433-2779
Publisher: Springer Verlag
DOI: 10.1007/s10009-022-00673-z

Automatically Finding the Right Probabilities in Bayesian Networks

Author(s): Bahare Salmani, Joost-Pieter Katoen
Published in: Journal of Artificial Intelligence Research, Issue 77, 2023, Page(s) 1637-1696, ISSN 1076-9757
Publisher: Morgan Kaufmann Publishers, Inc.
DOI: 10.1613/jair.1.14044

Programmatic Strategy Synthesis: Resolving Nondeterminism in Probabilistic Programs

Author(s): Kevin Batz, Tom Jannik Biskup, Joost-Pieter Katoen, Tobias Winkler
Published in: Proceedings of the ACM on Programming Languages, Issue 8, 2024, Page(s) 2792-2820, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3632935

Synthesizing optimal bias in randomized self-stabilization

Author(s): Matthias Volk; Borzoo Bonakdarpour; Joost-Pieter Katoen; Saba Aflaki
Published in: Distributed Computing, Issue 35(1), 2022, Page(s) 37-57, ISSN 0178-2770
Publisher: Springer Verlag
DOI: 10.1007/s00446-021-00408-4

Quantitative separation logic: a logic for reasoning about probabilistic pointer programs

Author(s): Kevin Batz, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Christoph Matheja, Thomas Noll
Published in: Proceedings of the ACM on Programming Languages, Issue 3/POPL, 2019, Page(s) 1-29, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3290347

Indecision and delays are the parents of failure—taming them algorithmically by synthesizing delay-resilient control

Author(s): Mingshuai Chen, Martin Fränzle, Yangjia Li, Peter N. Mosaad, Naijun Zhan
Published in: Acta Informatica, 2020, ISSN 0001-5903
Publisher: Springer Verlag
DOI: 10.1007/s00236-020-00374-7

Aiming low is harder: induction for lower bounds in probabilistic program verification

Author(s): Marcel Hark, Benjamin Lucien Kaminski, Jürgen Giesl, Joost-Pieter Katoen
Published in: Proceedings of the ACM on Programming Languages, Issue 4/POPL, 2020, Page(s) 1-28, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3371105

A Deductive Verification Infrastructure for Probabilistic Programs

Author(s): Philipp Schröer, Kevin Batz, Benjamin Lucien Kaminski, Joost-Pieter Katoen, Christoph Matheja
Published in: Proceedings of the ACM on Programming Languages, Issue 7, 2023, Page(s) 2052-2082, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3622870

Counterexample-guided inductive synthesis for probabilistic systems

Author(s): Milan Ceska; Christian Hensel; Sebastian Junges; Joost-Pieter Katoen
Published in: Formal Aspects of Computing, Issue 33, 2021, Page(s) 637-667, ISSN 0934-5043
Publisher: Springer Verlag
DOI: 10.1007/s00165-021-00547-2

A Taxonomy of Hoare-Like Logics: Towards a Holistic View using Predicate Transformers and Kleene Algebras with Top and Tests

Author(s): Lena Verscht, Benjamin Lucien Kaminski
Published in: Proceedings of the ACM on Programming Languages, Issue 9, 2025, Page(s) 1782-1811, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3704896

Residuality and Learning for Nondeterministic Nominal Automata

Author(s): Joshua Moerman; Matteo Sammartino
Published in: Logical Methods in Computer Science, 2022, Page(s) 27, ISSN 1860-5974
Publisher: Technischen Universitat Braunschweig
DOI: 10.18154/rwth-2022-01946

An Oracle-Guided Approach to Constrained Policy Synthesis Under Uncertainty

Author(s): Roman Andriushchenko, Milan Češka, Filip Macák, Sebastian Junges, Joost-Pieter Katoen
Published in: Journal of Artificial Intelligence Research, Issue 82, 2025, Page(s) 433-469, ISSN 1076-9757
Publisher: Morgan Kaufmann Publishers, Inc.
DOI: 10.1613/jair.1.16593

Exact Bayesian Inference for Loopy Probabilistic Programs using Generating Functions

Author(s): Lutz Klinkenberg, Christian Blumenthal, Mingshuai Chen, Darion Haase, Joost-Pieter Katoen
Published in: Proceedings of the ACM on Programming Languages, Issue 8, 2024, Page(s) 923-953, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3649844

Relatively complete verification of probabilistic programs: an expressive language for expectation-based reasoning

Author(s): Kevin Batz; Benjamin Lucien Kaminski; Joost-Pieter Katoen; Christoph Matheja
Published in: Proceedings of the ACM on Programming Languages, Issue 5 (POPL), 2021, Page(s) 1-30, ISSN 2475-1421
Publisher: ACM
DOI: 10.1145/3434320

The complexity of reachability in parametric Markov decision processes

Author(s): Sebastian Junges; Joost-Pieter Katoen; Guillermo A. Pérez; Tobias Winkler
Published in: Journal of Computer and System Sciences, Issue 119, 2021, Page(s) 183-210, ISSN 0022-0000
Publisher: Academic Press
DOI: 10.1016/j.jcss.2021.02.006

Conference proceedings (20)

PAYNT: A Tool for Inductive Synthesis of Probabilistic Programs

Author(s): Roman Andriushchenko; Milan Ceska; Sebastian Junges; Joost-Pieter Katoen; Simon Stupinsky
Published in: Proceedings 33rd International Conference on Computer-Aided Verification (CAV), Issue 12759, 2021, Page(s) 856-869
Publisher: Springer
DOI: 10.1007/978-3-030-81685-8_40

On Certificates, Expected Runtimes, and Termination in Probabilistic Pushdown Automata

Author(s): Tobias Winkler, Joost-Pieter Katoen
Published in: 2023 38th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS), 2023, Page(s) 1-13
Publisher: IEEE
DOI: 10.1109/lics56636.2023.10175714

Automated Termination Analysis of Polynomial Probabilistic Programs

Author(s): Moosbrugger, Marcel; Bartocci, Ezio; Katoen, Joost-Pieter; Kovács, Laura
Published in: Proceedings 30th European Symposium on Programming (ESOP), Issue 12648, 2021, Page(s) 491--518
Publisher: Springer
DOI: 10.1007/978-3-030-72019-3_18

Latticed k-Induction with an Application to Probabilistic Programs

Author(s): Kevin Batz; Mingshuai Chen; Benjamin Lucien Kaminski; Joost-Pieter Katoen; Christoph Matheja; Philipp Schröer
Published in: Proceedings 33rd International Conference on Computer Aided Verification (CAV), Issue 12760, 2021, Page(s) 524-549
Publisher: Springer
DOI: 10.18154/rwth-2021-06838

Residual Nominal Automata

Author(s): Moerman, J; Sammartino, M
Published in: Leibniz International Proceedings in Informatics (LIPIcs), Concurrency Theory, Issue 171, 2020, Page(s) 44:1-44:21
Publisher: Schloss Dagstuhl – Leibniz-Zentrum für Informatik
DOI: 10.18154/rwth-2020-03711

Inductive Synthesis for Probabilistic Programs Reaches New Horizons

Author(s): Roman Andriushchenko; Milan Češka; Sebastian Junges; Joost-Pieter Katoen
Published in: Proceedings 27th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS), Issue 12651, 2021, Page(s) 191-209
Publisher: Springer
DOI: 10.1007/978-3-030-72016-2_11

Does a Program Yield the Right Distribution? - Verifying Probabilistic Programs via Generating Functions

Author(s): Mingshuai Chen; Joost-Pieter Katoen; Lutz Klinkenberg; Tobias Winkler
Published in: Proceedings 34th International Conference on Computer-Aided Verification (CAV), Issue 13371, 2022, Page(s) 79-101
Publisher: Springer
DOI: 10.1007/978-3-031-13185-1_5

The Probabilistic Termination Tool Amber

Author(s): Moosbrugger, Marcel; Bartocci, Ezio ; Katoen, Joost-Pieter ; Kovács, Laura
Published in: Proceedings 24th International Symposium on Formal Methods (FM), Issue 13047, 2021, Page(s) 667-675
Publisher: Springer
DOI: 10.1007/978-3-030-90870-6_36

Fine-Tuning the Odds in Bayesian Networks

Author(s): Bahare Salmani; Joost-Pieter Katoen
Published in: Proceedings 16th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU), Issue 12897, 2021, Page(s) 268-283
Publisher: Springer
DOI: 10.1007/978-3-030-86772-0_20

Foundations for Entailment Checking in Quantitative Separation Logic

Author(s): Kevin Batz; Ira Fesefeldt; Marvin Jansen; Joost-Pieter Katoen; Florian Kessler; Christoph Matheja; Thomas Noll
Published in: Proceedings 31st European Symposium on Programming (ESOP), Issue 13240, 2022, Page(s) 57-84
Publisher: Springer
DOI: 10.1007/978-3-030-99336-8_3

Finding an $ε$-close Variation of Parameters in Bayesian Networks

Author(s): Salmani, Bahare; Katoen, Joost-Pieter
Published in: IJCAI, 2023
Publisher: ijcai.org
DOI: 10.48550/arxiv.2305.10051

Finding Provably Optimal Markov Chains

Author(s): Jip Spel, Joost-Pieter Katoen, Sebastian Junges
Published in: Lecture Notes in Computer Science, International Conference on Tools and Algorithms for the Construction and Analysis of Systems, Issue 12651, 2021, Page(s) 173-190
Publisher: Springer
DOI: 10.26226/morressier.604907f41a80aac83ca25cf0

PrIC3: Property Directed Reachability for MDPs

Author(s): Batz, Kevin; Junges, Sebastian; Kaminski, Benjamin Lucien; Katoen, Joost-Pieter; Matheja, Christoph; Schröer, Philipp
Published in: Computer Aided Verification : 32nd International Conference, CAV 2020, Issue 12225, 2020, Page(s) 512-538
Publisher: Springer
DOI: 10.48550/arxiv.2004.14835

Bayesian Inference by Symbolic Model Checking

Author(s): Bahare Salmani; Joost-Pieter Katoen
Published in: Proceedings 17 International Conference Quantitative Evaluation of Systems (QEST), Issue 12289, 2020, Page(s) 115-133
Publisher: Springer
DOI: 10.1007/978-3-030-59854-9_9

Inductive synthesis of finite-state controllers for POMDPs

Author(s): Roman Andriushchenko; Milan Ceska; Sebastian Junges; Joost-Pieter Katoen
Published in: Uncertainty in Artificial Intelligence, Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence, UAI 2022, Issue 180, 2022, Page(s) 85--95
Publisher: PMLR

Synthesizing Invariant Barrier Certificates via Difference-of-Convex Programming

Author(s): Qiuye Wang; Mingshuai Chen; Bai Xue; Naijun Zhan; Joost-Pieter Katoen
Published in: Proceedings 33rd International Conference on Computer-Aided Verification (CAV), Issue 12759, 2021, Page(s) 443-466
Publisher: Springer
DOI: 10.1007/978-3-030-81685-8_21

Separation and Renaming in Nominal Sets

Author(s): Moerman, Joshua; Rot, Jurriaan
Published in: 28th EACSL Annual Conference on Computer Science Logic (CSL 2020)<br/>Computer Science Logic, CSL 2020, Barcelona, Spain, 2020-01-13 - 2020-01-16, Issue 3, 2020, ISBN 978-3-95977-132-0
Publisher: Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik
DOI: 10.4230/LIPIcs.CSL.2020.31

Foundations for Entailment Checking in Quantitative Separation Logic (extended version)

Author(s): Batz, Kevin; Fesefeldt, Ira; Jansen, Marvin; Katoen, Joost-Pieter; Keßler, Florian; Matheja, Christoph; Noll, Thomas
Published in: Lecture Notes in Computer Science, European Symposium on Programming, Issue 13240, 2022, Page(s) 57-84
Publisher: Springer
DOI: 10.48550/arxiv.2201.11464

Generating Functions for Probabilistic Programs

Author(s): Klinkenberg, Lutz; Batz, Kevin; Kaminski, Benjamin Lucien; Katoen, Joost-Pieter; Moerman, Joshua; Winkler, Tobias; Maribel Fernández
Published in: Logic-Based Program Synthesis and Transformation, Issue 13, 2020, Page(s) 231-248
Publisher: Springer
DOI: 10.1007/978-3-030-68446-4_12

Probabilistic Program Verification via Inductive Synthesis of Inductive Invariants

Author(s): Kevin Batz; Mingshuai Chen; Sebastian Junges; Benjamin Lucien Kaminski; Joost-Pieter Katoen; Christoph Matheja
Published in: 29th International Conference Tools and Algorithms for the Construction and Analysis of Systems (TACAS), Issue 13994, 2023, Page(s) 410-429
Publisher: Springer
DOI: 10.1007/978-3-031-30820-8_25

Thesis and dissertations (1)

Advanced weakest precondition calculi for probabilistic programs

Author(s): Kaminski, Benjamin Lucien
Published in: Aachen 1 Online-Ressource (xiv, 363 Seiten) : Illustrationen, Diagramme (2019). doi:10.18154/RWTH-2019-01829 = Dissertation, RWTH Aachen University, 2019, Issue 1, 2019
Publisher: RWTH Aachen University, Germany
DOI: 10.18154/RWTH-2019-01829