Supermartingale Certificates for Quantitative Omega-regular Verification and Control
Preprint
Abstract
We present the first supermartingale certificate for quantitative $ω$-regular properties of discrete-time infinite-state stochastic systems. Our certificate is defined on the product of the stochastic system and a limit-deterministic Büchi automaton that specifies the property of interest; hence we call it a limit-deterministic Büchi supermartingale (LDBSM). Previously known supermartingale certificates applied only to quantitative reachability, safety, or reach-avoid properties, and to qualitative (i.e., probability 1) $ω$-regular properties. We also present fully automated algorithms for the template-based synthesis of LDBSMs, for the case when the stochastic system dynamics and the controller can be represented in terms of polynomial inequalities. Our experiments demonstrate the ability of our method to solve verification and control tasks for stochastic systems that were beyond the reach of previous supermartingale-based approaches.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- PolyQEnt: A Polynomial Quantified Entailment Solver2025
- Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems2024
- Compositional construction of control barrier functions for continuous-time stochastic hybrid systemsAutomatica, 2022
- Termination Analysis of Probabilistic Programs Through Positivstellensatz’s2016
- PSI: Exact Symbolic Inference for Probabilistic Programs2016
- Deductive Proofs of Almost Sure Persistence and Recurrence Properties2016
- Probabilistic NetKAT2016
- Expectation Invariants for Probabilistic Program Loops as Fixed Points2014
- Probabilistic Program Analysis with Martingales2013
- Markov Decision Processes1994