We consider infinite-state Markov decision processes (MDPs) that are induced by extensions of vector addition systems with states (VASS). Verification conditions for these MDPs are described by reachability and Buchi objectives w.r.t. given sets of control-states. We study the decidability of some qualitative versions of these objectives, i.e., the decidability of whether such objectives can be achieved surely, almost-surely, or limit-surely. While most such problems are undecidable in general, some are decidable for large subclasses in which either only the controller or only the random environment can change the counter values (while the other side can only change control-states).

Qualitative analysis of VASS-induced MDPs

SPROSTON, Jeremy James
2016-01-01

Abstract

We consider infinite-state Markov decision processes (MDPs) that are induced by extensions of vector addition systems with states (VASS). Verification conditions for these MDPs are described by reachability and Buchi objectives w.r.t. given sets of control-states. We study the decidability of some qualitative versions of these objectives, i.e., the decidability of whether such objectives can be achieved surely, almost-surely, or limit-surely. While most such problems are undecidable in general, some are decidable for large subclasses in which either only the controller or only the random environment can change the counter values (while the other side can only change control-states).
2016
19th International Conference on Foundations of Software Science and Computation Structures (FOSSACS 2016) and Held as Part of the European Joint Conferences on Theory and Practice of Software (ETAPS 2016)
Eindhoven, The Netherlands
2016
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Springer Verlag
9634
319
334
9783662496299
http://springerlink.com/content/0302-9743/copyright/2005/
https://arxiv.org/abs/1512.08824
Computer Science (all); Theoretical Computer Science
Abdulla, Parosh Aziz; Ciobanu, Radu; Mayr, Richard; Sangnier, Arnaud; Sproston, Jeremy
File in questo prodotto:
File Dimensione Formato  
1512.08824v2.pdf

Accesso aperto

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 321.33 kB
Formato Adobe PDF
321.33 kB Adobe PDF Visualizza/Apri
Abdulla2016_Chapter_QualitativeAnalysisOfVASS-Indu.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 357.15 kB
Formato Adobe PDF
357.15 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1588554
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 7
  • ???jsp.display-item.citation.isi??? 3
social impact