41
Optimally Resilient Strategies in Pushdown Safety Games Joint work with Daniel Neider (MPI-SWS) and Patrick Totzke (Liverpool) Artwork by Paulina Zimmermann Martin Zimmermann University of Liverpool August 2020 MFCS 2020 Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10

Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Optimally Resilient Strategies inPushdown Safety Games

Joint work with Daniel Neider (MPI-SWS) and Patrick Totzke (Liverpool)Artwork by Paulina Zimmermann

Martin Zimmermann

University of Liverpool

August 2020MFCS 2020

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10

Page 2: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 3: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 4: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 5: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 6: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 7: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 8: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 9: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 10: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 11: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 12: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 13: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 14: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 15: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 16: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 17: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 18: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 19: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 20: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 21: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Reactive Synthesis

Automatically generate correct-by-construction systems.

Model the interaction between a system and its environmentby an infinite-duration zero-sum game on graph. The winningcondition captures a specification of the system.A winning strategy for the system player corresponds to animplementation satisfying the system specification.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 2/10

Page 22: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 23: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

1

0

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 24: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 25: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

2

1

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 26: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 27: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 28: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

2

ω + 1

21

10

ω + 1ω + 1

ω + 1ω + 1

Question: How many disturbances make the system player lose?

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 29: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Resilience in Safety Games

Dallal, Tabuada and Neider: Add disturbances edges to modelnon-antagonistic external influences.

Theorem (Dallal, Neider & Tabuada, 2016)

A safety game with n vertices has resilience values in{0, · · · , n − 1} ∪ {ω + 1}.The resilience values and an optimally resilient strategy can becomputed in polynomial time.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 3/10

Page 30: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Systems with Infinite State Space

Pushdown graphs are configuration graphs of pushdownautomata.

One-counter automata are pushdown automata with a singlestack symbol (that can still test the stack for emptiness).

· · ·

· · ·

qI

q1

q2

⊥ A⊥ A2⊥ A3⊥ A4⊥ A5⊥

0

ω + 1

0

ω + 1

1

ω + 1

2

ω + 1

3

ω + 1

4

ω + 1

5

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 4/10

Page 31: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Systems with Infinite State Space

Pushdown graphs are configuration graphs of pushdownautomata.

One-counter automata are pushdown automata with a singlestack symbol (that can still test the stack for emptiness).

· · ·

· · ·

qI

q1

q2

⊥ A⊥ A2⊥ A3⊥ A4⊥ A5⊥

0

ω + 1

0

ω + 1

1

ω + 1

2

ω + 1

3

ω + 1

4

ω + 1

5

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 4/10

Page 32: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Building Blocks for an Algorithm

Theorem

A pushdown safety game has resilience values in {0, 1, 2, · · ·}∪{ω + 1}.An optimally resilient strategy always exists.

LemmaThe following problem is in ExpTime: “Given a pushdown safetygame G with initial vertex vI , is r(vI ) = ω + 1?”.

NotePSpace for one-counter safety games.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 5/10

Page 33: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Building Blocks for an Algorithm

Theorem

A pushdown safety game has resilience values in {0, 1, 2, · · ·}∪{ω + 1}.An optimally resilient strategy always exists.

LemmaThe following problem is in 2ExpTime: “Given a pushdown safetygame G with initial vertex vI and k ∈ ω (encoded in binary), isr(vI ) = k?”.

NoteExpSpace for one-counter safety games.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 5/10

Page 34: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

A Naive Algorithm

1: if r(vI ) = ω + 1 then2: return ω + 13: k = 04: while true do5: if r(vI ) = k then6: return k7: else8: k = k+1

The algorithm terminates, as the only possible resiliencevalues are ω + 1 or some k ∈ ω.

To obtain an upper bound on the running time, we need anupper bound on the resilience value of the initial vertex.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 6/10

Page 35: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Upper Bounds on Resilience Values

Note that resilience values can be unbounded. Nevertheless, wecan bound the resilience value of the initial vertex.

For a pushdown automaton P with n states and s stack symbols,define

b(P) = n · h(P) · sh(P)

with

h(P) = n · s · 2n+1 + 1

LemmaLet G be a pushdown safety game with initial vertex vI . Ifr(vI ) ∕= ω + 1, then r(vI ) < b(P), where P is the automatonunderlying G.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 7/10

Page 36: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

An Improved Algorithm

1: if r(vI ) = ω + 1 then2: return ω + 13: for k = 0 to b(P) do4: if r(vI ) = k then5: return k

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 8/10

Page 37: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

An Improved Algorithm

1: if r(vI ) = ω + 1 then2: return ω + 13: for k = 0 to b(P) do4: if r(vI ) = k then5: return k

TheoremThe following problem can be solved in triply-exponential time:“Given a pushdown safety game G with initial vertex vI , determinethe resilience value of vI”. If yes, an r(vI )-resilient strategy from vIcan be computed in triply-exponential time.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 8/10

Page 38: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

An Improved Algorithm

1: if r(vI ) = ω + 1 then2: return ω + 13: for k = 0 to b(P) do4: if r(vI ) = k then5: return k

TheoremThe following problem can be solved in polynomial space: “Given aone-counter safety game G with initial vertex vI , determine theresilience value of vI”.

NoteNo strategy computed.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 8/10

Page 39: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Conclusion

Also in the paper/arXiv version:

1. An outlook on resilient strategies in pushdown reachabilitygames (new resilience values appear).

2. A new result on optimal strategies in one-counter reachabilitygames (without disturbance edges).

3. Lower bounds on computational complexity and on theresilience value of the initial vertex.

Open problems:

1. Extension to more expressive winning conditions.

2. Better complexity bounds for pushdown safety games viasaturation.

3. Computing optimally resilient strategies for one-counter safetygames in polynomial space.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 9/10

Page 40: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

Conclusion

Also in the paper/arXiv version:

1. An outlook on resilient strategies in pushdown reachabilitygames (new resilience values appear).

2. A new result on optimal strategies in one-counter reachabilitygames (without disturbance edges).

3. Lower bounds on computational complexity and on theresilience value of the initial vertex.

Open problems:

1. Extension to more expressive winning conditions.

2. Better complexity bounds for pushdown safety games viasaturation.

3. Computing optimally resilient strategies for one-counter safetygames in polynomial space.

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 9/10

Page 41: Optimally Resilient Strategies in Pushdown Safety …zimmermann/slides/MFCS_2020.pdfMartin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 1/10 Reactive

The Last Slide

Thank you for watching.

Daniel Neider: [email protected] Totzke: [email protected] Zimmermann: [email protected]

Martin Zimmermann University of Liverpool Resilient Strategies in Pushdown Safety Games 10/10