21
Uncertain Reasoning in Games Dmitrijs Rutko Faculty of Computing University of Latvia LU and LMT Computer Science Days at Ratnieki, 2011

Uncertain Reasoning in Games

Embed Size (px)

DESCRIPTION

Uncertain Reasoning in Games. Dmitrijs Rutko Faculty of Computing University of Latvia. LU and LMT Computer Science Days at Ratnieki, 2011. Game Tree Search. Deterministic / stochastic games Perfect / imperfect information games. Finite zero-sum games. Game trees. max. 8. min. 2. 8. - PowerPoint PPT Presentation

Citation preview

Page 1: Uncertain Reasoning in Games

Uncertain Reasoning in Games

Dmitrijs RutkoFaculty of Computing

University of Latvia

LU and LMT Computer Science Days at Ratnieki, 2011

Page 2: Uncertain Reasoning in Games

Game Tree Search

Deterministic / stochastic games Perfect / imperfect information games

Page 3: Uncertain Reasoning in Games

Finite zero-sum games

deterministic chance

perfect information chess, checkers, go, othello

backgammon, monopoly, roulette

imperfect information

battleship, kriegspiel, rock-paper-scissors

bridge, poker, scrabble

Page 4: Uncertain Reasoning in Games

Game trees

Page 5: Uncertain Reasoning in Games

Classical algorithms

MiniMax O(wd)

Alpha-Beta O(wd/2)

1 2 7 4 3 6 8 9 5 4

2 7 8 9

2 8

8

√ √ √ Χ Χ √ √ √ Χ Χ

max

min

max

Page 6: Uncertain Reasoning in Games

Advanced search techniques

Transposition tables Time efficiency / high cost of space

PVS Negascout NegaC* SSS* / DUAL* MTD(f)

Page 7: Uncertain Reasoning in Games

Uncertain Reasoning

O(wd/2) More cut-offs

1 2 7 4 3 6 8 9 5 4

<5 ? ≥5 ≥5

<5 ≥5

≥5

√ √ Χ Χ Χ √ Χ √ Χ Χ

max

min

max

Page 8: Uncertain Reasoning in Games

Game tree statistical evaluation

Minimax value

Tree count

25 1

26 5

27 11

28 38

29 124

30 206

31 252

32 189

33 111

34 42

35 14

36 7

1000

Page 9: Uncertain Reasoning in Games

Game tree analytical evaluation

FX FXFX FX

Fmin

Fmax

Probability density

Cumulative distribution

Page 10: Uncertain Reasoning in Games

Game tree analytical evaluation

FX FXFX FX

Fmin

Fmax

Page 11: Uncertain Reasoning in Games

Cumulative probability function by level

Page 12: Uncertain Reasoning in Games

Probability density function by level

Page 13: Uncertain Reasoning in Games

Relative performance (Leaf nodes visited)

Page 14: Uncertain Reasoning in Games

Hey! That's My Fish!

Page 15: Uncertain Reasoning in Games

Evaluation function

Fish Amount (player) – Fish Amount (opponent)

Page 16: Uncertain Reasoning in Games

Iterative deepening

Page 17: Uncertain Reasoning in Games

Number of positions searched

Page 18: Uncertain Reasoning in Games

Relative number of positions searched

Page 19: Uncertain Reasoning in Games

Relative time elapsed

Page 20: Uncertain Reasoning in Games

Conclusions and Future Work

BNS gives a 10 percent performance improvement

Transposition tables Different evaluation functions Multi-player game Approximation search

Page 21: Uncertain Reasoning in Games

Questions ?

[email protected]