29
Introduction to Probabilistic Analysis

Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

Embed Size (px)

Citation preview

Page 1: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

Introduction to Probabilistic Analysis

Page 2: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

22.07 • Introduction to Probabilistic Analysis

The third phase of the cycle incorporates uncertainty into the analysis of the decision.

Strategy Table

DecisionStructure

DeterministicAnalysis

ProbabilisticAnalysis

AppraisalInitial

Situation

Iteration

InfluenceDiagram

12345

DeterministicModelA B C

DeterministicSensitivity

DecisionTree

ProbabilityDistributions

Value ofInformation

Decision Quality

Page 3: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

32.07 • Introduction to Probabilistic Analysis

We will review terminology and probability calculations used in probabilistic analysis.

EV

• Cumulative Probability Distributions

• Probability Trees

• Decision Trees & Expected Values25

0

100.5

.5

50

Page 4: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

42.07 • Introduction to Probabilistic Analysis

We will work with probabilities associated with discrete events and continuous variables.

* Probability of cost less than or equal to any given value.

RainProbability = p

Probability = 1 – p

Discrete Event

No Rain

Cost ($ millions)

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

Continuous Variable

Cumulative Probability*

Page 5: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

52.07 • Introduction to Probabilistic Analysis

Probability nodes represent discrete, uncertain events in probability and decision trees.

Anatomy of a Single Probability Node

.25

.25

.50

Higher

No Change

Lower

Outcome

Branch(one for each outcome)

Probability(sum to 1.0)

Outcomesare

mutuallyexclusive

Outcomesare

collectivelyexhaustive

Uncertainty associated with continuous variables can be represented in a tree using a discrete approximation.

Price Next Month

Page 6: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

62.07 • Introduction to Probabilistic Analysis

Two events may be probabilistically independent or dependent.

Independent

500

200

500

200

200

100

.5

.5

.6

.4

.6

.4

Market Price($/ton)

Sales Volume(thousand tons)

Dependent

500*

200

500*

200

200

100

.5

.5

.4

.6

.8

.2

* Outcomes could change alongwith or instead of probabilities.

Market Price($/ton)

Sales Volume(thousand tons)

ConditionalProbability

MarginalProbability

The order of adjacent probability nodes can be reversed.

Page 7: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

72.07 • Introduction to Probabilistic Analysis

A “joint probability distribution” can be computed from data in the probability tree.

Market Price($/ton)

Sales Volume(thousand tons)

500

200

500

200

200

100

.5

.5

.4

.6

.8

.2

Revenues($ millions)

JointProbability

100

40

50

20

.2*

•* .5 x .4 = .2

.3

.4

.1

Page 8: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

82.07 • Introduction to Probabilistic Analysis

Sometimes it is necessary to switch the conditioning variable.

The information is available in this order.

Test Result

ActualEvent

Not Sick

“Negative”.98

.02

.99

.001

.999“Positive”

“Negative”.01

“Positive”

Sick

But we want to use the informationin this order.

Actual Event

Test Result

Sick

Sick

“Positive”

“Negative”

Not Sick

Not Sick

What probability would you assign to being sick, given a positive test result?

Page 9: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

92.07 • Introduction to Probabilistic Analysis

We “flip” the tree using a process called “Bayesian Revision” of probabilities.

1) Begin by computing joint probabilities

Test Result

ActualEvent

Not Sick

“Negative”.98

.02

.99

.001

.999“Positive”

“Negative”.01

“Positive”

Sick

.00099

.00001

.01998

.97902

Joint Probability

2) Transfer joint probabilities to

corresponding joint events

Actual Event

Test Result

Sick

Sick

“Positive”

“Negative”

Not Sick

Not Sick

.00099

.00001

.01998

.97902

Joint Probability

3) Add joints to get

marginal probs.

.02097

4) Divide to get

conditional probabilities

~.001/.021 =.047

Does the resulting .047 probability of sick surprise you, given the test accuracy?

Page 10: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

102.07 • Introduction to Probabilistic Analysis

We will review terminology and probability calculations used in probabilistic analysis.

EV

• Cumulative Probability Distributions

• Probability Trees

• Decision Trees & Expected Values25

0

100.5

.5

50

Page 11: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

112.07 • Introduction to Probabilistic Analysis

A cumulative probability distribution shows the probability that a variable will be less than or equal to any given value.

CumulativeProbability*

Cost ($ millions)

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

*Probability that cost (in this case) is less than or equal to ____.

The complementary cumulative (drawn down from the top) shows the probability of exceeding any given value.

Page 12: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

122.07 • Introduction to Probabilistic Analysis

The cumulative probability distribution displays information decision-makers need.

*Probability that cost is less than or equal to a given value.

CumulativeProbability*

Cost ($ millions)

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

One chance in 10 that cost will begreater than $180 million

“Median” cost is $14 million(equal chance above or below)

One chance in 10 thatcost will be $110 millionor less

80%chancethat costwill be$110 millionto$180 million

Page 13: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

132.07 • Introduction to Probabilistic Analysis

Cumulative probability distributions can be plotted for discrete and continuous variables.

Cost ($ millions)

Cumulative Probability

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

Continuous Variable

Cumulative Probability

Days of Rain Next Week

0

.2

.4

.6

.8

1.0

0 1 2 3 54

Discrete Variable

6 7

Page 14: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

142.07 • Introduction to Probabilistic Analysis

Let’s review how to construct a cumulative probability distribution in discrete form.

Market Price($/ton)

Sales Volume(thousand tons)

500

200

500

200

200

100

.5

.5

.4

.6

.8

.2

Revenues($ millions)

100

40

50

20

CumulativeProbability

Revenues ($ millions)

0

.2

.4

.6

.8

1.0

0 20 40 60 80 100

Discrete Cumulative Probability Distribution

Why is this a step function?

Page 15: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

152.07 • Introduction to Probabilistic Analysis

Begin by computing the value (revenues) and joint probability for each endpoint.

.2*

* . 5 x .4 = .2

Market Price($/ton)

Sales Volume(thousand tons)

500

200

500

200

200

100

.5

.5

.4

.6

.8

.2

Revenues($ millions)

100

40

50

20

Joint Probabilit

y

.3

.4

.1

Page 16: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

162.07 • Introduction to Probabilistic Analysis

Next, list and rank unique profit outcomes, joint probabilities, and cumulative probabilities.

Tree Endpoints

Revenues($ millions)

JointProbability

100 .2

40

50

20

.3

.4

.1

Probability Distribution

Revenues($ millions)

20

40

50

100

JointProbability

.1

.3

.4

.2

Cumulative*Probability

.1

.4

.8

1.0

*Probability that revenues are less than or equal to _____.

Page 17: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

172.07 • Introduction to Probabilistic Analysis

Plotting the cumulative distribution shows the range of outcomes and associated probabilities.

Discrete Cumulative Probability Distribution

CumulativeProbability

Revenues ($ millions)

.2

.4

.6

.8

1.0

0

0 20 40 60 80 100 120

Page 18: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

182.07 • Introduction to Probabilistic Analysis

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

Cumulative distributions for continuous variables are constructed by connecting cumulative points.

Values on the horizontal axis are called “percentiles” (e.g., $110 million and $180 million are the 10th and 90th percentiles, respectively).

Cumulative*Probability

Cost($ millions)

Assessed Cumulative

Probability

60

110

140

180

230

.01

.10

.50

.90

.99

Continuous Cumulative Probability Distribution

Cost ($ millions)*Probability that cost is less than or equal to ____.

Page 19: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

192.07 • Introduction to Probabilistic Analysis

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

Cumulative

Probability

Cumulative Probability Distribution

Cost ($ millions)

Continuous variables also can be plotted as “probability density functions.”

Probability

Density

Cost ($ millions)

0 50 100 150 200 250

Probability Density Function

Page 20: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

202.07 • Introduction to Probabilistic Analysis

Cumulative

Probability

Cost ($ millions)

0

.2

.4

.6

.8

1.0

0 50 100 150 200

Cumulative Probability Distribution

Probability

Density

0 50 100 150 200 250

Probability Density Function

The cumulative form is easier to use for assessing and making calculations with probabilities.

250

Probabilitythat cost is lessthan or equal to$120 million

Cost ($ millions)

Page 21: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

212.07 • Introduction to Probabilistic Analysis

“Flying bars” highlight differences in probability distributions for many alternatives.

Strategy 5

Strategy 4

Strategy 3

Strategy 2

Strategy 1

“Flying Bar” Comparison of Strategy Risks

–200 –150 –100 –50 0 50 100 150 200 250 300 350 400

Net Present Value ($ millions)

*

*

*

*

*

*1st 10th Percentiles

90th 99th

*Expected Value

Legend

Page 22: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

222.07 • Introduction to Probabilistic Analysis

The mean, median, and mode all can be used to describe distributions, depending on which characteristics are important.

MedianMode

MeanMode

0

.2

.4

.6

.8

1.0

Mean

Median

Probability Density FunctionCumulative

Probability Distribution

Parameter MeaningMean Expected value; probability-weighted averageMedian 50th percentileMode Most likely value

Page 23: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

232.07 • Introduction to Probabilistic Analysis

We will review terminology and probability calculations used in probabilistic analysis.

EV

• Cumulative Probability Distributions

• Probability Trees

• Decision Trees & Expected Values25

0

100.5

.5

50

Page 24: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

242.07 • Introduction to Probabilistic Analysis

The expected value (EV) is a single number that can represent an entire probability distribution.

Discrete Variable

Sales Volume(thousand tons)

500

200

.6

.4

EV = 380thousand tons

EV = 380thousand tons

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

CumulativeProbability

Cumulative Probability Distribution

Cost ($ millions)

EV = $141 million

The expected value is a “probability-weighted average.” “Mean” is synonymous with expected value.

Page 25: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

252.07 • Introduction to Probabilistic Analysis

Use a right-to-left rollback procedure to compute expected values for probability trees.

Market Price($/ton)

Sales Volume(thousand tons)

500

200

500

200

200

100

.5

.5

.4

.6

.8

.2

Revenues($ millions)

100

40

50

20

$64

$44

EV ofRevenue =$54 million

EV ofRevenue =$54 million

The rollback proceeds right to left, one node at a time: e.g., $64 = .4 x $100 + .6 x $40.

Box IndicatesExpectedValue

Page 26: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

262.07 • Introduction to Probabilistic Analysis

Use the same rollback procedure for decision trees, choosing the best expected value at decisions.

.5

.5

.2

.8

.3

.7

.3

.7

.5

.5

50

10

100

–20

50

20

60

60

20

30

44Indicates expected value.

4

Indicates preferred alternative for an expected value decision-maker.

30

50

44

48

60

60

20

40

44

Decision Uncertainty UncertaintyNet Value ofOutcomesDecision

PlanA

PlanB

Page 27: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

272.07 • Introduction to Probabilistic Analysis

“Inside a complicated problem there may be a simple problem waiting to emerge!”

.5

.5

.2

.8

.3

.7

.3

.7

.5

.5

50

10

100

–20

50

20

60

60

20

30

44Indicates expected value.

4

30

50

44

48

60

60

20

40

44

Decision Uncertainty UncertaintyNet Value ofOutcomesDecision

Is the initial choice between alternatives clearer now, once the inferior choices are removed?

PlanA

PlanB

Page 28: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

282.07 • Introduction to Probabilistic Analysis

The expected value of a cumulative distribution is the point where two areas are equal.

Cumulative

Probability*

Cost ($ millions)

0

.2

.4

.6

.8

1.0

0 50 100 150 200 250

Continuous Variable

Area C =Area D

* Probability that cost is less than or equal to ____.

EV =$141 million

7

Cumulative

Probability*

Days of Rain Next Week

0

.2

.4

.6

.8

1.0

0 1 2 3 54

Discrete Variable

6

EV =3.1 days

Area A =Area B

A

B

Page 29: Introduction to Probabilistic Analysis. 2 2.07 Introduction to Probabilistic Analysis The third phase of the cycle incorporates uncertainty into the analysis

292.07 • Introduction to Probabilistic Analysis

We will review terminology and probability calculations used in probabilistic analysis.

EV

• Cumulative Probability Distributions

• Probability Trees

• Decision Trees & Expected Values25

0

100.5

.5

50