26

Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

Embed Size (px)

DESCRIPTION

Introduction to Probability, Conditional Probability, Bayes's Rule, Example of Sampling Problem using Bayes's Theorem, story from Howard Raiffa

Citation preview

Page 1: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 2: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A = person entering our clinichas lung cancer = 10% = 0.1

B = person entering our clinicis a smoker = 50% = 0.5

Likelihood data = P(B|A) = 0.8

P(A|B) = (0.8) x (0.1)

(0.5)= 0.16

Page 3: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

• “Bayesian Inference” refers to use of Bayes’Theorem to update probabilities as newevidence is available

• Especially valuable to analyze trends when data will continue to flow in over time

• Provides a rational method for updatingbeliefs in science, engineering, medicine, law

Page 4: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

Sets

Venn Diagrams

Terminology

Symbols

Experiment Space S

Page 5: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A

Page 6: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

B

Page 7: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Page 8: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Intersection of sets = creatures satisfying both constraints: two-legged And flying

∩ the “and” function

Page 9: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Caution: Venn Diagrams areLogical relationships,

not the comparative size of sets.

Page 10: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Page 11: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Page 12: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A B

Union: e.g. creatures satisfying either constraint: two-legged or flying

the “or” function

Page 13: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

What if no intersection?

A ∩ B = (null set, empty set, or impossible event)

A B

Page 14: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

S is the set of all possible outcomes S is often called “the sure event”

EVENT = subset of S A S

if A is an event, Anot is the eventthat A does not occur

Page 15: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

A Anot = null, impossible set

A Anot = S set of all outcomes

Page 16: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

the probability of A, given B

P(A│B)

Page 17: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 18: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 19: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 20: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 21: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling

Ask some lawyers whotry cases on probabilistic

evidence?

Ask political punditswho make election

predictions?

Ask a class of MBA studentsat Harvard B-School

taking a course inDecision Theory?

Page 22: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 23: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 24: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 25: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling
Page 26: Jan 2014 Intro to Bayesian Probability, Statistical Inference, Sampling