41
Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Embed Size (px)

Citation preview

Page 1: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Thinking About Inference

BPS chapter 15

© 2010 W.H. Freeman and Company

Page 2: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance levelA certain manufacturer of paints uses an additive to get the drying time

for a specific paint to be 75 minutes. If there’s too much additive, the drying time could be longer than specified but too little additive will decrease the drying time. In testing the amount of additive, they use these hypotheses: H0: = 7 ml vs. Ha: 7 ml. Which of the following would be an implication of having a small ?

a) Concluding that the mean amount of additive is different from 7 ml more often.

b) Concluding that the mean amount of additive is not different from 7 ml more often.

Page 3: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level (answer)A certain manufacturer of paints uses an additive to get the drying time

for a specific paint to be 75 minutes. If there’s too much additive, the drying time could be longer than specified but too little additive will decrease the drying time. In testing the amount of additive, they use these hypotheses: H0: = 7 ml vs. Ha: 7 ml. Which of the following would be an implication of having a small ?

a) Concluding that the mean amount of additive is different from 7 ml more often.

b) Concluding that the mean amount of additive is not different from 7 ml more often.

Page 4: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Statistical significanceA group of researchers wanted to know if there was a difference in

average yearly income taxes paid between residents of two very large cities in the midwestern United States. The average for the first city was $6,505 and for the second city, it was $6,511. The difference provided a P-value of 0.0007. Were these results statistically significant?

a) No, because a $6 difference is probably too small to really matter.

b) No, because the P-value is small.

c) Yes, because the P-value is small.

d) Yes, because the difference of $6 is bigger than 0.

Page 5: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Statistical significance (answer)A group of researchers wanted to know if there was a difference in

average yearly income taxes paid between residents of two very large cities in the midwestern United States. The average for the first city was $6,505 and for the second city, it was $6,511. The difference provided a P-value of 0.0007. Were these results statistically significant?

a) No, because a $6 difference is probably too small to really matter.

b) No, because the P-value is small.

c) Yes, because the P-value is small.

d) Yes, because the difference of $6 is bigger than 0.

Page 6: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Practical significanceA group of researchers wanted to know if there was a difference in

average yearly income taxes paid between residents of two very large cities in the midwestern United States. The average for the first city was $6,505 and for the second city, it was $6,511. The difference provided a P-value of 0.0007. Were these results practically significant?

a) No, because a $6 difference is probably too small to really matter.

b) No, because the P-value is small.

c) Yes, because the P-value is small.

d) Yes, because the difference of $6 is bigger than 0.

Page 7: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Practical significance (answer)A group of researchers wanted to know if there was a difference in

average yearly income taxes paid between residents of two very large cities in the midwestern United States. The average for the first city was $6,505 and for the second city, it was $6,511. The difference provided a P-value of 0.0007. Were these results practically significant?

a) No, because a $6 difference is probably too small to really matter.

b) No, because the P-value is small.

c) Yes, because the P-value is small.

d) Yes, because the difference of $6 is bigger than 0.

Page 8: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I errorWhich of the following defines Type I error?

a) Reject H0 when H0 is true.

b) Reject H0 when H0 is false.

c) Do not reject H0 when H0 is true.

d) Do not reject H0 when H0 is false.

Page 9: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I error (answer)Which of the following defines Type I error?

a) Reject H0 when H0 is true.

b) Reject H0 when H0 is false.

c) Do not reject H0 when H0 is true.

d) Do not reject H0 when H0 is false.

Page 10: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II errorWhich of the following defines Type II error?

a) Reject H0 when H0 is true.

b) Reject H0 when H0 is false.

c) Do not reject H0 when H0 is true.

d) Do not reject H0 when H0 is false.

Page 11: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II error (answer)Which of the following defines Type II error?

a) Reject H0 when H0 is true.

b) Reject H0 when H0 is false.

c) Do not reject H0 when H0 is true.

d) Do not reject H0 when H0 is false.

Page 12: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I and Type II errorIf we fail to reject the null hypothesis, we may have made

a) A Type I error.

b) A Type II error.

c) Either a Type I or Type II error.

Page 13: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I and Type II error (answer)If we fail to reject the null hypothesis, we may have made

a) A Type I error.

b) A Type II error.

c) Either a Type I or Type II error.

Page 14: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I errorSuppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

What is a Type I error in context?

a) Believing the mean level of NOx exceeds 5.0 ppt when it really does.

b) Believing the mean level of NOx exceeds 5.0 ppt when it really does not.

c) Believing the mean level of NOx is 5.0 ppt or less when it really is.

d) Believing the mean level of NOx is 5.0 ppt or less when it really is not.

Page 15: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I error (answer)Suppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

What is a Type I error in context?

a) Believing the mean level of NOx exceeds 5.0 ppt when it really does.

b) Believing the mean level of NOx exceeds 5.0 ppt when it really does not.

c) Believing the mean level of NOx is 5.0 ppt or less when it really is.

d) Believing the mean level of NOx is 5.0 ppt or less when it really is not.

Page 16: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II errorSuppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

Which of the following best describes the implications of a Type II error?

a) Cutting federal funding when in fact the level of NOx is greater than 5.0 ppt.

b) Cutting federal funding when in fact the level of NOx is equal to 5.0 ppt or less.

c) Providing federal funding when in fact the level of NOx is greater than 5.0 ppt.

d) Providing federal funding when in fact the level of NOx is equal to 5.0 ppt or less.

Page 17: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II error (answer)Suppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

Which of the following best describes the implications of a Type II error?

a) Cutting federal funding when in fact the level of NOx is greater than 5.0 ppt.

b) Cutting federal funding when in fact the level of NOx is equal to 5.0 ppt or less.

c) Providing federal funding when in fact the level of NOx is greater than 5.0 ppt.

d) Providing federal funding when in fact the level of NOx is equal to 5.0 ppt or less.

Page 18: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I and Type II errorSuppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

Suppose the agency concludes that the mean level of NOx exceeds 5.0 ppt. Which of the following is true?

a) Neither a Type I error nor a Type II error could have been committed.

b) We definitely did not make a Type I error, but a Type II error may have been committed.

c) We definitely did not make a Type II error, but a Type I error may have been committed.

d) We may have made both a Type I error and a Type II error.

Page 19: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type I and Type II error (answer)Suppose that a regulatory agency will propose that Congress cut

federal funding to a metropolitan area if its mean level of NOx is unsafe—that is, if it exceeds 5.0 ppt. The agency gathers sample NOx concentrations on 60 different days and calculates a test of significance to assess whether the mean level of NOx is greater than 5.0 ppt.

Suppose the agency concludes that the mean level of NOx exceeds 5.0 ppt. Which of the following is true?

a) Neither a Type I error nor a Type II error could have been committed.

b) We definitely did not make a Type I error, but a Type II error may have been committed.

c) We definitely did not make a Type II error, but a Type I error may have been committed.

d) We may have made both a Type I error and a Type II error.

Page 20: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance levelThe significance level is

a) A Type I error.

b) A Type II error.

c) The probability of a Type I error.

d) The probability of a Type II error.

e) The power of a test.

Page 21: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level (answer)The significance level is

a) A Type I error.

b) A Type II error.

c) The probability of a Type I error.

d) The probability of a Type II error.

e) The power of a test.

Page 22: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

is

a) A Type I error.

b) A Type II error.

c) The probability of a Type I error.

d) The probability of a Type II error.

e) The power of a test.

Page 23: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

(answer) is

a) A Type I error.

b) A Type II error.

c) The probability of a Type I error.

d) The probability of a Type II error.

e) The power of a test.

Page 24: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

1 - 1 - is

a) A Type I error.

b) A Type II error.

c) The probability of a Type I error.

d) The probability of a Type II error.

e) The power of a test.

Page 25: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

1 - (answer)1 - is

A Type I error. A Type II error. The probability of a Type I error. The probability of a Type II error. The power of a test.

Page 26: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II errorSuppose we set our significance level to be = 0.01. To decrease the

probability of committing a Type II error, we can

a) Increase our sample size.

b) Decrease our sample size.

Page 27: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Type II error (answer)Suppose we set our significance level to be = 0.01. To decrease the

probability of committing a Type II error, we can

a) Increase our sample size.

b) Decrease our sample size.

Page 28: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and powerTrue or False: As the significance level for a test is decreased, the

power is increased.

a) True

b) False

Page 29: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and power (answer)True or False: As the significance level for a test is decreased, the

power is increased.

a) True

b) False

Page 30: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance levelTrue or False: As the significance level for a test is decreased, the

probability of making a Type I error is increased.

a) True

b) False

Page 31: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level (answer)True or False: As the significance level for a test is decreased, the

probability of making a Type I error is increased.

a) True

b) False

Page 32: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance levelTrue or False: As the significance level for a test is decreased, the

probability of making a Type II error is increased.

a) True

b) False

Page 33: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level (answer)True or False: As the significance level for a test is decreased, the

probability of making a Type II error is increased.

a) True

b) False

Page 34: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and powerTrue or False: In a significance test with = 0.05, if n is increased,

then the power of the test increases.

a) True

b) False

Page 35: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and power (answer)True or False: In a significance test with = 0.05, if n is increased,

then the power of the test increases.

a) True

b) False

Page 36: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and powerTrue or False: For small n, is approximately equal to 1 - .

a) True

b) False

Page 37: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and power (answer)True or False: For small n, is approximately equal to 1 - .

a) True

b) False

Page 38: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and powerTrue or False: For large n (i.e., n > 30), is approximately equal to 1 -

.

a) True

b) False

Page 39: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level and power (answer)True or False: For large n (i.e., n > 30), is approximately equal to 1 -

.

a) True

b) False

Page 40: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance levelTrue or False: In a significance test with = 0.05, if n is increased,

then increases.

a) True

b) False

Page 41: Thinking About Inference BPS chapter 15 © 2010 W.H. Freeman and Company

Significance level (answer)True or False: In a significance test with = 0.05, if n is increased,

then increases.

a) True

b) False