Producing Data: Experiments

BPS chapter 9

© 2010 W.H. Freeman and Company

Explanatory variablesHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What is the explanatory variable?

a) The amount of scent.

b) Presence or absence of the floral scent.

c) Time to complete the pencil and paper mazes.

d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

Explanatory variables (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What is the explanatory variable?

a) The amount of scent.

b) Presence or absence of the floral scent.

c) Time to complete the pencil and paper mazes.

d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

Response variablesHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What is the response variable?

a) The amount of scent.

b) Presence or absence of the floral scent.

c) Time to complete the pencil and paper mazes.

d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

Response variables (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What is the response variable?

a) The amount of scent.

b) Presence or absence of the floral scent.

c) Time to complete the pencil and paper mazes.

d) Whether the subject was able to complete the mazes quicker while wearing the floral-scented mask.

IndividualsHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What are the individuals?

a) The masks (floral-scented or unscented).

b) The 22 subjects.

c) The mazes.

Individuals (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

What are the individuals?

a) The masks (floral-scented or unscented).

b) The 22 subjects.

c) The mazes.

ControlHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated control/comparison by

a) Giving each subject a floral-scented and an unscented mask.

b) Randomly assigning half of the subjects to wear a floral-scented mask only and the other half to wear the unscented mask only.

c) Giving each subject two sets of mazes.

Control (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated control/comparison by

a) Giving each subject a floral-scented and an unscented mask.

b) Randomly assigning half of the subjects to wear a floral-scented mask only and the other half to wear the unscented mask only.

c) Giving each subject two sets of mazes.

RandomizationHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated randomization by

a) Randomly selecting the subjects to participate in the study.

b) Randomly assigning half of the subjects to wear the floral-scented mask and the other half to wear an unscented mask.

c) Randomly assigning the order that each subject receives the floral-scented and unscented masks.

Randomization (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated randomization by

a) Randomly selecting the subjects to participate in the study.

b) Randomly assigning half of the subjects to wear the floral-scented mask and the other half to wear an unscented mask.

c) Randomly assigning the order that each subject receives the floral-scented and unscented masks.

ReplicationHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated replication by

a) Using two masks.

b) Using two sets of mazes.

c) Using three mazes within each set.

d) Using twenty-two subjects.

e) Repeating the entire experiment a second time.

Replication (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The researchers incorporated replication by

a) Using two masks.

b) Using two sets of mazes.

c) Using three mazes within each set.

d) Using twenty-two subjects.

e) Repeating the entire experiment a second time.

VariablesHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

If age affects whether the presence of a floral scent improves learning ability and was not included among the variables studied in the experiment, then age is

a) An explanatory variable.

b) A response variable.

c) A lurking variable.

d) Confounded with floral scent.

Variables (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

If age affects whether the presence of a floral scent improves learning ability and was not included among the variables studied in the experiment, then age is

a) An explanatory variable.

b) A response variable.

c) A lurking variable.

d) Confounded with floral scent.

Experimental designHirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The experimental design used is called a

a) Completely randomized design.

b) Randomized block design.

c) Matched pairs design.

Experimental design (answer)Hirsch and Johnston from the Smell & Taste Treatment and Research

Foundation in Chicago believe that the presence of floral scent can improve a person’s learning ability in some situations. To test this hypothesis, they set up an experiment in which each of 22 subjects completed 2 sets of three pencil and paper mazes, one set while wearing a floral-scented mask. Each subject wore a floral-scented mask and an unscented mask, and the order was randomized. The researchers measured the length of time it took each subject to complete the sets of mazes.

The experimental design used is called a

a) Completely randomized design.

b) Randomized block design.

c) Matched pairs design.

Statistical significanceIf there is a statistically significant difference between the average

times to complete the mazes while wearing the floral-scented mask and the unscented mask, then the difference in average times to complete the mazes between the floral-scented mask and the unscented mask is

a) Too large to be due to chance alone.

b) Too small to be due to chance alone.

c) So large that we can reasonably attribute it to chance.

d) So small that it is likely due to chance.

Statistical significance (answer)If there is a statistically significant difference between the average

times to complete the mazes while wearing the floral-scented mask and the unscented mask, then the difference in average times to complete the mazes between the floral-scented mask and the unscented mask is

a) Too large to be due to chance alone.

b) Too small to be due to chance alone.

c) So large that we can reasonably attribute it to chance.

d) So small that it is likely due to chance.

Experimental designAn Austrian study investigated whether maintaining a surgery patient’s

body temperature close to normal by heating the patient during surgery decreases wound infection rates. Patients included in the study were undergoing colon or rectal surgery and were randomly assigned to one of two treatment groups. In the normalthermic group, patients’ core temperatures were maintained near normal 36.5 degrees Celsius. In the hypothermic group, patients’ core temperatures were allowed to decrease to about 34.5 degrees Celsius.

The design is called a

a) Completely randomized design

b) Randomized block design

c) Matched pairs design

Experimental design (answer)An Austrian study investigated whether maintaining a surgery patient’s

body temperature close to normal by heating the patient during surgery decreases wound infection rates. Patients included in the study were undergoing colon or rectal surgery and were randomly assigned to one of two treatment groups. In the normalthermic group, patients’ core temperatures were maintained near normal 36.5 degrees Celsius. In the hypothermic group, patients’ core temperatures were allowed to decrease to about 34.5 degrees Celsius.

The design is called a

a) Completely randomized design

b) Randomized block design

c) Matched pairs design

Experimental designIn the previous experiment involving patients’ temperatures, both men

and women were the patients. If the men and women were separately assigned to treatments, the design would be a

a) Completely randomized design

b) Randomized block design

c) Matched pairs design

Experimental design (answer)In the previous experiment involving patients’ temperatures, both men

and women were the patients. If the men and women were separately assigned to treatments, the design would be a

a) Completely randomized design

b) Randomized block design

c) Matched pairs design

Randomized block designIn a randomized block design, a block contains

a) Individuals that are similar with respect to the characteristic that defines the block.

b) Individuals that are assigned to the same treatment.

c) Individuals that are similar with respect to the characteristic that defines the block and that are assigned to the same treatment.

Randomized block design (answer)In a randomized block design, a block contains

a) Individuals that are similar with respect to the characteristic that defines the block.

b) Individuals that are assigned to the same treatment.

c) Individuals that are similar with respect to the characteristic that defines the block and that are assigned to the same treatment.

Randomized block designIn a randomized block design

a) All of the subjects are allocated at random among the treatments.

b) The random assignment of individuals to treatments is carried out separately within each block.

c) All the individuals within one block are randomly assigned one treatment.

Randomized block design (answer)In a randomized block design

a) All of the subjects are allocated at random among the treatments.

b) The random assignment of individuals to treatments is carried out separately within each block.

c) All the individuals within one block are randomly assigned one treatment.

Experimental designTrue or false: An advantage of the randomized block design (RBD)

over the completely randomized design (CRD) is that the RBD eliminates confounding between a lurking variable (blocking variable) and the response variable.

a) True

b) False

Experimental design (answer)True or false: An advantage of the randomized block design (RBD)

over the completely randomized design (CRD) is that the RBD eliminates confounding between a lurking variable (blocking variable) and the response variable.

a) True

b) False

Experimental designTrue or false: An advantage of the randomized block design (RBD)

over the completely randomized design (CRD) is that the RBD eliminates the variation associated with the blocking variable and makes detection of statistical significance easier.

a) True

b) False

Experimental design (answer)True or false: An advantage of the randomized block design (RBD)

over the completely randomized design (CRD) is that the RBD eliminates the variation associated with the blocking variable and makes detection of statistical significance easier.

a) True

b) False

Problems with experimentsA study claims that patients who receive surgery for intestinal cancer

live much longer after treatment than patients who are treated without surgery. However, doctors operated only on patients in relatively good condition so we cannot conclude from this study that surgery lengthens intestinal cancer patients’ lives.

This is an example of

a) Confounding.

b) A lurking variable.

c) A double-blind experiment.

d) The placebo effect.

Problems with experiments (answer)A study claims that patients who receive surgery for intestinal cancer

live much longer after treatment than patients who are treated without surgery. However, doctors operated only on patients in relatively good condition so we cannot conclude from this study that surgery lengthens intestinal cancer patients’ lives.

This is an example of

a) Confounding.

b) A lurking variable.

c) A double-blind experiment.

d) The placebo effect.

Double-blind experimentsMedical experiments are often double-blind. This means that

a) All individual data are kept confidential.

b) Neither the subject nor the doctor/administrator knows which treatment the subject receives.

c) Doctors are not allowed to decide which treatment a patient will receive; subjects are randomly assigned to treatments.

d) The subjects in the control group receive a placebo treatment.

Double-blind experiments (answer)Medical experiments are often double-blind. This means that

a) All individual data are kept confidential.

b) Neither the subject nor the doctor/administrator knows which treatment the subject receives.

c) Doctors are not allowed to decide which treatment a patient will receive; subjects are randomly assigned to treatments.

d) The subjects in the control group receive a placebo treatment.

ExperimentsAn advantage of experiments over observational studies is

a) An experiment can provide evidence of cause and effect.

b) An experiment can compare two or more groups.

c) An experiment can include explanatory and response variables.

Experiments (answer)An advantage of experiments over observational studies is

a) An experiment can provide evidence of cause and effect.

b) An experiment can compare two or more groups.

c) An experiment can include explanatory and response variables.

ExperimentsWhich of the following principles of good experimentation does an

observational study not incorporate?

a) Control or comparison

b) Random assignment to treatments

c) Replication

Experiments (answer)Which of the following principles of good experimentation does an

observational study not incorporate?

a) Control or comparison

b) Random assignment to treatments

c) Replication

Experiment vs. observational studyThe Minnesota Study of Twins Reared Apart investigated whether

similar attributes of twins are related to heredity or the influence of family environment. The researchers conducted an intense psychological and physiological assessment of 56 pairs of identical twins reared apart and several hundred identical twins reared together and compared the similarities of the twins in both groups.

Is this study an experiment or an observational study?

a) Experiment

b) Observational study

Experiment vs. observational study (answer)The Minnesota Study of Twins Reared Apart investigated whether

similar attributes of twins are related to heredity or the influence of family environment. The researchers conducted an intense psychological and physiological assessment of 56 pairs of identical twins reared apart and several hundred identical twins reared together and compared the similarities of the twins in both groups.

Is this study an experiment or an observational study?

a) Experiment

b) Observational study