56
International Science and Engineering Fair May 10, 2010 Thoughts Examples Example 1 Q & A Importance of Statistics in Scientific Research Christopher J. Malone, PhD Winona State University, Winona, MN Email: [email protected]

Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Importance of Statistics in Scientific Research

Christopher J. Malone, PhDWinona State University, Winona, MNEmail: [email protected]

Page 2: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Hypothesis

Page 3: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Hypothesis

Force

Page 4: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Hypothesis

Force

Oops, backwards

Page 5: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Hypothesis

ForceHigh School Project

Page 6: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Hypothesis

ForceTheory

High School Project

Page 7: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

Page 8: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

Page 9: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

Page 10: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

Page 11: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

Page 12: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

Forcemass speed

Page 13: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

160043604410

Page 14: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

43604410

160043604410 *

Slush is most

dangerous

Page 15: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

43604410

160043604410 *

Slush is most

dangerousRight?

Page 16: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

43604410

160043604410*

15904390 * 4380

2nd Trial

Page 17: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

The Experiment

43604410

160043604410*

15904390 * 4380

2nd Trial

Yea, but

Page 18: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExample 1

HollywoodVersion

436044104410*

Page 19: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Measurement details should be in research plan › What are you going to measure?› How are you going to measure?

› Measurement issues go beyond identification of independent and dependent variables

› Outcomes must be measurablee.g. “I will identify the day the plant wilts” is not

precise; carefully measuring soil moisture over time is much better

Page 20: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Numerical measurements are generally better than categorical measurements; however, avoid changing data types

Categorical Now, numerical

Page 21: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Numerical measurements are generally better than categorical measurements; however, avoid changing data types

› Why? Averages, Standard Deviations, Correlations, etc.

Categorical Now, numerical

Page 22: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Comparing Averages…

Averages0.670.50

Page 23: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Comparing Averages…

Averages0.670.50

0.000.50

Page 24: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Measurement issues/concerns are often overlooked› The necessity of precision in measurements cannot be

overstated

Page 25: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Measurements

Thoughts

› Measurement issues/concerns are often overlooked› The necessity of precision in measurements cannot be

overstated

› _

Page 26: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

Page 27: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› How good is my shot?

Page 28: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› How good is my shot?

Page 29: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› How good is my shot?

Page 30: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› Replication allows us to estimate the error due to variables that are not under our control (i.e. noise)

Page 31: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› Replication allows us to estimate the error due to variables that are not under our control (i.e. noise)

› Which in turn allows us to measure and possibly attribute an observed outcome to the variables that areunder our control (i.e. effect)

Page 32: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Replication

Thoughts

› Generally speaking, more is better› May be necessary to balance replication and precision

› Replication allows us to estimate the error due to variables that are not under our control (i.e. noise)

› Which in turn allows us to measure and possibly attribute an observed outcome to the variables that areunder our control (i.e. effect)

› _

Page 33: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Usually inappropriate to display raw data, especially for high school projects

Page 34: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Usually inappropriate to display raw data, especially for high school projects

Page 35: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Usually inappropriate to display raw data, especially for high school projects

› Bar charts should only be used for tallys, not for numerical measurements (including averages)

Page 36: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Bar charts should only be used for tally’s, not for numerical measurements (including averages)

Page 37: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Usually inappropriate to display raw data, especially for high school projects

› Bar charts should only be used for tally’s, not for numerical measurements (including averages)

› Bring back the dot plots! › Simple to construct and easy to read› Stack them to compare groups

Page 38: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Bring back the dot plots!

Page 39: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Bring back the dot plots!

Page 40: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Bring back the dot plots!

Adding Averages, v 1 Adding Averages, v 2

Page 41: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Generally speaking…› Excel is less than optimal for constructing displays› Numerical data require numerical data displays

› Compute change for paired measurements

Page 42: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Generally speaking…› Excel is less than optimal for constructing displays› Numerical data require displays for numerical data

› Compute change for paired measurements

Page 43: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Generally speaking…› Excel is less than optimal for constructing displays› Numerical data require displays for numerical data

› Compute change for paired measurements› % change may be necessary at times

› Scatter plots tend to be under utilized

Page 44: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› Generally speaking…› Excel is less than optimal for constructing displays› Numerical data require displays for numerical data

› Compute change for paired measurements› % change may be necessary at times

› Scatter plots tend to be under utilized

Your summaries and displays should support your story.

Page 45: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

Summaries and Displays

Thoughts

› _

160043604410

Page 46: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

The Statistical Chapter of your Story

Thoughts

› These elements will give statistics an opportunity to help tell your story› Good experimental design techniques› The collection of precise and error free

measurements› The use of appropriate statistical methods› Interpretations that are meaningful and given within

context

Page 47: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

The Statistical Chapter of your Story

Thoughts

› Borrow ideas and concepts from others › e. g. Marketing› e. g. What are the important elements of an

effective persuasive speech? -Learn from Jack Franchetti @ 10:00AM tomorrow…

Page 48: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

The Statistical Chapter of your Story

Thoughts

› Borrow ideas and concepts from others › e. g. Marketing› e. g. What are the important elements of an

effective persuasive speech? -Learn from Jack Franchetti @ 10:00AM tomorrow…

› In the end, your story may be different than your original hypothesis.

› Many of the young scientists here are not presenting their original hypothesis.

› This is indeed the essence of the scientific method!

Page 49: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

› Compliments of Wendy Greenberg, Biology Department, Bemidji State University

› Set-up: 1. Play game 5 times with sound,

then 5 times without sound2. Measurement: Score3. Issues???

Examples

Example #1 (Video Games and Sound)

Page 50: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & A

› Compliments of Wendy Greenberg, Biology Department Bemidji State University

› Set-up: 1. Play game 5 times with sound,

then 5 times without sound2. Measurement: Score3. Issues???

Note: Student recognized issue of potential improvement due to learning, but his solution was to switch the order!

Examples

Example #1 (Video Games and Sound)

Page 51: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExamples

Example #2 (Influencing the color of a flower)› My hypothesis: Does colored water change the color of a

flower?

› Set-up: 1. What should I measure?2. The type of flower is irrelevant to me, but I will use a

rose and tulip for my experiment. 3. Do I need a control? Why or why not?4. I have room for 16 planting pots in my lab.

Page 52: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExamples

Example #2 (Influencing the color of a flower)› Sketching an appropriate randomization plan

Page 53: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExamples

Example #2 (Influencing the color of a flower)› The Data

Page 54: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AExamples

Example #2 (Influencing the color of a flower)› The averages

Page 55: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AQ & A

Q & A Session

Page 56: Importance of Statistics in Scientific Researchcourse1.winona.edu/cmalone/Promotion/Presentations/Importance o… · International Science and Engineering Fair May 10, 2010 Example

International Science and Engineering FairMay 10, 2010

Thoughts ExamplesExample 1 Q & AQ & A

Thank you!

Chris MaloneWinona State University

Email: [email protected]