41
Studying Student Beliefs About Science: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys that probe We have developed and validated surveys that probe students’ beliefs about physics and chemistry and students’ beliefs about physics and chemistry and about how these subjects are learned. These surveys about how these subjects are learned. These surveys then provide a measure of students’ beliefs on a then provide a measure of students’ beliefs on a novice-to-expert scale that can be used to novice-to-expert scale that can be used to investigate the impact of teaching or relationships investigate the impact of teaching or relationships between beliefs and other educational outcomes of between beliefs and other educational outcomes of interest. These surveys are being used in courses interest. These surveys are being used in courses across North America. At the University of across North America. At the University of Colorado, we have administered these surveys to Colorado, we have administered these surveys to more than 15,000 students in over 50 courses. I more than 15,000 students in over 50 courses. I will discuss how to develop and validate such will discuss how to develop and validate such surveys, and what we have learned from them. We surveys, and what we have learned from them. We see how beliefs correlate with learning of content, see how beliefs correlate with learning of content, choice of major, and interest, and how different choice of major, and interest, and how different teaching practices impact beliefs in positive and teaching practices impact beliefs in positive and negative ways. We have also seen surprising negative ways. We have also seen surprising results with regard to the beliefs students have results with regard to the beliefs students have

Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

  • View
    219

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Studying Student Beliefs About Science:Studying Student Beliefs About Science:  their importance and what affects themtheir importance and what affects them  We have developed and validated surveys that probe students’ We have developed and validated surveys that probe students’

beliefs about physics and chemistry and about how these beliefs about physics and chemistry and about how these subjects are learned. These surveys then provide a measure subjects are learned. These surveys then provide a measure of students’ beliefs on a novice-to-expert scale that can be of students’ beliefs on a novice-to-expert scale that can be used to investigate the impact of teaching or relationships used to investigate the impact of teaching or relationships between beliefs and other educational outcomes of interest. between beliefs and other educational outcomes of interest. These surveys are being used in courses across North These surveys are being used in courses across North America.  At the University of Colorado, we have America.  At the University of Colorado, we have administered these surveys to more than 15,000 students in administered these surveys to more than 15,000 students in over 50 courses.  I will discuss how to develop and validate over 50 courses.  I will discuss how to develop and validate such surveys, and what we have learned from them.  We see such surveys, and what we have learned from them.  We see how beliefs correlate with learning of content, choice of how beliefs correlate with learning of content, choice of major, and interest, and how different teaching practices major, and interest, and how different teaching practices impact beliefs in positive and negative ways.  We have also impact beliefs in positive and negative ways.  We have also seen surprising results with regard to the beliefs students seen surprising results with regard to the beliefs students have when they enter the university, particularly in how have when they enter the university, particularly in how beliefs about chemistry and physics differ.beliefs about chemistry and physics differ.

Page 2: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

• To do: To do:

- Bring copy of chemistry and physics Bring copy of chemistry and physics statements. statements.

Page 3: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Studying Student Beliefs About Studying Student Beliefs About Science:Science:

their importance and what affects themtheir importance and what affects them

Kathy PerkinsKathy Perkins

University of Colorado at BoulderUniversity of Colorado at Boulderhttp://per.colorado.eduhttp://per.colorado.edu

http://class.colorado.eduhttp://class.colorado.edu

Page 4: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Physics Education Research GroupUniversity of Colorado

Physics faculty: Michael Dubson Noah FinkelsteinKathy PerkinsSteve PollockCarl Wieman

Postdocs: Sam McKaganLinda Koch

Ph. D. students:*Wendy Adams*Jack Barbera (chem)Mariel DesrochePat KohlLauren KostNoah PodolefskyChandra Turpen

School of Ed:Valerie Otero,Danielle Harlow*Kara Gray

Page 5: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

OutlineOutline• What do we mean by beliefs? What do we mean by beliefs?

• Measuring beliefs: Measuring beliefs: The CLASS-Phys and CLASS-Chem SurveyThe CLASS-Phys and CLASS-Chem Survey

• Importance of studying students’ beliefs:Importance of studying students’ beliefs:

– Characterizing beliefs – Chemistry and PhysicsCharacterizing beliefs – Chemistry and Physics

– Correlations between beliefs and … : Correlations between beliefs and … : • Choice of major & pursuit of studyChoice of major & pursuit of study• Changes in self-reported interestChanges in self-reported interest• (Content learning)(Content learning)

• Can we impact students’ beliefs? Can we impact students’ beliefs?

• Developing belief surveysDeveloping belief surveys

Page 6: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Beliefs about scienceBeliefs about scienceNovice

content and structure

Isolated pieces of information

Coherent framework of concepts

Handed down by authority. No connection to real world

Describes nature. Established by experiment

source

Expert

problem solving

Pattern matching to memorized recipes.

Systematic concept-based strategies. Widely applicable.

(boring, useless)

Adapted from David Hammer (Cognition and Instruction)

Think about science like a scientist.

(relevant, useful, interesting)

Page 7: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

The CLASS SurveyThe CLASS Survey(Colorado Learning Attitudes about Science Survey)(Colorado Learning Attitudes about Science Survey)

• Builds on previous work in physics by (MPEXBuilds on previous work in physics by (MPEX1 1 & VASS& VASS22))

• Main Goals: Main Goals: – Change focus from “expectations for learning in course” to Change focus from “expectations for learning in course” to

“beliefs about the discipline and learning the discipline” “beliefs about the discipline and learning the discipline” – Valid/Reliable across university populations (non-sci to majors)Valid/Reliable across university populations (non-sci to majors)– Probe additional facets of beliefs (problem solving, chem specific)Probe additional facets of beliefs (problem solving, chem specific)

• CLASS-Phys CLASS-Phys (42 statements)(42 statements) & CLASS-Chem & CLASS-Chem (50 statements)(50 statements) (39 common statements)(39 common statements)

1. Redish, E., Saul, J. M. Steinberg, R. N., (1998). 1. Redish, E., Saul, J. M. Steinberg, R. N., (1998). Amer. Journal of PhysAmer. Journal of Phys. 2. Halloun, I. E., (1996). . 2. Halloun, I. E., (1996). Proceedings Proceedings of the ICUPE. of the ICUPE.

I think about the physics I experience in everyday life.I think about the physics I experience in everyday life.

It is possible to explain physics ideas without mathematical It is possible to explain physics ideas without mathematical formulas.formulas.

Strongly DisagreeStrongly Disagree Strongly AgreeStrongly Agree1 2 3 4 51 2 3 4 5

Page 8: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

CLASS: ScoringCLASS: Scoring

I think about the physics I experience in everyday life.I think about the physics I experience in everyday life.

Strongly DisagreeStrongly Disagree Strongly AgreeStrongly Agree1 2 3 4 51 2 3 4 5

- Score ‘Overall’ % Favorable :- Score ‘Overall’ % Favorable :percentage of statements for which the student percentage of statements for which the student agreesagrees with the expert with the expert

- Score % Favorable on individual statements:- Score % Favorable on individual statements: percentage of students percentage of students agreeingagreeing with expert with expert

- Score % Favorable on categories (4-10 statements):- Score % Favorable on categories (4-10 statements): percentage of statements for which student agree with expertpercentage of statements for which student agree with expert

• Personal InterestPersonal Interest• Real World ConnectionReal World Connection• Problem Solving (PS) GeneralProblem Solving (PS) General• PS ConfidencePS Confidence• PS SophisticationPS Sophistication

• Sense Making / EffortSense Making / Effort• Conceptual ConnectionsConceptual Connections• Conceptual LearningConceptual Learning• Atomic-Molecular Perspective of Atomic-Molecular Perspective of

ChemistryChemistry

(%Unfavorable, %Neutral)(%Unfavorable, %Neutral)

CLASS-Phys: Adams et al., Physical Review ST - PER CLASS-Phys: Adams et al., Physical Review ST - PER CLASS-Chem: Barbera et al., (Submitted to JCE)CLASS-Chem: Barbera et al., (Submitted to JCE)

Page 9: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

OutlineOutline• What do we mean by beliefs? What do we mean by beliefs?

• Measuring beliefs: Measuring beliefs: The CLASS-Phys and CLASS-Chem SurveyThe CLASS-Phys and CLASS-Chem Survey

• Importance of studying students’ beliefs:Importance of studying students’ beliefs:

– Characterizing beliefs – Chemistry and PhysicsCharacterizing beliefs – Chemistry and Physics

– Correlations between beliefs and … : Correlations between beliefs and … : • Choice of major & pursuit of studyChoice of major & pursuit of study• Changes in self-reported interestChanges in self-reported interest• (Content learning)(Content learning)

• Can we impact students’ beliefs? Can we impact students’ beliefs?

• Developing belief surveysDeveloping belief surveys

Page 10: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Surveyed beliefs and choice of Surveyed beliefs and choice of majormajor• Students who choose to major in physics see Students who choose to major in physics see

physics as highly relevant and useful in everyday physics as highly relevant and useful in everyday life.life.

Elementary ed majors

Non-sci majors

Bio & Chem

Whole classmostly engineers

1st yr Phys majors

2nd yr Phys majors

1st and 2nd yr grads

0% 20% 40% 60% 80% 100%% Favorable Score (PRE)

(Calc-based Phys I)

‘Personal Interest’‘Overall’

Elementary Ed Majors Don’tElementary Ed Majors Don’t

(Alg-based Phys I)

Page 11: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Chemistry: Surveyed beliefs & choice of Chemistry: Surveyed beliefs & choice of majormajor

• Students who choose to major in chemistry see Students who choose to major in chemistry see chemistry as highly relevant and useful in chemistry as highly relevant and useful in everyday life.everyday life.

Environmental

Prep for Gen I

General I (non-majors)

Organic II (non-majors)

General I (majors)

Organic II (majors)

Physical I (Juniors-Seniors)

Chem Faculty

0 20 40 60 80 100

‘Personal Interest’‘Overall’

% Favorable Score (PRE)

Majors in same class more expert

Page 12: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Distribution of BeliefsDistribution of Beliefs

0%5%

10%15%20%25%30%35%40%45%

0 10 20 30 40 50 60 70 80 90 100‘Overall’ % Favorable (PRE)

(Percentage of statements for which student agrees w/ expert)

Pe

rce

nta

ge

of

res

po

nd

en

tsAlg-based Phys I (N=309)

Calc-based Phys I (N=389)3rd semester for phys majors (N=61)

expert-likenovice-like

Page 13: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Are we … Are we …

Creating Creating majors with majors with expert-like expert-like

beliefsbeliefs

Filtering out Filtering out those without those without pre-existing pre-existing expert-like expert-like

beliefsbeliefs

OROR ??

Page 14: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

0%

10%

20%

30%

40%

50%

60%All StudentsIntended Physics MajorsMajor in Sp07

Pe

rce

nta

ge

of

res

po

nd

en

ts

0 10 20 30 40 50 60 70 80 90 100

‘Overall’ % Favorable (PRE)

Beliefs at Beliefs at STARTSTART of Phys I of Phys I

Who from Calc-based Phys I, majors in Who from Calc-based Phys I, majors in physics? physics?

• Calc-based Phys I (Fa04-Fa05): 1306 students• “Intend to major in physics”: 85 students• Actually majoring in physics in Sp07: 18 students

Most students who end up majoring in physics, arrive at university with expert-like beliefs at the start.

Page 15: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Who from Gen Chem I, majors in chemistry? Who from Gen Chem I, majors in chemistry?

• Gen Chem I (Fa06): 567 students• “Intend to major in chemistry”: 60 students

Pe

rce

nta

ge

of

res

po

nd

en

ts

‘Overall’ % Favorable (PRE)

Beliefs at START of GEN CHEMBeliefs at START of GEN CHEM

0%

5%

10%

15%

20%

25%

30%

35%All StudentsIntended Chem Majors

0 10 20 30 40 50 60 70 80 90 100

Page 16: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Looking at Individual Statements Looking at Individual Statements

StatementsStatements Pre-favPre-fav

4. I think about the chemistry I experience in 4. I think about the chemistry I experience in everyday life. everyday life.

30%30%

29. When I see a chemical formula, I try to 29. When I see a chemical formula, I try to picture how the atoms are arranged and picture how the atoms are arranged and connected. connected.

36%36%

43. To understand chemistry, I sometimes think 43. To understand chemistry, I sometimes think about my personal experiences and relate them about my personal experiences and relate them to the topic being analyzed. to the topic being analyzed.

38%38%

6. After I study a topic in chemistry and feel that 6. After I study a topic in chemistry and feel that I understand it, I have difficulty solving problems I understand it, I have difficulty solving problems on the same topic. on the same topic.

45%45%

Gen Chem IGen Chem I

Page 17: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Surveyed Beliefs and Self-reported Surveyed Beliefs and Self-reported InterestInterest

•Students’ beliefs as measured by CLASS, and

•Self-rated interest – supplemental questions

“Currently, what is your level of interest in physics? “

(very low, low, moderate, high, very high)

“During the semester, my interest in physics…”

(increased, decreased, stayed the same)

“Why?” (Open response)

Page 18: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Surveyed Beliefs correlate with Self-reported Surveyed Beliefs correlate with Self-reported InterestInterest

0

20

40

60

80

100

0 1 2 3 4 5 6Self-rated Interest (1=Very Low; 5=Very High)

Po

st 'O

vera

ll' %

F

avo

rab

le

RawDataAverage

0

10

20

30

40

10 20 30 40 50 60 70 80 90 100Post ‘Overall’ % Favorable

(rounded to nearest 10)

# o

f s

tud

en

ts

• Calc-based Calc-based Phys I course Phys I course (N=391)(N=391)

• Students’ with Students’ with higher self-higher self-reported reported interest have interest have more expert-more expert-like beliefs.like beliefs.

• Correlation of Correlation of

R=0.65R=0.65

Very LowLow

HighVery High

Interest:

Page 19: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Chemistry: Surveyed Beliefs correlate Chemistry: Surveyed Beliefs correlate with Self-reported Interestwith Self-reported Interest

• Gen Chem I Gen Chem I Course Course (N=564)(N=564)

• Students’ with Students’ with higher self-higher self-reported reported interest have interest have more expert-more expert-like beliefs.like beliefs.

• Correlation of Correlation of

R=0.60R=0.60

0

10

20

30

40

50

60

0 10 20 30 40 50 60 70 80 90 100

# o

f s

tud

en

ts

Post ‘Overall’ % Favorable

Very LowLow

HighVery High

Interest:

0

20

40

60

80

100

0 1 2 3 4 5 6Self-rated Interest (1=Very Low; 5=Very High)

Po

st 'O

vera

ll' %

F

avo

rab

le

RawDataAverage

Page 20: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

How and ‘Why’ students’ interest How and ‘Why’ students’ interest in physics changesin physics changes

Increased No change

Decreased

19% 37% 45%

• Change in Interest :Change in Interest :% Favorable on CLASS % Favorable on CLASS shifted toward novice (-shifted toward novice (-7%)7%)

• Change in Beliefs :Change in Beliefs :

• Reasons given for ‘Why’ interest changed:Reasons given for ‘Why’ interest changed: Coded into 5 types of reasonsCoded into 5 types of reasons

- Beliefs (as probed by CLASS)Beliefs (as probed by CLASS)- Specific Aspects of InstructionSpecific Aspects of Instruction- Personal Success in CoursePersonal Success in Course- Comparison with Prior Experience (HS)Comparison with Prior Experience (HS)- Relation to Career PathRelation to Career Path

• Same course (Calc-based Phys I course; N=391)Same course (Calc-based Phys I course; N=391)

Page 21: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Spe

cific

A

spec

ts o

f In

stru

ctio

nR

elat

ion

to

Car

eer

Pla

ns

Per

sona

l S

ucce

ss

Prio

r E

xper

ienc

e

Bel

iefs

0%

20%

40%

60%

80%

100%

% o

f S

tud

ents

Calc Phys 1 (A): 19%↑ and 45%↓

Calc Phys 1 (B): 17%↑ and 39%↓

Alg Phys 1: 45%↑ and 16%↓

Reasons for Increased Interest

Reasons ‘Why’ students’ interest Reasons ‘Why’ students’ interest change change

0%

20%

40%

60%

80%

100%

0%

20%

40%

60%

80%

100%

% o

f S

tud

ents

Decreased Interest

• Over 50% of Over 50% of increased interest increased interest reasons related to reasons related to surveyed beliefssurveyed beliefs

• Top 3 belief reasons: Top 3 belief reasons: 1. Real World 1. Real World ConnectionConnection

2. Personal Interest2. Personal Interest(usefulness)(usefulness)

3. Prob. Solv. 3. Prob. Solv. ConfidenceConfidence

• Top reason for Top reason for decreased interest is decreased interest is Specific Aspects of Specific Aspects of InstructionInstruction

Page 22: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Chemistry vs Physics BeliefsChemistry vs Physics Beliefs• Comparable population; 39 matching statements; PRE-beliefsComparable population; 39 matching statements; PRE-beliefs

Biology Majors in Chem I (CLASS-Chem, N=156) Biology Majors in Chem I (CLASS-Chem, N=156) vs Biology Majors in Alg-based Phys I (CLASS-Phys, N=212)vs Biology Majors in Alg-based Phys I (CLASS-Phys, N=212)

30

40

50

60

70

80

90

100

0 10 20 30 40 50 60

Unfavorable (%)

Fav

ora

ble

(%

)

OverallReal World ConnectionConceptual ConnectionsApplied ConceptualUnderstanding

PHYS ICHEM I

• ‘‘Overall’ & 3 Overall’ & 3 categories show categories show statistically statistically significant significant differences in differences in PREPRE beliefsbeliefs

• Biology Majors Biology Majors consistently have consistently have more expert-like more expert-like beliefs about beliefs about PhysicsPhysics

Page 23: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

38. It is possible to explain [] ideas without mathematical formulas.

37. To understand [], I sometimes think about my personal experiences and relate them to the topic being analyzed.1. A significant problem in learning [] is being able to memorize all the information I need to know.

6. Knowledge in [] consists of many disconnected topics.

17. Understanding [] basically means being able to recall something you've read or been shown.

22. If I want to apply a method used for solving one [] problem to another problem, the problems must involve very similar situations.29. To learn [], I only need to memorize solutions to sample problems.

35. The subject of [] has little relation to what I experience in the real world.

26. In [], mathematical formulas express meaningful relationships among measurable quantities.

13. I do not expect [] equations to help my understanding of the ideas; they are just for doing calculations.

Chemistry vs Physics Beliefs: Individual Chemistry vs Physics Beliefs: Individual StatementsStatements

Statements

0% 40% 80%

PHYS I

CHEM I

% Favorable

0% 40% 80%% Unfavorable

Page 24: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

38. It is possible to explain [] ideas without mathematical formulas.

37. To understand [], I sometimes think about my personal experiences and relate them to the topic being analyzed.1. A significant problem in learning [] is being able to memorize all the information I need to know.

6. Knowledge in [] consists of many disconnected topics.

17. Understanding [] basically means being able to recall something you've read or been shown.

22. If I want to apply a method used for solving one [] problem to another problem, the problems must involve very similar situations.29. To learn [], I only need to memorize solutions to sample problems.

35. The subject of [] has little relation to what I experience in the real world.

26. In [], mathematical formulas express meaningful relationships among measurable quantities.

13. I do not expect equations to help my understanding of the idea in []s; they are just for doing calculations.

0% 40% 80%

PHYS I

CHEM I

% Favorable

0% 40% 80%% Unfavorable

Chemistry vs Physics Beliefs: Individual Chemistry vs Physics Beliefs: Individual StatementsStatements

Statements

Page 25: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

38. It is possible to explain [] ideas without mathematical formulas.

37. To understand [], I sometimes think about my personal experiences and relate them to the topic being analyzed.1. A significant problem in learning [] is being able to memorize all the information I need to know.

6. Knowledge in [] consists of many disconnected topics.

17. Understanding [] basically means being able to recall something you've read or been shown.

22. If I want to apply a method used for solving one [] problem to another problem, the problems must involve very similar situations.29. To learn [], I only need to memorize solutions to sample problems.

35. The subject of [] has little relation to what I experience in the real world.

26. In [], mathematical formulas express meaningful relationships among measurable quantities.

13. I do not expect [] equations to help my understanding of the ideas; they are just for doing calculations.

0% 40% 80%% Favorable

PHYS I

CHEM I

0% 40% 80%% Unfavorable

Chemistry vs Physics Beliefs: Individual Chemistry vs Physics Beliefs: Individual StatementsStatements

Statements

Page 26: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Chemistry vs Physics Beliefs: Individual Chemistry vs Physics Beliefs: Individual StatementsStatements

Why do biology majors see chemistry …. • as having less to do with the real world• as being less conceptual, needing math to explain

chemistry but not making sense of the math. • as being more about memorizing disconnected pieces of

information and sample problems,

??

Page 27: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

OutlineOutline• What do we mean by beliefs? What do we mean by beliefs?

• Measuring beliefs: Measuring beliefs: The CLASS-Phys and CLASS-Chem SurveyThe CLASS-Phys and CLASS-Chem Survey

• Importance of studying students’ beliefs:Importance of studying students’ beliefs:

– Characterizing beliefs – Chemistry and PhysicsCharacterizing beliefs – Chemistry and Physics

– Correlations between beliefs and … : Correlations between beliefs and … : • Choice of major & pursuit of studyChoice of major & pursuit of study• Changes in self-reported interestChanges in self-reported interest• (Content learning)(Content learning)

• Can we impact students’ beliefs? Can we impact students’ beliefs?

• Developing belief surveysDeveloping belief surveys

Page 28: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

OutlineOutline• What do we mean by beliefs? What do we mean by beliefs?

• Measuring beliefs: Measuring beliefs: The CLASS-Phys and CLASS-Chem SurveyThe CLASS-Phys and CLASS-Chem Survey

• Importance of studying students’ beliefs:Importance of studying students’ beliefs:

– Characterizing beliefs – Chemistry and PhysicsCharacterizing beliefs – Chemistry and Physics

– Correlations between beliefs and … : Correlations between beliefs and … : • Choice of major & pursuit of studyChoice of major & pursuit of study• Changes in self-reported interestChanges in self-reported interest• (Content learning)(Content learning)

• Can we impact students’ beliefs? Can we impact students’ beliefs?

• Developing belief surveysDeveloping belief surveys

Page 29: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Can we impact students’ beliefs Can we impact students’ beliefs through our teaching?through our teaching?

• MPEX work in Physics:MPEX work in Physics: Students’ expectations shift to be Students’ expectations shift to be moremore novice novice (decline of ~5-8% in ‘Overall’ %fav)(decline of ~5-8% in ‘Overall’ %fav)

• CLASS-Phys results at CU-Boulder:CLASS-Phys results at CU-Boulder:

-15 -10 -5 0 5 10% Favorable

-15 -10 -5 0 5 10Shift in % Favorable (Post-Pre)

OverallOverall

Calc-based Phys II (N = 218)

Alg-based Phys I (N = 128, 312, 306)

Calc-based Phys I (N = 389, 348, 398)

MORE NOVICEMORE NOVICE MORE EXPERTMORE EXPERT

Shift in % Favorable (Post-Pre)

Page 30: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

OverallOverall

Personal Personal InterestInterest

Real WorldReal WorldConnectionConnection

Problem Problem SolvingSolving

ConceptualConceptualConnectionsConnections

MORE NOVICEMORE NOVICE MORE EXPERTMORE EXPERT

-15 -10 -5 0 5 10% Favorable

Calc-based Phys II

Alg-based Phys I

Calc-base Phys I

Impact on categories of students’ beliefs Impact on categories of students’ beliefs

Shift in % Favorable (Post-Pre)

Page 31: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

What about in chemistry? What about in chemistry?

-15 -10 -5 0 5 10

OverallOverall

Personal Personal InterestInterest

Real WorldReal WorldConnectionConnection

Problem Problem SolvingSolving

Atomic-MolecularAtomic-MolecularPerspectivePerspective

% Favorable

MORE NOVICEMORE NOVICE MORE EXPERTMORE EXPERT

GenChem 1

GenChem 2

Honors Gen 1Honors Gen 2

N=298N=403N=239N=406N=21N=25

Shift in % Favorable (Post-Pre)

Page 32: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Insights and successes in Insights and successes in addressing students’ beliefsaddressing students’ beliefs

Important question: Important question:

Do students’ know Do students’ know what experts’ believe or not?what experts’ believe or not?

Page 33: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Do students’ know what physicists Do students’ know what physicists believe? believe?

Personal Score

1. A significant problem in learning physics is being able to memorize all the information I need to know.

Strongly Agree Strongly Disagree1 2 3 4 5What do YOU think?

0%

20%

40%

60%

80%

100%

% O

vera

ll fa

vora

ble

sc

ore

prepost

Personal

prepost

“Physicist”

Courses

PHYS I-Calculus

PHYS I- Algebra

PHYS of Sound

91.9% fav91.9% favPhysics facultyPhysics faculty

What would a physicist say? “Physicist” Score

Page 34: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Strategies that have helpedStrategies that have helped

ExplicitlyExplicitly attending to beliefs in attending to beliefs in allall aspects of course aspects of course• Using many real-world, everyday-life contexts Using many real-world, everyday-life contexts • Including conceptual questionsIncluding conceptual questions• Emphasizing students’ developing and Emphasizing students’ developing and explaining reasoning, e.g. using peer learning explaining reasoning, e.g. using peer learning and requiring reasoning. and requiring reasoning. • Having students explicitly discuss/explain Having students explicitly discuss/explain connections, e.g. using compare/contrast cases, connections, e.g. using compare/contrast cases, including multiple representations.including multiple representations.

CU Phys:CU Phys: Seen beliefs Seen beliefs hold steadyhold steady

CU Chem:CU Chem:Seen less Seen less regression in regression in real world, and real world, and increase in A-M increase in A-M perspectiveperspective

• Maryland PER group: Maryland PER group: Andy Elby (AJP, 2001):Andy Elby (AJP, 2001): Physics about refining intuitive ideas, e.g. Elby PairsPhysics about refining intuitive ideas, e.g. Elby Pairs

Used metacognitive questions in HW Used metacognitive questions in HW Practices to promote “learning-oriented” approach Practices to promote “learning-oriented” approach

Joe Redish:Joe Redish: includes Elby pairs, metacognitive skills (paper soon!) includes Elby pairs, metacognitive skills (paper soon!)

Page 35: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

CLASS Development: CLASS Development: Probing beliefs about scienceProbing beliefs about science

Novice

content and structure

Isolated pieces of information

Coherent framework of concepts

Handed down by authority. No connection to real world

Describes nature. Established by experiment

source

Expert

problem solving

Pattern matching to memorized recipes.

Systematic concept-based strategies. Widely applicable.

Adapted from David Hammer (Cognition and Instruction)

Page 36: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

CLASS: DevelopmentCLASS: Development- Creating statements- Creating statements

represent novice – expert differences represent novice – expert differences (how do biologists think about biology, (how do biologists think about biology, what do students say that experts would disagree to?)what do students say that experts would disagree to?)

EXAMPLES SPECIFIC TO FIELD:EXAMPLES SPECIFIC TO FIELD:

Why chemicals react the way they do does not usually make Why chemicals react the way they do does not usually make sense to me; I just memorize what happens. sense to me; I just memorize what happens.

A poem means anything I think it means.

Programming is really mostly debugging.

Page 37: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

CLASS: DevelopmentCLASS: Development- Creating statements- Creating statements

represent novice – expert differencesrepresent novice – expert differences (how do biologists think about biology, (how do biologists think about biology, what do students say that experts would disagree)what do students say that experts would disagree)

clarity of languageclarity of language use students’ voiceuse students’ voiceavoid multiple ideas in one statementavoid multiple ideas in one statementavoid “intuitive”, “theory”, “domain”, “concept”avoid “intuitive”, “theory”, “domain”, “concept”(in chem: avoid “structure”, specify “equation” and “formula” in (in chem: avoid “structure”, specify “equation” and “formula” in

chem)chem)

probe students general beliefs probe students general beliefs … … avoid course-specific beliefs avoid course-specific beliefs

“in this course ….” (also creates pre-survey issues)“in this course ….” (also creates pre-survey issues)

… … make appropriate for all levels of students make appropriate for all levels of students EXAMPLES OF MPEX STATEMENTS DROPPED OR REVISED:EXAMPLES OF MPEX STATEMENTS DROPPED OR REVISED: A good understanding of physics is necessary for me to achieve my career A good understanding of physics is necessary for me to achieve my career

goals. A good grade in this course is not enough.goals. A good grade in this course is not enough.Knowledge in physics consists of many pieces of information each of which Knowledge in physics consists of many pieces of information each of which

applies primarily to a specific situation.applies primarily to a specific situation.

Page 38: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

CLASS: DevelopmentCLASS: Development

- Testing (validating) statements- Testing (validating) statementsInterview with students (variety of levels) Interview with students (variety of levels) Collect responses from and interviews with professors (experts)Collect responses from and interviews with professors (experts)Verify that: Verify that:

1) Interpretation is clear and consistent 1) Interpretation is clear and consistent 2) Students reasoning for response consistent with response 2) Students reasoning for response consistent with response

and with novice-expertness of viewand with novice-expertness of view3) Professors have consistent response3) Professors have consistent response4) Reasonable spread among student responses4) Reasonable spread among student responses

- Conducting factor analysis to determine categories - Conducting factor analysis to determine categories need a lot of responses from a variety of students need a lot of responses from a variety of students categories emerges from student data (represent student thinking)categories emerges from student data (represent student thinking)categories are not determined by expert. categories are not determined by expert.

Page 39: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Chemistry vs Physics Beliefs: ExpertsChemistry vs Physics Beliefs: Experts

0%

20%

40%

60%

80%

100%

120%

Statements sorted by Chem Faculty %Favorable

PHYSPHYS CHEMCHEM% Favorable

% Unfavorable

Personal beliefs of Physics and Chemistry Faculty Personal beliefs of Physics and Chemistry Faculty

91.9% fav91.9% fav89.4% fav89.4% fav

Page 40: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

Fav Unfav Fav Unfav

66% 14% 63% 8%14. I cannot learn chemistry if the teacher does not explain things well in class.

71% 16% 84% 2%1. A significant problem in learning chemistry is being able to memorize all the information I need to know.

72% 12% 82% 6%9. When I solve a chemistry problem, I locate an equation that uses the variables given in the problem and plug in the values.

72% 8% 84% 3%16. I study chemistry to learn knowledge that will be useful in my life outside of school.

73% 6% 82% 3%19. Nearly everyone is capable of understanding chemistry if they work at it.

73% 16% 85% 11%45. It is possible to explain chemistry ideas without mathematical formulas.

77% 10% 87% 5%22. To understand chemistry I discuss it with friends and other students.

80% 8% 92% 3%43. To understand chemistry, I sometimes think about my personal experiences and relate them to the topic being analyzed.

PHYSPHYSCHEMCHEMChemistry vs Physics Beliefs: ExpertsChemistry vs Physics Beliefs: Experts

Page 41: Studying Student Beliefs About Science: their importance and what affects them their importance and what affects them We have developed and validated surveys

ConclusionsConclusions

http://class.colorado.eduhttp://class.colorado.edu

• CLASS probes general beliefs about physics or chemistryCLASS probes general beliefs about physics or chemistry

• Major findings: Major findings: • Majors more expert-like than non-majors from the startMajors more expert-like than non-majors from the start• Students’ level of interest correlated with beliefs Students’ level of interest correlated with beliefs

• Evidence that beliefs drive increases in interestEvidence that beliefs drive increases in interest• Biology majors: Less expert-like beliefs about chemistryBiology majors: Less expert-like beliefs about chemistry• Specifically attending to beliefs can avoid regression Specifically attending to beliefs can avoid regression