36
Pattern Matching Pattern Matching for for Construct Validity Construct Validity

Pattern Matching for Construct Validity. The Pattern-Matching Model - Theories - Ideas - Hunches - Theories - Ideas - Hunches

Embed Size (px)

Citation preview

Pattern Matching Pattern Matching for for

Construct ValidityConstruct Validity

Pattern Matching Pattern Matching for for

Construct ValidityConstruct Validity

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories

- Ideas- Ideas- Hunches- Hunches

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories- Ideas- Ideas- Hunches- Hunches

Conceptualization taskConceptualization task

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories- Ideas- Ideas- Hunches- Hunches

Theoretical patternTheoretical pattern

Conceptualization taskConceptualization task

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories- Ideas- Ideas- Hunches- Hunches

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

- Observations- Observations- Data- Data

- Measures- Measures

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories- Ideas- Ideas- Hunches- Hunches

- Observations- Observations- Data- Data- Measures- Measures

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

- Observations- Observations- Data- Data

- Measures- Measures

Data OrganizationData Organization

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model

- Observations- Observations- Data- Data- Measures- Measures

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

- Observations- Observations- Data- Data- Measures- Measures

Patternmatching

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model

- Observations- Observations- Data- Data- Measures- Measures

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Th

eor e

tica

Th

eore

tica

llR

ealm

Rea

lm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

The Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching ModelThe Pattern-Matching Model- Theories- Theories

- Ideas- Ideas- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleT

heo

r eti

caT

heo

reti

call

Rea

lmR

ealm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleT

heo

r eti

caT

heo

reti

call

Rea

lmR

ealm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleT

heo

r eti

caT

heo

reti

call

Rea

lmR

ealm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

Concept MapConcept Map

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleT

heo

r eti

caT

heo

reti

call

Rea

lmR

ealm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

Concept MapConcept Map

- Arithmetic?- Arithmetic?- Geometry?- Geometry?- Reading?- Reading?

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching Example

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

Th

eor e

tica

Th

eore

tica

llR

ealm

Rea

lm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

Concept MapConcept Map

- Arithmetic?- Arithmetic?- Geometry?- Geometry?- Reading?- Reading?

Data AnalysisData Analysis

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching Example

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

Th

eor e

tica

Th

eore

tica

llR

ealm

Rea

lm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

Concept MapConcept Map

- Arithmetic?- Arithmetic?- Geometry?- Geometry?- Reading?- Reading?

Data AnalysisData Analysis

Observed PatternObserved Pattern

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching Example

- Arithmetic- Arithmetic- Geometry- Geometry- Reading- Reading

Th

eor e

tica

Th

eore

tica

llR

ealm

Rea

lm

Ob

serv

ati o

na

Ob

serv

ati o

na

llR

ealm

Rea

lm

Patternmatching

- Theories- Theories- Ideas- Ideas

- Hunches- Hunches

Conceptualization taskConceptualization task

Theoretical patternTheoretical pattern

Observed PatternObserved Pattern

Data OrganizationData Organization

- Observations- Observations- Data- Data

- Measures- Measures

Concept mappingConcept mapping

Concept MapConcept Map

- Arithmetic?- Arithmetic?- Geometry?- Geometry?- Reading?- Reading?

Data AnalysisData Analysis

Observed PatternObserved Pattern

Patternmatch r

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Test questionsTest questions

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Closer if Closer if moremore similar similar

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Farther if Farther if lessless similar similar (low distance means (low distance means

moremore similar) similar)

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Farther if Farther if lessless similar similar (low distance means (low distance means

moremore similar) similar)

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Farther if Farther if lessless similar similar (low distance means (low distance means

moremore similar) similar)

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet High interitem High interitem

correlation means correlation means moremore similar. similar.

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Matrix of Matrix of inter-point inter-point distancesdistances

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Matrix of Matrix of inter-point inter-point distancesdistances

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Matrix of Matrix of inter-point inter-point distancesdistances

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

A Patter- Matching ExampleA Patter- Matching ExampleA Patter- Matching ExampleA Patter- Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Arithmetic

Geometry

Algebra

Reading

Spelling

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

Patternmatch r

12

34

5

12

34

5

3Scan a m

ultitude of in

formation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and decide

what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

Patternmatch r

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

PatternMatch r

PairPair DistanceDistance1,21,2 .342.3421,31,3 .457.457...... ......

n,n-1n,n-1 3.2413.241

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

PatternMatch r

PairPair DistanceDistance1,21,2 .342.3421,31,3 .457.457...... ......

n,n-1n,n-1 3.2413.241

ItemsItems CorrelationCorrelation1,21,2 .92.921,31,3 .89.89...... ......

n,n-1n,n-1 .03.03

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

PatternMatch r

PairPair DistanceDistance1,21,2 .342.3421,31,3 .457.457...... ......

n,n-1n,n-1 3.2413.241

ItemsItems CorrelationCorrelation1,21,2 .92.921,31,3 .89.89...... ......

n,n-1n,n-1 .03.03

r = -.93

A Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleA Pattern-Matching ExampleTheoreticalTheoretical

realmrealm

ObservationalObservationalrealmrealm

Matrix of Matrix of inter-point inter-point distancesdistances

Matrix of Matrix of inter-iteminter-item

correlationscorrelations

Patternmatch r

PairPair DistanceDistance1,21,2 .342.3421,31,3 .457.457...... ......

n,n-1n,n-1 3.2413.241

ItemsItems CorrelationCorrelation1,21,2 .92.921,31,3 .89.89...... ......

n,n-1n,n-1 .03.03

r = -.93

Estimate ofEstimate ofconstruct validityconstruct validity

Why Does Pattern Matching Work?Why Does Pattern Matching Work?Why Does Pattern Matching Work?Why Does Pattern Matching Work?

Theoretical pattern is like a Theoretical pattern is like a fingerprintfingerprint -- more -- more detail is better, if you can match it to reality.detail is better, if you can match it to reality.

If you find a match If you find a match to a detailed theoretical to a detailed theoretical pattern, it provides evidence for your theory.pattern, it provides evidence for your theory.

The more detail, the The more detail, the less likely there are less likely there are alternative explanations alternative explanations (threats) to construct (threats) to construct validity.validity.

Disadvantages of Pattern MatchingDisadvantages of Pattern MatchingDisadvantages of Pattern MatchingDisadvantages of Pattern Matching

Requires a Requires a detaileddetailed conceptual conceptual frameworkframework

Requires that theoretical and observed Requires that theoretical and observed patterns are patterns are structured the samestructured the same

Advantages of Pattern MatchingAdvantages of Pattern MatchingAdvantages of Pattern MatchingAdvantages of Pattern Matching

More More generalgeneral and and flexibleflexible than MTMM than MTMM Yields an overall Yields an overall estimateestimate of construct of construct

validityvalidity RequiresRequires you to specify what you think you to specify what you think

about the constructsabout the constructs Treats convergence and discrimination Treats convergence and discrimination

as a as a continuumcontinuum