52
By Hui Bian Office for Faculty Excellence 1

By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Embed Size (px)

Citation preview

Page 1: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

By Hui BianOffice for Faculty Excellence

1

Page 2: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Repeated measures ANOVA with SPSSOne-way within-subjects ANOVA with SPSSOne between and one within mixed design

with SPSSRepeated measures MANOVA with

SPSSHow to interpret SPSS outputs

How to report results

2

Page 3: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

When the same measurement is made several times on each subject or case, such asSame group of people are pretested and

post-tested on a dependent variable.Comparing the same subjects under

several different treatments.Interested in the performance trends over

time: is it linear, quadratic, or cubic?

3

Page 4: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Between and within factorsBetween factors: a grouping or classification

variables such as sex, age, grade levels, treatment conditions etc.

Within factors: is the one with multiple measures from a group of people such as time.

4

Page 5: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

AssumptionsIndependence of the observations

Violation is seriousMultivariate normality

Fairly robust against violationSphericity

Not necessary for the multivariate approachThe variance-covariance matrices are the

same across the cells formed by the between-subjects effects.

5

Page 6: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

A simplest designOne within-subjects factorOne dependent variableA group of subjects measured at different

points in time

6

Page 7: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Example: sample is from high school students.Research questions:

1. whether there is a significant change on frequency of drinking over time (3 months) before and after treatment;

2. whether the relationship between the within factor (time) and frequency of drinking is linear, quadratic, or cubic.

Within-subjects factor: time. Dependent variable: frequency of drinking (a28

and b28).Two-time points data: a28 means baseline and b28

means 3-month posttestTwo conditions: before treatment and after

treatment7

Page 8: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

The design

8

Page 9: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Select Intervention group as our sampleGo to Data Select Cases Check If conditions…Then click If

9

Page 10: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Let Conditions = 1Then click Continue

10

Page 11: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Run Repeated Measures analysisAnalyze General Linear Model

Repeated MeasuresType Time as Within-Subject Factor Name,

type 2 as Number of Levels, then click AddType dv1 as Measure Name (dv means

dependent variable), then click Add

11

Page 12: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Then click Define

12

Page 13: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

After Define you should get this windowMove a28 to (1, dv1)Move b28 to (2, dv2)

13

Page 14: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

We don’t have any between-subjects factorsClick Options to get this

14

Check Compare main effects even we have two levels for within-subjects factor. I just want to show the pair comparison function.

Page 15: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Click Plots to get this window

15

Page 16: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsDescriptive statistic results

16

Page 17: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsWithin-subjects effect: results of two tables are

same.

17

Page 18: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

18

Correction options include Geenhouse-Geisser, Huyn-Feldt, and Lower-bound when sphericity is not assumed. They produce more

conservative estimates.

Page 19: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsWithin-subjects effect: if there is no

homogeneity of dependent variable covariance matrix, the Sphericity is not assumed. We should use the correction options.

19

Page 20: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsThe mathematical properties underlying the

relationship between within-subjects factor and dependent variable.

20

Test linear component of Time

effect The linear component is not significant

Page 21: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPlot

21

Page 22: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

22

Quadratic

Cubic

Page 23: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPairwise comparisons: the within-subjects

factor only has two levels. So we get the same results as multivariate tests table shows.

23

Page 24: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

ResultsOne-way within-subjects ANOVA was

performed to test whether there was a difference of frequency of drinking between before-treatment and after-treatment conditions. The observed F value was not statistically significant, F(1, 136) = .42, p = .52, partial η2 = .003, which indicated no difference of frequency of drinking over time.

24

Page 25: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Two-way mixed designTwo independent factors: one is a between-

subjects factor and one is a within-subjects factor

One dependent variable.Tests null hypotheses about the effects of both

the between-subjects factor and within-subjects factor.

Tests the effect of interactions between factors.

25

Page 26: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Example:Research questions:

whether there is a significant change on frequency of drinking over time (3 months) between intervention and control group.

Within-subjects factor: time.Between-subjects factor: conditions

(intervention vs. control).Dependent variable: frequency of drinking (a28

and b28).Two-time points data: a28 means baseline and

b28 means 3-month posttest

26

Page 27: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

The design

27

Page 28: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Run repeated measures analysisSelect all casesGo to Analyze General Linear Model

Repeated MeasuresThe same procedure to define the within-

subjects factor and dependent variable.Move Conditions to…

28

Page 29: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Click OptionsClick Plots

29

Page 30: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsMultivariate tests

30

Page 31: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsEstimated marginal means

31

Page 32: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPlots

32

Page 33: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

ResultsThe intervention effect was analyzed using

repeated measures ANOVA. There was no statically significant difference between intervention and control group over time on frequency of drinking, F(1,285) = .90, p = .34, partial η2 = .003.

33

Page 34: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

ExampleResearch questions:

whether there is a significant change on drinking behaviors over time (3 months) between intervention and control groups; or whether there is an intervention effect on drinking behaviors.

Within-subjects factor: time.Between-subjects factor: conditions (two levels)Dependent variables: frequency of drinking

(a28 and b28), quantity of drinking (a31 and b31), and heavy drinking (a34 and b34).

Two-time points data: baseline and posttest

34

Page 35: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Run repeated measures analysisGo to Analyze General Linear Model

Repeated MeasuresWe have three dependent variablesStill one within-subjects factorClick Define

35

Page 36: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Move a28/b28, a31/b31, and a34/b34 to…

36

Page 37: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Options and Plots

37

Page 38: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsMultivariate tests

38

Page 39: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsWithin-subjects effects

39

Page 40: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsUnivariate tests

40

Page 41: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsEstimated marginal means

41

Page 42: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPlots: dv1 (frequency of drinking)

42

Page 43: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPlots: dv2 (quantity of drinking)

43

Page 44: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputsPlots: dv3 (heavy drinking)

44

Page 45: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

ResultsRepeated measures MANOVA test was

conducted to test intervention effect on drinking behaviors. The results showed there was no difference between intervention and control group on frequency, quantity, and heavy drinking over time, F(3, 283) = 1.18, p = .32, η2 = .01. Univariate tests also indicated there was no intervention effect on individual drinking behavior, F(1, 285) = .90, p = .34, η2 = .003 for frequency, F(1, 285) = .67, p = .41, η2 = .002 for quantity, and F(1, 285) = .39, p = .53, η2 = .001 for heavy drinking.

45

Page 46: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Example (planned comparisons)One within-subjects factor: timeOne between-subjects factor: living condition

(11r)One dependent variable: frequency of drinking

(a28 and b28)

46

Page 47: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Contrasts are used to test for differences among the levels of a between-subjects factor.

Go to Analyze General Linear Model Repeated Measures

The same procedure to define within-subjects factor and dependent variable

Click Contrasts

47

Page 48: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

You should get the left windowChoose Simple (simple means compares the

mean of each level to the mean of a reference).

48

Pull down

Page 49: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Decide which category of between-subjects factor is a reference category.

The between-subjects factor is a11r: 1= Mother and father; 2 = Mother and stepfather; 3 = Mother; 4 = Others.

Use 1 = Mother and father as a reference.

49

Check First, then click Change

Page 50: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

SPSS outputs

50

Page 51: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

Meyers, L. S., Gamst, G., & Guarino, A. J. (2006). Applied multivariate research: design and interpretation. Thousand Oaks, CA: Sage Publications, Inc.

Stevens, J. P. (2002). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

51

Page 52: By Hui Bian Office for Faculty Excellence 1. Repeated measures ANOVA with SPSS One-way within-subjects ANOVA with SPSS One between and one within mixed

52