Transcript
Page 1: SURFing with Statistics New Zealand

SURFing with Statistics New Zealand

Nathaniel Pihama and Deborah Brunning

Statistics New Zealand

Statistics Teachers' Day30 November 2007

Page 2: SURFing with Statistics New Zealand

What you will see today

• SURF for Schools

• The Statistics New Zealand website

• Table Builder

..and some ideas on how to use them!

Page 3: SURFing with Statistics New Zealand

The First SURF: a Synthetic Unit Record File for Schools

Page 4: SURFing with Statistics New Zealand

Overview:

• Confidentiality – Big Picture

• SURF???– What is it?– How and why did we make a SURF?

• What teachers and students can do with the SURF

Page 5: SURFing with Statistics New Zealand

What is a Unit Record File?

Other names• Data set• Unit Record Data set• Microdata

Example: A Dataset:Name Gender No.Sibs Age;yrsAmy F 1 14Ben M 2 13Cher F 1 15

Page 6: SURFing with Statistics New Zealand

Confidentiality

Safe

UnsafeUseless Useful

The pocket

Raw dataset

Non release

Page 7: SURFing with Statistics New Zealand

Confidentialised Unit Record Files

Confidentiality methods include:Categorical Data• Global recoding• Local recoding

• Numerical Data • top/bottom coding, • capping,• rounding,

Before Top and Bottom Coding

0

2

4

6

8

0 10 20 30 40 50 60 70 80 90

Salary: k$/yr

FreqAfter Top and Bottom Coding

0

2

4

6

8

0 10 20 30 40 50 60 70 80 90

Salary: k$/yr

Freq

Page 8: SURFing with Statistics New Zealand

What is the SURF?

• Data from 200 synthetic respondents.

• Target population is those aged 15-45 in paid employment.

• 7 variables

Page 9: SURFing with Statistics New Zealand

personid gender

qualification age hours income marital ethnicity

1 female school 15 4 87 never european

2 female vocational 40 42 596 married european

3 male none 38 40 497 married maori

4 female vocational 34 8 299 never european

5 female school 45 16 301 married european

6 male degree 45 50 1614 married european

7 female none 36 12 201 other european

What does the SURF look like?

The first 7 of 200 complete unit records

Page 10: SURFing with Statistics New Zealand

SURF- the variables

Page 11: SURFing with Statistics New Zealand

How to start SURFing?• The gender gap (Level 3 and 4)

» Do more females have higher qualifications than males?

» Is this different from how it was in the past?

• Am I average? (Level 4) » What defines the average person?

• Under pressure? (Level 5)» Are people who have never been married different

from married people?

• Equal Pay! (Level 6) » Are males and females paid equally?

• Money for nothing (Level 7) » Investigating hours worked by employees in a

company• Should I do a degree? (Level 8)

» Investigation into whether getting a degree helps improve earning power

http://www.stats.govt.nz/schools-corner

Page 12: SURFing with Statistics New Zealand

• A large company is concerned that it has too many employees who do not work a 40-hour week.

• You have been hired to investigate the working patterns of the employees.

Task -Money for Nothing

Page 13: SURFing with Statistics New Zealand

Further Analysis- Hours by Gender

SURF CURF

Page 14: SURFing with Statistics New Zealand

Related variables – Hours by Marital Status

SURF CURF

Page 15: SURFing with Statistics New Zealand

Related variables – Hours by Age GroupSURF CURF

Page 16: SURFing with Statistics New Zealand

How ‘school friendly’ is SURF????

• SURF Excel spreadsheet

• Records are in random order – First 30 records could be used for manual

data analysis

• Use ExcelHow???????

Page 17: SURFing with Statistics New Zealand

Add Age_10 variable

Add random numbers (then paste special as values)

An example of how to take a stratified sample

Page 18: SURFing with Statistics New Zealand

Use filter – copy and paste records

Sort on random numbers

Page 19: SURFing with Statistics New Zealand

Filter function

Page 20: SURFing with Statistics New Zealand

Pivot Tables

Page 21: SURFing with Statistics New Zealand

Pivot Tables

Page 22: SURFing with Statistics New Zealand

Box plots !!!!

QUARTILE functionSORT by Marital

Page 23: SURFing with Statistics New Zealand

Regression and Residuals• Trend line in a scatter plot

– Good for quick visual check

– Provides equation & R-sq

– But no residuals

• Plot the data (XY scatter)

(tidy plot up)

• Add TrendlineChart menu > Add trendline

Options tab

y = 17.058x + 0.3487

R2 = 0.6323

0

200

400

600

800

1000

1200

1400

1600

1800

2000

0 20 40 60 80

Hours

Inco

me

Page 24: SURFing with Statistics New Zealand

Regression and Residuals

• Using Excel functions

– SLOPE(), INTERCEPT(), RSQ()

Copy cell ref into formula bar

Page 25: SURFing with Statistics New Zealand

Regression and Residuals- Easy to create predicted values and residuals

(can copy formula and use $)

Page 26: SURFing with Statistics New Zealand

Regression and Residuals- Plot the residuals

-600

-400

-200

0

200

400

600

800

1000

1200

Hours

Res

idu

als

Page 27: SURFing with Statistics New Zealand

The Statistics New Zealand Website

Page 28: SURFing with Statistics New Zealand
Page 29: SURFing with Statistics New Zealand
Page 30: SURFing with Statistics New Zealand

Stats NZ Products and Services• Schools Corner

– Full of resources based on the curriculum.

• Information releases – Hot Off the Press – Full of highlights, commentary, technical notes and tables!

• New Zealand in Profile– Quick stats of New Zealand for 2007

• Analytical reports– Contain in depth analysis, background and technical

information

• Table Builder– Customisable tables of released survey data

Page 31: SURFing with Statistics New Zealand
Page 32: SURFing with Statistics New Zealand
Page 33: SURFing with Statistics New Zealand
Page 34: SURFing with Statistics New Zealand
Page 35: SURFing with Statistics New Zealand

Stats NZ Products and Services• Schools Corner

– Full of resources based on the curriculum.

• Information releases – Hot Off the Press – Full of highlights, commentary, technical notes and tables!

• New Zealand in Profile– Quick stats of New Zealand for 2007

• Analytical reports– Contain in depth analysis, background and technical

information

• Table Builder– Customisable tables of released survey data

Page 36: SURFing with Statistics New Zealand
Page 37: SURFing with Statistics New Zealand

Stats NZ Products and Services• Schools Corner

– Full of resources based on the curriculum.

• Information releases – Hot Off the Press – Full of highlights, commentary, technical notes and tables!

• New Zealand in Profile– Quick stats of New Zealand for 2007

• Analytical reports– Contain in depth analysis, background and technical

information

• Table Builder– Customisable tables of released survey data

Page 38: SURFing with Statistics New Zealand
Page 39: SURFing with Statistics New Zealand

Stats NZ Products and Services• Schools Corner

– Full of resources based on the curriculum.

• Information releases – Hot Off the Press – Full of highlights, commentary, technical notes and tables!

• New Zealand in Profile– Quick stats of New Zealand for 2007

• Analytical reports– Contain in depth analysis, background and technical

information

• Table Builder– Customisable tables of released survey data

Page 40: SURFing with Statistics New Zealand

Battle for the ‘greener suburb’:

an example of using case data from Table Builder

Page 41: SURFing with Statistics New Zealand

• Problem – the statement of the research questions

• Plan – planning the procedures used to carry out the study

• Data – the data collection process

• Analysis – the summaries and analyses of the data to answer the questions posed

• Conclusion – the conclusions about what has been learned.

The statistical investigation cycle:(Wild and Pfannkuch, 1999)

Page 42: SURFing with Statistics New Zealand

Battle for the ‘greener suburb’:an example of using case data

• Comparing the ‘traveling to work’ habits of area units within Auckland.

• Which area has the ‘greener’ workers?– Walking / Running / Cycling

– Public transport

– Carpooling?

– Working at home?

Page 43: SURFing with Statistics New Zealand

Battle for the ‘greener suburb’:where to find the data

• We want a data source that contains information about modes of travel to work by area units.

• Luckily, we have the 2006 Census of Population and Dwellings on Table Builder!

   

Page 44: SURFing with Statistics New Zealand
Page 45: SURFing with Statistics New Zealand
Page 46: SURFing with Statistics New Zealand
Page 47: SURFing with Statistics New Zealand
Page 48: SURFing with Statistics New Zealand
Page 49: SURFing with Statistics New Zealand
Page 50: SURFing with Statistics New Zealand
Page 51: SURFing with Statistics New Zealand
Page 52: SURFing with Statistics New Zealand
Page 53: SURFing with Statistics New Zealand
Page 54: SURFing with Statistics New Zealand
Page 55: SURFing with Statistics New Zealand
Page 56: SURFing with Statistics New Zealand
Page 57: SURFing with Statistics New Zealand

• So this is some of what Statistics New Zealand has to offer for teachers.

• Do you know about: – Statzing?– CensusAtSchool?– Statistics and Research?


Recommended