Cross-national surveys The example of the European surveys The example of the European ... topic survey? Monitor fieldwork ... waste money. privacy

Cross-national surveys
The example of the European Social Survey
Ineke Stoop

www.europeansocialsurvey.org Kaunas, October 2015
Content
What is the ESS? Aims History Organisation
Content Methodology Other assets
http://www.europeansocialsurvey.org/

What is the ESS?

Key facts
Attitudes, values and beliefs Biennial (start 2002) Face-to-face 60+ minutes 30+ European countries Effective sample size 1500
Compare across countries and over time Implement best practices and improve fieldwork methods and survey methodology Everything publicly available Data Documentation

ESS top data user countries (>100) (August 2015) (N=82,933)
0 1000 2000 3000 4000 5000 6000 7000 8000 9000Mexico
BrazilIran
IndiaLuxembourg
JapanKorea
CyprusCroatia
PhilippinesLatvia
AustraliaChina
IcelandBulgariaSlovakia
LithuaniaCanada
RomaniaTurkey
Czech RepublicIsrael
GreeceUkraineEstoniaRussia
IrelandHungaryFinland
SwedenPortugal
AustriaDenmark
SwitzerlandFrance
ItalyPoland
SloveniaNorway
SpainUnited States
NetherlandsUnited Kingdom
BelgiumGermany

What is the ESS? Aims

Aims ESS To monitor and
interpret public attitudes and values within Europe and to investigate how they interact with Europes changing institutions
To advance and consolidate improved methods of cross-national survey measurement in Europe and beyond

What is the ESS? History

History
Beliefs in government Steering group European Science Foundation Central funding EU Framework Programmes Fieldwork funded by research councils First round 2002 ESS-European Research Infrastructure Consortium in 2013 Central funding and fieldwork funding by research councils/ministries

What is the ESS? Organisation

Organisation
General Assembly (member states) Headquarters (London): Director Core Scientific Team (SCP) FinCom Scientific Advisory Board (SAB) Methods Advisory Board (MAB) National Coordinators Forum Working groups (sampling expert panel, fieldwork questionnaire group, website editorial board, )

Time schedule 1 round
Rotating modules
Survey agency
Source question
-naire
Sample design
Field-work
design
Trans-lation, pretest
Field-work
Data prepara-
tion
Data delivery
Edits and
harmoni-sation
Data release
Quality reports

Content

Content questionnaires ESS Every round
Socio-demo-graphic items household composition education housing occupation social structure
Attitudes and behaviour patterns religious affiliation and identity ethnic and national identity political and social trust party affiliation and voting
behaviour media consumption value orientations social exclusion
Round specific R1 Immigration
Citizenship, involvement and democracy R2 Family, work and well-being
Opinions on health and care-seeking Economic Morality
R3 Personal & Social Well-being The Timing of Life
R4 Ageism Welfare attitudes
R5 Family, work and well-being in times of economic recession
Trust in police and courts R6 Personal & Social Well-being
Understanding, evaluation democracy R7 Immigration
Social inequalities in health R8 Climate change
Welfare attitudes

Rotating modules: call for proposals
Questions from scientific community Tested measures with proven explanatory value in national settings Appropriateness to academic and policy needs Suitability for multicultural and multinational measurement Call Round 9 open until 11 January 2016

Methodology

Methods
Central coordination Specifications Questionnaire Design Monitoring Procedures Guidelines Rules
National implementation National budgets Fieldwork organisation/country National coordinator (NC) CST-NC-Project manager-Field director-Interviewers
Quality
Consis-tency over
time
Compara-bility
across countries

Main methodological issues Representing the populations
Sampling: differing sampling frames, pre-specified minimal effective sample size Nonresponse bias Participation related to
topic survey?
Monitor fieldwork Contact forms
Representing the concepts
Questionnaire design process Link to theory Ensure functional equivalence Extensive pre-testing Cognitive testing Maximise reliability and validity Translation

Data collection in ESS 5 (presentation Achim Koch)

Countries and survey organisations

PAPI vs. CAPI

Day and time of interview
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
SE FI DK NL CH NO DE UK FR BE CZ HU IL SI PL ES PT RU BG
%weekend
%wkday_ev
% wkday_ma

Length of fieldwork period
< 4 months: 6 (out of 20) countries < 5 months: 10 (out of 20) countries
0
50
100
150
200
250
CZ HU BG SI ES FI PL DK DE RU IL SE NO PT CH FR UK NL BE EE
days

Interviews per week
30 14 25 7 21
19 33 17 16 25
26 8 23 27 24
19 20 21 22 16
(figures = length of fieldwork in weeks)

Fieldwork period
End fieldwork by December: 2 (out of 20) countries End fieldwork by January: 4 (out of 20) countries
2010 2011
Rgp Rgs Spl Lap Grd Sau Vas Kov Bal Geg Bir Lie Rgp Rgs
HUFISI
DKDEPLNOUKSECZPTCHBGNLFRBERUEEIL
ES1. Sept. 2010 31. Dec. 2010

End Data collection in ESS 5
(presentation Achim Koch)

Response outcomes European Social Survey, R5
0
10
20
30
40
50
60
70
80
90
100
BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IL LT NL NO PL PT RU SE SI SK UA
interview noncontact refusal not able/other
Report on quality assessment of contact data files in Round 5: Final report 27 countries, Hideko Matsuo and Geert Loosveldt, Working paper Centre for

Cross-national surveys The example of the European surveys The example of the European ... topic survey? Monitor fieldwork ... waste money. privacy

Text of Cross-national surveys The example of the European surveys The example of the European ... topic...

European Data Protection an example for the U.S.? .European Data Protection an example for the U.S.?

Conducting ethanobotanical surveys: an example ethanobotanical surveys: an example from Ghana on plants used for the protection of stored cereals and pulses ... of stored cereals and

Innovation surveys and innovation policy: the European experience

1st Example - European Southern .Our 1st example is the generation of random realizations of galactic

Notes 8آ2 & 8آ3.notebook June 09, Surveys, Experiments, and Observational EXAMPLE studies Data Collection

Images of Europe and European Values: Surveys of the Russian Elite Valeria Kasamara

Program for International Student Assessment (PISA) nces.ed.gov/surveys/pisa/pdf/ · 5-2 Example of

Harmonisation by example: European laws against unfair ... 1 Dir. 2005/29 of the European Parliament

Conducting ethanobotanical surveys: an example from Ghana ...gala.gre.ac.uk/11105/1/Doc-0166.pdf ·

European fellowships (EF) Administrative forms (Part A ... Example, not to complete European Commission

Special Eurobarometer 374 - European .Previous Eurobarometer surveys (in 2005, 2007 and 2009) highlighted

Biodiversity Surveys of Firefly Species: Practical ... Eastern European Luciola species. They easily