Quantitative data Quantitative data collection on the status collection on the status of Roma in SEE and CEE:of Roma in SEE and CEE:Methodology, Purpose, and Policy Methodology, Purpose, and Policy

ApplicationApplication

Susanne MilcherSusanne Milcher Specialist, Poverty and Economic Specialist, Poverty and Economic

Development Development UNDP Regional CentreUNDP Regional Centre

BratislavaBratislava(17 September 2004)(17 September 2004)

Europe and

CIS

OutlineOutline General problems with ethnic General problems with ethnic

datadata The baseline survey The baseline survey

methodologymethodology Policy applicationPolicy application Future stepsFuture steps

Europe and

CIS

Problems with relevant Problems with relevant datadata

Governments reluctant to collectGovernments reluctant to collect– Political considerationsPolitical considerations– Constitutional constraintsConstitutional constraints

Constituencies reluctant to shareConstituencies reluctant to share– Desire to avoid discrimination and Desire to avoid discrimination and

stigmatizationstigmatization– Desire to keep distance from the stateDesire to keep distance from the state

As a result:As a result: Opportunities to misuse and misinterpret Opportunities to misuse and misinterpret

data deficitsdata deficits But all aware that data is necessaryBut all aware that data is necessary

Europe and

CIS

UNDP approach to the UNDP approach to the issueissue

Reliable quality quantitative data is a Reliable quality quantitative data is a necessarynecessaryprecondition for relevant policies. It means precondition for relevant policies. It means data,data,which is:which is: RelevantRelevant, adequately reflecting reality, adequately reflecting reality ComparableComparable – both between countries and – both between countries and

with majority populations (control group) in with majority populations (control group) in individual countries – over timeindividual countries – over time

Respecting privacy Respecting privacy – making sure will not – making sure will not be misused, individual is protected against be misused, individual is protected against discrimination discrimination

Europe and

CIS

How to get there? The How to get there? The surveysurvey

Problems are of technical, Problems are of technical, methodological and legal nature methodological and legal nature and specific problems require and specific problems require specific approachesspecific approaches

Clear division of roles between Clear division of roles between international and national actors international and national actors necessary in the short, mid and long necessary in the short, mid and long run (phase-out strategy)run (phase-out strategy)

Link to MDGs monitoring (baseline)Link to MDGs monitoring (baseline)

Europe and

CIS

How to get there?How to get there? RelevancyRelevancy – related primarily to – related primarily to

communities involvement in data collection communities involvement in data collection (Roma interviewers where possible, (Roma interviewers where possible, assistant interviewers in other cases)assistant interviewers in other cases)

ComparabilityComparability – applying consistent – applying consistent methodologies in different countries methodologies in different countries following the format HBS and LFSfollowing the format HBS and LFS

Include Include majority boostersmajority boosters Respecting Respecting privacyprivacy – not using registry – not using registry

datadata

Europe and

CIS

Previous experiencePrevious experience Regional UNDP/ILO large scale survey on Roma in Regional UNDP/ILO large scale survey on Roma in

five Central and Eastern European (CEE) countries five Central and Eastern European (CEE) countries conducted in 2001conducted in 2001

Situation of Roma from a ‘human development’ Situation of Roma from a ‘human development’ perspectiveperspective

““How much” worse and specific characteristics of How much” worse and specific characteristics of their statustheir status

Answering these specific and concrete questions Answering these specific and concrete questions in quantitative figures is a necessary precondition in quantitative figures is a necessary precondition both for understanding the underlying causes and both for understanding the underlying causes and addressing them adequatelyaddressing them adequately

Europe and

CIS

Roma: poverty profilesRoma: poverty profiles

Average monthly per capita expenditures in Roma householdsBG CZ HU RO SK

As % of country average wage 15 31 17 13 18

As % of country average monthly household expenditures

34 46 26 30 30

Europe and

CIS

Roma: Deprivation Roma: Deprivation indicators indicators

(% of people lacking access to)(% of people lacking access to)

Czech Republic

0 20 40 60 80

Car

TV set

Washing machine

Telephone

Running water

Toilet in the house

Roma

Countryaverage

Europe and

CIS

Roma: Deprivation Roma: Deprivation indicators indicators

(% of people lacking access to)(% of people lacking access to)

Romania

0 20 40 60 80 100

Car

TV set

Washing machine

Telephone

Running water

Toilet in the house

Roma

Countryaverage

Europe and

CIS

Roma: Unemployment (ILO Roma: Unemployment (ILO definition)definition)

0

10

20

30

40

50

60

70

BG CZ HU RO SK

Roma, broad unemployment rate 2001, country average

Europe and

CIS

The survey IThe survey I Supposed to provide base-line data for the Supposed to provide base-line data for the

“Decade” progress monitoring and for NTL “Decade” progress monitoring and for NTL policy purposespolicy purposes

Covers all countries in SEE and CEE with Covers all countries in SEE and CEE with sizeable Roma minorities (“Decade +”)sizeable Roma minorities (“Decade +”)

Where relevant, has IDPs and refugees Where relevant, has IDPs and refugees boostersboosters

Will be the basis of a “regional vulnerability Will be the basis of a “regional vulnerability report”report”

Could be used as a pilot for similar data Could be used as a pilot for similar data collection exercises in the regioncollection exercises in the region

Europe and

CIS

The survey IIThe survey II The unit of analysis – householdThe unit of analysis – household Main interviewee – head of the householdMain interviewee – head of the household Universe studied – households in Roma Universe studied – households in Roma

settlementssettlements Roma settlements – municipalities or Roma settlements – municipalities or

neighborhoods with high concentration of neighborhoods with high concentration of RomaRoma

Territorial unit – municipalities with share Territorial unit – municipalities with share of Roma population equal or above the of Roma population equal or above the NTL average as registered by the censusNTL average as registered by the census

Europe and

CIS

The sampling model The sampling model assumptionsassumptions

Census understate absolute numbers but Census understate absolute numbers but reflect the structure and distribution reflect the structure and distribution (“where those people are?”)(“where those people are?”)

The major disparities visible at the level of The major disparities visible at the level of municipalitiesmunicipalities

Comparability with the “majority in Comparability with the “majority in proximity” more important than with proximity” more important than with national averagenational average

Majority boosters – a “benchmark” sample Majority boosters – a “benchmark” sample for comparisons with non-Roma in similar for comparisons with non-Roma in similar socioeconomic environment socioeconomic environment

Europe and

CIS

Inevitable impedimentsInevitable impediments Sample may be under-representing Sample may be under-representing

integrated Romaintegrated Roma Majority population in proximity may not Majority population in proximity may not

be sufficient for constructing a boosterbe sufficient for constructing a booster Concentrated Roma neighborhood may Concentrated Roma neighborhood may

still constitute a share lower than the still constitute a share lower than the NTL averageNTL average

Data not representative for sub-Data not representative for sub-grouping grouping

Europe and

CIS

What shall the survey What shall the survey provide?provide?

Household representative information, Household representative information, “census-type” allowing approximations for“census-type” allowing approximations for– Poverty rates and depthPoverty rates and depth– Levels and sources of incomeLevels and sources of income– Educational attainment, completion rates, Educational attainment, completion rates,

enrollment rate and functional literacyenrollment rate and functional literacy– General picture of health status and access to General picture of health status and access to

health services health services – Dwellings characteristics (water, sanitation) for Dwellings characteristics (water, sanitation) for

deprivation indicatorsdeprivation indicators All this - disaggregated by age, sex, income All this - disaggregated by age, sex, income

status of the household and sub-national levelstatus of the household and sub-national level

Europe and

CIS

Dose of realism Dose of realism (the inevitable (the inevitable

constraints)constraints)

Not all indicators are possible to be Not all indicators are possible to be monitored or disaggregatedmonitored or disaggregated

Data (as any data perhaps) – still Data (as any data perhaps) – still approximation and should be used approximation and should be used as complementary to other statisticsas complementary to other statistics

Cross-country comparability will be Cross-country comparability will be limited (if necessary at all)limited (if necessary at all)

Europe and

CIS

Time-frameTime-frame Completed sampling methodology and Completed sampling methodology and

questionnairequestionnaire August/September – translating, back August/September – translating, back

translation and testing of the translation and testing of the questionnaire; samplingquestionnaire; sampling

End of August: identification of assistant-End of August: identification of assistant-interviewers and first training (Sofia)interviewers and first training (Sofia)

October: field-workOctober: field-work November: data availableNovember: data available First quarter 2005 “Vulnerability First quarter 2005 “Vulnerability

Assessment”Assessment”

Europe and

CIS

Policy applicationPolicy application Only based on quantitative data can the Only based on quantitative data can the

actors involved (governments, donors, actors involved (governments, donors, implementing partners) outline priorities implementing partners) outline priorities and measure progressand measure progress

Disaggregated quantitative data is a Disaggregated quantitative data is a precondition for relevant national-level precondition for relevant national-level policies for sustainable inclusion of policies for sustainable inclusion of vulnerable groups and Roma in particularvulnerable groups and Roma in particular

Monitoring and evaluation of national-level Monitoring and evaluation of national-level policies, what impact has been achieved?policies, what impact has been achieved?

Europe and

CIS

Future steps and possible Future steps and possible cooperationcooperation

Improve methodologies for vulnerability Improve methodologies for vulnerability analysis to establish disaggregated data analysis to establish disaggregated data collection capacities at the country level in collection capacities at the country level in 2-3 years2-3 years

Work with National Statistical Offices on Work with National Statistical Offices on practical projects on data disaggregationpractical projects on data disaggregation

Elaborate possible approaches to Elaborate possible approaches to overcome legal barriers overcome legal barriers

Encourage and coordinate advocacy Encourage and coordinate advocacy campaign for new approach to “group-campaign for new approach to “group-related” data, incl. ethnic groupsrelated” data, incl. ethnic groups

Europe and

CIS

Links to other Roma-Links to other Roma-related initiativesrelated initiatives

Follow up to first regional reportFollow up to first regional report ““Avoiding the Dependency Trap”Avoiding the Dependency Trap”

Decade of Roma InclusionDecade of Roma Inclusion baseline and baseline and monitoringmonitoring

Measuring the progress at national level Measuring the progress at national level (Czech Republic and Hungary)(Czech Republic and Hungary)

WB “Living Standards” assessmentWB “Living Standards” assessment Roma Development Opportunities Web-Roma Development Opportunities Web-

site, site, http://roma.undp.skhttp://roma.undp.sk

Europe and

CIS

Thank you!Thank you!Bratislava Regional CenterBratislava Regional Center

35 Grosslingova 35 Grosslingova 81109 Bratislava, Slovak Republic81109 Bratislava, Slovak Republic

+421 2 59337 111+421 2 59337 111www.undp.skwww.undp.sk

http://roma.undp.skhttp://roma.undp.skhttp://mdgr.undp.skhttp://mdgr.undp.sk