15
www.rti.org RTI International is a registered trademark and a trade name of Research Triangle Institute. Sampling for Conflict Areas Stephanie Eckman Kristen Himelein, Johannes Bauer, Siobhan Murray

Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

www.rti.org RTI International is a registered trademark and a trade name of Research Triangle Institute.

Sampling for Conflict Areas

Stephanie Eckman Kristen Himelein, Johannes Bauer, Siobhan Murray

Page 2: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Background

Standard approach: – stratified cluster survey to select EAs – household listing operation

Special case of Mogadishu – EA maps and estimated population counts available – but listing was prohibitively dangerous

Requirement for a new design: – limited time in the field – representative

2

Page 3: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Sampling Options

5 options compared – Satellite Mapping – Segmentation – Grid / Geosampling – Qibla method – Random Walk

3

Page 4: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Satellite Mapping

How it works: – Identify each structure in image – Select simple random sampling – Get coordinates of selected units

Pros: – Good coverage, if image up-to-date – Weights straightforward

Cons: – Multi-unit buildings – Uninhabited buildings, commercial

buildings

4

Page 5: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Segmentation

How it works: – Divide PSUs into given size chunks – Select segments SRS – List segments and interview

Pros: – Weights straightforward

Cons: – Manual work – Interviewers must identify

boundaries in the field

5

Page 6: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Grid / Geosampling

How it works: – Overlay grid – Select squares (SRS, PPS) – List segments and interview

Pros: – Weights straightforward – Easier to find in field

Cons: – Buildings that cross squares?

6

Page 7: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

How it works: – Select random points – Walk from point to structure – Qibla is direction for prayer

Pros: – Easy to implement

Cons: – Some points lead out of PSU – Weights complex

7

Qibla

Qibla Method

Page 8: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Pros: – Easy to implement (?)

Cons: – No probabilities of selection – Interviewer discretion

8

Random Walk

Page 9: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

How We Tested Methods

3 PSUs in Mogadishu

Assigned consumption values to HHs – At random – Somewhat clustered – Very clustered

Conducted as part of the Mogadishu High Frequency Survey, a face-to-face household survey conducted from October to December 2014 in Mogadishu, Somalia, by the World Bank Group and Altai Consulting.

9

Page 10: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

10

Heliwa Hodon

Dharkinley

Page 11: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Results

11

Estim

ate of Consum

ption

Page 12: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Satellite Mapping

Qibla (full weights)Qibla (simple distance)

Segmentation

Grid

Random Walk0

12

3bi

as (%

of m

ean)

.1 .15 .2 .25 .3coefficient of variation

12

Results

Page 13: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Results – Bias & Precision

Satellite mapping unbiased, smallest coefficient of variation – If map is good

Segmentation unbiased bias – additional level of selection decreased the precision

Grid theoretically unbiased – did not perform as well in simulations because of small n

Random walk very biased

Qibla may be inexpensive alternative

13

Page 14: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Results – Clustering in Y

If Y randomly assigned – all methods work well

Clustering in Y reduces precision – Segmenting, gridding

Random walk showed did not show a steady relationship between clustering and precision

14

Page 15: Sampling for Conflict Areas - World Bankpubdocs.worldbank.org/en/707061466445443432/Eckman-dr3.pdf“New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative

Thank You

Stephanie Eckman

stepheckman.com

[email protected]

Papers: “Second-Stage Sampling for Conflict Areas” World Bank Policy Research Working Paper WPS7617 http://goo.gl/K44HVS “New Ideas in Sampling for Surveys in the Developing World” Advances in Comparative Survey Methods: Multicultural, Multinational and Multiregional Context “Sampling Nomads: A New Technique for Remote, Hard-to-Reach, and Mobile Population” Journal of Official Statistics http://goo.gl/5ICAYk

15