Upload
dior
View
38
Download
0
Embed Size (px)
DESCRIPTION
Planning and Implementation of Post Enumeration Surveys Pres. 4. Some Requirements for a Good PES. Adequate planning Technical personnel with requisite skills and experience in survey methodology and in designing and implementing the whole PES process - PowerPoint PPT Presentation
Citation preview
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning and Implementation of Post Enumeration Surveys
Pres. 4
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Some Requirements for a Good PES
Adequate planning Technical personnel with requisite skills and experience in
survey methodology and in designing and implementing the whole PES process
Sample design, implementation, matching and estimation Develop an efficient sample design
A successful PES calls for a good sample design and survey implementation
The timing of PES should be soon after census Maintain operational independence
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Some Requirements for a Good PES (Contd.)
Ensure quality assurance in all the stages of the PES, thus from planning to data processing
Control of non-sampling errors is essential like in any other surveys, as unlike sampling errors, they are difficult to measure, therefore one is better off controlling them
Credible estimation methodologies and procedures
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PESJudicious planning for the PES is critical in order to yield reliable
resultsPlanning of PES should be:
Preceded by a clear and unambiguous statement of objectives as this facilitates to articulate planning of PES activities
Synchronized with planning for the censusStart early and adequate resources devoted to it as part of
overall census programmeDevelop a comprehensive survey plan showing budgetary and
manpower requirements
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)Adequate Resources:Financial allotment: Without sufficient funds the
PES would be poorly implemented and therefore may not produce better results than the census. This would defeat the whole purpose of evaluating a census
Human resources: There is need to have requisite number of specialist staff such as survey methodologists; demographers; and analysts; qualified enumerators and supervisors
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)Commitment to the philosophy of a PES: it is very critical to have the
top management of a statistical/census office committed to the philosophy of the PES, so that they can plan for resources and support its efficient implementation
Establishment of an independent unit: It is advisable that an independent PES planning and implementation unit is established. This also enhances the operational independence between the census and PES
Technical planning: It is necessary to have sub-technical teams to work on the sample design; plan for the implementation of the PES; the design of a Dual System of Estimation plan, matching and the reconciliation exercise
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)
Elements of planning a PESPreparatory activitiesData collection related activitiesMatchingReconciliation (if undertaken)Data processingEstimation of coverage and content errorReport preparation and dissemination
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)
Publicity campaignPES as a specialized data collectionImportance of not biasing potential sample
populationStrategies used in different countries(??)
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES
Pilot TestThis can be a dress rehearsal of the actual PES as the pilot census
is a dress rehearsal of the censusIt can be conducted in selected administrative divisions (taking
into account costs)The purpose of the pilot test is to test the adequacy of the entire
PES plan and its organizationIt should be conducted in conditions similar to the actual
enumeration of the actual PES
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)
Pilot Test (Contd.)The pilot test should follow immediately the census pilot testWhile it is not a source of usable data it provides insights into
operational aspects of data collection that can contribute to a successful conduct of a PES and census
Ideally it should be taken a year before the actual PES just as a pilot census is taken a year before a census (UN, 2008 P&R)
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Pilot Test (Contd.)Provides an opportunity to test questions and the
overall field methodology before mounting the PESIt also offers a chance to test the matching and
analytical proceduresResults of the pilot test contribute to establishment
of matching rules, reconciliation procedures and logistical flows of documents between PES and census
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Data collectionMethod commonly used in a PES is the face-to-face interviewEnumerators go to households, in selected EAs/clusters, and
interview respondentsThey collect information by asking questions from a PES
questionnaireThis method provides an opportunity for probingEnumerators can explain the objectives of the PES to
respondents
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)
Questionnaire Should be based on the final census questionnaire The format and size of questionnaire are important for
recording of responses and for data capture Pre-testing of questionnaire is imperative Selection of items for the questionnaire deserves careful
consideration Items to be used in matching process should ideally be
considered for the questionnaire
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Questionnaire (Contd.) Variables for which information is to be collected on the
PES should have been included on the census as well Commonly considered variables include – age, sex,
relationship to reference person, marital status, educational level and type of housing unit
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Selection and training of field staffEnumerators are the interface with respondents
should be able to communicate effectively with respondentsTheir work is critical to the success of the PES field work and
therefore their selection is critical and should be done objectivelyThey should be thoroughly trained before being assigned field workMain objective of training is to enhance uniformity and minimize
measurement error during interviews
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Training Qualified instructors well versed with the objectives of the PES
should be responsible for trainingIt is advisable that the trainers should be part of the PES planning
and implementation teamsTrainees should take turns in explaining to others various items in
the questionnairePractical lessons are essential both in the classroom and the field.
Based on performance trainees can be retained as enumerators or dismissed
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)The role of supervisorsDespite good training of enumerators, without good supervision, in the
field, there may be inaccurate results Need for dedicated and effective supervisionSupervisors should be more experienced and better qualified than
enumeratorsLike enumerators, they should undergo extensive training in all aspects
of the PESSupposed to organize work for enumerators by determining field
assignments
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)The role of supervisors (Contd.)They review completed work and maintain a high
commitment of enumerators to the PES A supervisor can make follow-up visits to non-respondents
as they are better qualified and experiencedThere should be a manageable ratio between enumerators
and a supervisor (1 to 5 ratio should be okay)
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Field data collectionDuring data collection objective is to classify
individuals by enumeration status relative to census night
Use of probing is necessary to adequately establish census night residence status
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)Reconciliation (if done) Developing instructions for field reconciliation visits Training of enumerators and supervisors Carrying out reconciliation visits Final decisions on unresolved cases with respect to final statusData processing Selection or development of computer programmes for data processing,
tabulation & estimation Recruitment and training of data processing staff Carrying out data entry, editing and tabulation
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Planning of PES (contd.)Estimation of coverage and content error (i) Estimation of coverage error (ii) Estimation of content error
Report preparation and dissemination (i) Analysis of PES results including producing and interpretation
of sampling errors for key variables (ii) Preparation of PES analytical report (iii) Dissemination of results
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Control of non-sampling errorsShould be controlled and reduced to the level that their
presence does not compromise the usefulness of the PES results
Particularly harmful when they are non-random because they introduce bias in the PES estimates
Bias is difficult to measureBest way to control non-sampling error is to follow the right
procedures in all PES activities
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Control of non-sampling errors (Contd.)Should be controlled and reduced to the level that their
presence does not compromise the usefulness of the PES results
Particularly harmful when they are non-random because they introduce bias in the PES estimates
Bias is difficult to measureBest way to control non-sampling error is to follow the right
procedures in all PES activities
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Implementation of PES (contd.)Factors contributing to non-sampling errorVague objectives of the PESDuplication or omissions due to imprecise definition of boundaries
of EAsInappropriate methods of interviewingLack of trained and experienced field interviewers and
supervisorsInadequate identification particulars of sampling unitsErrors occurring in data processing
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan, 21-24 November, 2010
Thank You!