If you can't read please download the document
Upload
colman
View
42
Download
0
Tags:
Embed Size (px)
DESCRIPTION
Digital Survey Method. The use of ICTs in programme evaluation (Tearfund HIV programme) Gamos May 2012. KAP Surveys. Research Assessments Evaluation. Impact Surveys (evaluation). Accountability – finding out what works – and proving it! Two purposes of KAP surveys: - PowerPoint PPT Presentation
Citation preview
The use of ICTs in programme evaluation
(Tearfund HIV programme)
Gamos
May 2012Digital Survey Method
KAP SurveysResearchAssessmentsEvaluation
Accountability finding out what works and proving it!
Two purposes of KAP surveys:To understand whats going on (formative learning)To show changes that have taken place over duration of programme
Key features of methodology:Large, randomly selected sampleInternationally tested and accepted indicatorsStatistical tests for reliabilityImpact Surveys (evaluation)
KAP StructureExample KAP baseline and endline KAP surveys for Tearfunds HIV programme in Ethiopia and Malawi.
KAP Relationships
KAP FindingsPositive change in indicators linked to exposure to HIV information through Church partners
Survey process (paper)
Technology can assist with data entry:Devices for data capture (CAPI software) eliminates need for data transcriptionOptical reading technologies eliminate human errors in data entry activity;Computer assisted data entry reduces human errors
Review of ICTs for surveys
Early experience with PDAs was not encouragingNetbooks require PC skills (that are rare)Mobile phones good for data collection but screen too small for CAPI.
NOW tablets! Low cost, big screen, apps do not need computing skills, mobile phone skills are universal.ICTs for surveys data capture
Optical reading technologies too expensive; better to give budget to partners.Computer assisted data entry Gamos created bespoke software for each project.ICTs for surveys data transcription
Survey process - DigitalFormsEliminates data entry
Tearfund & Gamos decided to invest in digital technology HIV IMPACT programme in MalawiKey decisions:Operating system: Android v. iOS (Apple)Bespoke software v. Freeware (Android)Devices as capital (asset) or expenditure (disposable)Automatic or manual management of data filesDigitalForms
Cost savings:Data entry software eliminate need for computer assisted data entry;Data entry no need to recruit data entry staff or to appoint supervisors.Printing costs no need to copy paper questionnaires.
Additional costs:Hardware handheld devices Writing software to run on the tablets
Overall no cost premiumDigitalForms
Modules:Household & respondent (poverty & social)Children & pregnancy (contraception, ANC, delivery, PNC)HIV/AIDS awareness (exposure to information, knowledge, attitudes)Testing & counselling (as part of ANC and other)Response of churches (activities, support, attitudes to PLWH)HIV status (consent and disclosure)Loops - household membership roster; child birth historyDigitalForms the product
The kit: for enumerators:TabletMains chargerMicro SD cardBackup battery (not all kits)Carrying caseFor supervisors:Car battery charger enables 2 devices to be charged up from the car battery;USB microSD card reader for copying files onto a central laptop.
DigitalForms the product
Training workshop nothing to report; brief introduction to tap & swipe, then people got into it seems quite intuitive.Challenges from field experience:enumerators want the ability to edit records Gamos created checking software to help supervisors check (but not edit) submitted files;Questions need to be numbered so that teams can discuss issues / edits;field reports mentioned tablets running out of power (problems with backup batteries?). Experience to dateCompletion rates only 1 question was forced, otherwise non-completion rates were typically around 2%.
Downloading of updated versions workshop used beta version and demonstrated downloading software; teams downloaded release version successfully (1 error).Android update - 4.30 on Friday afternoon (release date) Asus upgraded to Android 4.0.3 panic! Fortunately, rollout did not extend to Malawi.Clean data!
Experience to date
Complete user review processAutomatic data uploading (to server)More comprehensive data validationDevelop more modulesCheaper devices
www.gamos.orgNext steps
Supplementary slides
Baseline endline analysisDifference-in-differences method
Takes account of errors:Beneficiaries may be different from others (selection bias);Other changes may take place over time
Exposure to HIV/AIDS messagingChurch based:Information heard public talks (e.g. sermons), seen or heard information at a religious institution relating to HIV;Participation in AIDS related activities organised by churches;Personal contact talked about AIDS or multiple sexual partnerships with church members or leaders. Others:Broadcast media radio, TVHealth services antenatal careHealth services - HIV tests (not antenatal care)
Definition of links (impact?)
Value of approachGenerated data on:Access to information on HIV/AIDSResponses of churches - HIV activities, stigma within church, promote testing, policiesHIV knowledge protection, PPTCTStigmatising attitudesAttitudes towards sex, womens sexual rights, Access to ANC male involvementTestingSexual behaviour age at debut, MCPs, condomsOutcomes changes in behaviour, care and support, intentions
*