Embed Size (px)
Citation preview
COLLECTING SOCIAL INDICATOR & PROGRAM DATAIvette Rodriguez Stern, Junior Specialist University of Hawai‘iCenter on the FamilyCollege of Tropical Agriculture and Human Resources
Learning ObjectivesTo understand:
What social indicators are and how to use them in program planning.
What type of program data should be collected to document process and assess impact.
Social Indicators• Data points, statistical markers, measures of Social conditionsBehaviorsStatus
• Observed as time series to monitor social systems, identify changes and guide intervention
• Serve as early warning systems; “miner’s canary”
Land, K.C. & Ferriss, A.L. (2007). The sociology of social indicators. In Bryant, C.D. & Peck, D.L. (Eds.), 21st Century Sociology: A Reference Handbook. Thousand Oaks, CA: Sage Publications.
ExamplesUnemployment ratesPoverty ratesCrime ratesChild abuse ratesTeen pregnancy ratesHealth status indicesSchool enrollment ratesAchievement scoresVoting rates
Key Uses of Social IndicatorsTo identify areas of concern
Inform citizens and policy makersTrack trends and patternsInform where interventions are needed
Moore, K.A., Brown, B.V, Scarupa, H.J. (2003). The uses (and misuses) of social indicators: Implications for public policy. Child Trends Research Brief.
Other Uses of Social Indicators• Monitoring outcomes at the macro level• Setting goals• Increasing accountability• Reflective practice
Moore, K.A., Brown, B.V, Scarupa, H.J. (2003). The uses (and misuses) of social indicators: Implications for public policy. Child Trends Research Brief.
Misuse of Social IndicatorsShould not use social indicators to:
Claim credit for societal trendsClaim credit for program successEvaluate performance of individuals or programs
Moore, K.A., Brown, B.V, Scarupa, H.J. (2003). The uses (and misuses) of social indicators: Implications for public policy. Child Trends Research Brief.
Role of Social Indicators in Evaluation• Limited• More appropriate for program planning• Miner’s canary• Provide context for intervention• Inform practice and intervention in a given community or program
Examples of Social Indicator Resources
What Data are Needed for Program Evaluation• Identifying what data is need during the planning phase is keyWhat baseline data already availableWhat data needs to be collected before program initiatedWhat should data collection process be
Importance of Logic Model• Useful for identifying elements of program that are most likely to yield useful evaluation data
• Useful for identifying an appropriate sequence for collecting program data and measuring progress
Process Evaluation:Measuring Inputs and Outputs• Focuses on program effort and implementation
• Answers questions about program processes and proceduresIs program being implemented as intendedAre investments being made as planned Are you reaching intended audiences
Examples of Process Evaluation Data• Number of workshops/trainings delivered• Number of resources/products delivered• Number of clients served• Client satisfaction
Data ManagementDatabases:
• Client intake forms/files demographics and other relevant data
• Documentation of services delivered (the “dose”)To individual clientsIn group formatResources delivered
• Satisfaction survey data
Outcome Evaluation• Measures “beneficial change”• Most critical because it deals with bottom line
• Measuring program outcomesImportant to identify relevant and very specific outcomesNot every outcome will be of equal importance
Methods for Measuring Program Outcomes• Surveys• Interviews• Tests (established standards or criteria to assess knowledge, skills or performance)
• Instruments must be:ReliableValidSufficiently sensitive
• Pre-post test design
ResourcesRequired Reading:Moore, K.A., Brown, B.V, Scarupa, H.J. (2003). The uses (and misuses) of social indicators: Implications for public policy. Child Trends Research Brief. (http://www.childtrends.org/wp-cont)
Radhakrishna, R.B. & Relado, R.Z. (2009). A framework to link evaluation questions to program outcomes. Journal of Extenstion. 47 (3).
University of Wisconsin Cooperative Extension (2005). Documenting Outcomes in Tobacco Control Programs. (Section 2, Steps in Program Evaluation only).
Recommended Reading:Lippmann, L.H. (2006). Indicators and indices of child well-being: A brief American history. Social Indicators Research. 83: 39-53.
Rossi, P.H., Freeman, H.E., Lipsey, M.W. (2003). Evaluation: A systematic approach. Thousand Oaks, CA: Sage Publications (Chapter 7: Measuring and Monitoring Program Outcomes only).
