Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
2015-2016EvaluationPlanforENLACECOMUNITARIODecember2015CharlaHenley,MACandidate,LatinAmericanStudiesMelissaDenetdale,BACandidate,CriminologySoniaBettez,PhD,RWJFCenterforHealthPolicyatUNMNMEVALUATIONLABUniversityofNewMexicoOverviewofEnlaceComunitario
EnlaceComunitarioisdevotedtoservingtheLatinoImmigrantcommunityinAlbuquerque,NewMexico.TheorganizationprovidesinterventionservicesforLatinoimmigrantfamilieswhofindthemselvesinabusiverelationships.Inadditiontotheinterventionservices,theorganization’spreventativeservicesworkwiththeLatinoimmigrantcommunityatlarge(pleaseseetheLogicModelinAppendixAformoreinformation).TheYouthLeadershipProgramaimstopreventdomesticviolence(DV)andintimatepartnerviolence(IPV)intheLatinoimmigrantcommunitybysparkingchangeinsocialandsocietalnormsduringachild’sformativeyears.Latinoboysandgirlsbetweentheagesof11and20yearsoldattendtrainingseminarstolearnaboutwhatitmeanstorelateinhealthyways.Aftertheseseminars,thestudentstaketheirknowledgetothecommunity,holdingeventsattheirschoolsandatcommunitycentersforkidstheiragetolearnaboutIPV.Inessence,theprogramcallsonteenstopromotesocialchangeintheircommunities.ThroughtheYouthLeadersprogramEnlaceseekstopreventDV/IPVinBernalilloCountyLatinoimmigrantcommunities,andenvisionsexpansionofprogramslikethisonanationalscale.
ResearchsuggeststhatLatinoyoutharevulnerabletoDV/IPVforavarietyofreasons.Studiesofdomesticviolence(DV)andintimatepartnerviolence(IPV)inLatinocommunitiesreachdifferentconclusionsabouttheprevalenceandriskfactorsassociatedwithDVandIPV(Gonzalez-Guardaetal.2013,Ocampoetal.2007,andKimberetal.2015).Whilethestudiessuggestthatimmigrantgenerationalstatus(IGS)andagearemostassociatedwithIPV,theyvaryindiscussingtheactualdegreeoftherisk.
Kimberetal.(2015)usesdatafromanationallyrepresentativesurveytohighlightthefindingthat1stgenerationimmigrants1arelesslikelytoexperienceIPV(orreportit)thantheir3rdgenerationcounterparts.Thisfindingcontributestothecallformoreeducationandpreventionprogramsinimmigrantcommunities,especiallywhenconsideringthestudylimitationsoflimitedreportingforfearofconsequenceandpotentiallanguagebarriers.Ocampoetal.(2007)focusesonLatinohighschoolstudentsandsurveysthatshowstudentsaremostlikelytotrustandfeelmostcomfortabletalkingtootherstudentsaboutIPVoccurrences,anddon’tfeelcomfortablesharinginformationwithauthorityfigures.Gonzalez-Guardaetal.(2013)takestheopinionsofLatinocommunitymembersintoconsiderationwithregardstohowcurrentIPVpreventionprogramsoverlookculturalnormsandtraditionsthatleadtoIPVand
1ImmigrantsrepresentedinthesurveyidentifiedasWhite,Black,AmericanIndian/AlaskaNative,Asian/NativeHawaiian/otherPacificIslander,orHispanicandthenidentifiedas1st,2nd,or3rdgenerationimmigrants.
EnlaceComunitarioEvaluationPlan2toleranceofIPV.Thisstudy’sfindingsalsocontributetotheideathatspecialIPVpreventionandeducationprogramsshouldbecreatedforLatinoimmigrantcommunitiessothattheprogramsareculturallyappropriateandspecific.Theliterature,reviewedingreaterdetailinAppendixA,thussupportthepremiseoftheYouthLeadershipprogramatEnlaceComunitario,whichcallsuponLatinoyoungadultstoeducatetheirpeersaboutthedangersofIPVandDVinhopesofmotivatingachangeintheculturalnormsthatmarginalizeLatinos.EnlacehasdevelopedtheYouthLeadershipprogramtopromoteeducationabouthealthyrelating,whatitmeanstobeinanabusiverelationshipandtheimportanceofpreventivesteps.Lastly,theYouthLeadersprogramrespondstothesuggestionsmadebythecommunitymembersasinGonzalez-Guardaetal.(2013)andthestudentsinOcampoetal.(2007).CommunityContextAccordingtotheCenterforDiseaseControl(CDC)2011,morethan12millionpeoplearevictimsofIPVeachyear2.Butnotallpeopleareaffectedequally.Infact,thosemostatriskofexperiencingIPVarewomen,youth(age12-24),andthoseidentifyingasnon-white.
Furthermore,Figure1showsthat,inthe2010NationalIntimatePartnerandSexualViolenceSurvey,YoungAdultsreportedahigherprevalenceofIPVNationwidewhenrespondingtothequestion:Inthepast12months,haveyoubeenphysicallyharmed,onpurpose,byanintimatepartner?Figure1illustratestheanswers.Figure1.PrevalenceofIntimatePartnerViolenceinYoungAdults
*NationalIntimatePartnerandSexualViolenceSurvey,2010TheU.S.prevalenceofIPVandSexualViolenceinawoman’slifetimeis35.6%.NewMexicanwomenexperienceIPVat34%3,whichisclosetothenationalrate.Furthermore,non-whitewomenareevenmorelikelytoexperienceIPVintheirlifetimes.Figure2showstherateatwhichwomenresponded“yes”tohavingbeenphysicallyharmedbyanintimatepartnerinthelasttwelvemonths.2CDCViolencePreventionFactSheet3http://www.cdc.gov/violenceprevention/nisvs/state_tables_74.html
1%
4%
7%
8%
14%
55+
45-54
35-44
25-34
18-24
Age
EnlaceComunitarioEvaluationPlan3Figure2.UnitedStatesRateofDomesticPartnerViolenceasReportedbyWomen
*NationalIntimatePartnerandSexualViolenceSurvey,2010Asdisplayedinthefigureabove,therateatwhichLatinasresponded“yes”ismuchhigherthantheirwhitecounterparts.
DatafromtheNewMexicoYouthRiskandResiliencySurvey,asurveyofthehealthriskbehaviorsandresiliency(protective)factorsofNewMexicohighschoolandmiddleschoolstudents,illustratetheriskfacedbyyoungerLatinogirlsinNewMexico.Figure3showsAmericanIndianandLatinoHighSchoolStudentsinBernalilloCountyreportingthehighestratesofIPVbyresponding“yes”tobeinghit,slapped,orphysicallyhurtonpurposebytheirboyfriendorgirlfriendduringthepast12months.Figure3.RatesofintimatepartnerviolenceamongyouthinBernalilloCounty,NM
*NewMexicoYouthRiskandResiliencySurvey,2011.Whereasonly8%ofwhitegirlsreportedthattheyhadbeenphysicallyharmedbytheirboyfriendorgirlfriendonpurposewithinthepast12monthsthatratejumpsto12.9%whenlookingattheresponsesoftheLatinogirls.Stratifiedbygrade,thepercentagegoesfrom10%intenthgradeto13.1%intwelfthgrade,consistentwiththenationaldatafromtheCDCthatshowsIPVmostprominentamongyoungwomenandrisinguntil24yearsofage.
4%
5%
6%
6%
8%
9%
ForeignBorn
White,Non-Hispanic
All
USBorn
Latino
Black
5%
8%
10%
12%
13%
Unknown
White
Asian/PacificIslander
Hispanic/Lamno
AmericanIndian
EnlaceComunitarioEvaluationPlan4
Withspecialconcernforthemostat-riskgroupsmentionedpreviously,itisimportanttonotethat,accordingtotheCensus,47.7%ofNewMexicansidentifyasLatino,with9.8%reportingtheyareforeignborn.IfwelookatBernalilloCountyinparticular,wecanseetheriskofexperiencingIPVgrowing:49%ofBernalilloCountyresidentsidentifyasLatinoand10.9%reporttheyareforeignborn4.Itshouldcomeasnosurprise,then,thatwearesuggestingthatthiscountymayhavemoreofariskforIPVthanpreviouslyrealized.
Ourresearchshowsthat“one-size-fits-all”IPVpreventionprogramsdonotworkintheLatinoimmigrantcommunities.AssuggestedbythecommunitymembersinGonzalez-Guardaetal.(2013),thistypeofviolencehasbeenconsideredaprivatefamilymatterinsomecultures,whichteachesvictimsto“justdealwith”theviolenceinsteadofremovingthemselvesfromitortryingtoalleviateit.EnlaceComunitarioisdoingsomethingtoaddressalloftheaboveconcerns.
EvaluationHistoryEnlacehasperformedevaluationsoftheirpreventionservicesinthepast.In2011,EnlaceproducedacasestudyoftheirPromotorasprogram.Thisevaluationtookplaceoverthreeyearsandassessedtheimpacttheprogramonthesurvivorsthatbecameleadersintheorganization.Initially,theYouthLeadersprogramwasgoingtobeapartofthatevaluationbutthecasestudyshiftedfocustothePromotorasprogramwhentheorganizationrealizedjusthowmuchinformationhadbeencollectedforbothprograms.BecausethePromotorasprogramhadbeeninplaceforlongerthantheYouthLeadersprogramatthattime,thestafffeltconfidentintheirdecision.However,becausethestaffplannedtorevisittheevaluationoftheYouthLeadersprogram,EnlacecollectedanddigitallystoredinformationintheformofaudiencesatisfactionassessmentsaftereveryYouthLeaderpresentationsince2012.WewereabletopullthatdataintoSTATAsoftwareinordertoanalyzeoverallsatisfactionwiththepresentationsbetweentheyears2012and2015.Figure4intheAppendixBshowshowtheyouthansweredthequestionsabouthavingfun,knowledgeandpreparationofpresenters,andlearningaboutabuse.Theresponsestothesequestionswereoverwhelminglypositive.Furtheranalysisshowedthattheonlydistinguishabledifferenceintheresponsesthroughouttheyearswasthattheaudienceseemedtohavemorefunwatchingthepresentationsafter2012(Figure5).Whileitwashelpfultoknowthattheaudiencewassatisfiedwiththepresentations,Enlaceshouldconsidercollectinginformationthatwouldbemoreinformative,suchas:whattheaudiencelearned,whetherthereisadifferenceinwhatislearnedinrelationtowhoispresenting,whetherornotlearningledtobehaviorchanges,etc.).Therefore,werecommendedthattheaudiencesatisfactionassessmentsoftheYouthLeaderpresentationsberevisedinordertogenerategreaterdetail.
EvaluationPlanOurevaluationseekstoanswerthefollowingquestions:HastherebeenanimpactontheYouthLeadersthemselvesasaresultoftheirparticipationintheprogram?Havetheirrelatingbehaviorschanged?Isthereanyindicationthattherehasbeenanylargerimpactonthecommunity,institutions,orstructuresasaresultoftheprogram?ThroughtheexperiencesoftheYouthLeaders,canweidentifyanypatternsthathaveemergedinthecommunitythatsuggestachangeinculturalnorms?
We(theresearchteam)willconductafocusgroupwiththenineyouthleadersinthisyear’scohorttocollectavarietyofideasfromtheYouthLeaders,tobetterunderstandtheimpactoftheprogram.WewillaskstaffatEnlaceandayouthleaderrepresentativetohelpcreatequestionsforthefocusgrouptoensurerelevancy.Weplantouseaninteractiveformatinthefocusgroupsincethestudentsareaccustomedtoworkingtogetherintheirpresentationsandliketomovearound.Wealsoplanvariedconfigurationsofyouth(individually,indyads,twogroups,allinonegroup)tocreateanenvironmentwhereweheareveryone’svoices.Theyouth
4http://quickfacts.census.gov/qfd/states/35/35001.html
EnlaceComunitarioEvaluationPlan5willanswerthequestionsinwritingeitheronindexcardsoronflipchartpageswewillcollectinordertominimizethetimeneededtotranscribealltheinformation.Thelistofquestions(createdinconjunctionwithEnlaceandreviewedbyYouthLeadersforapproval/revisions)canbefoundinAppendixC.
TheCurrent(Tentative)TimelineThissemester,wefinisheddraftingourevaluationplanandfocusgroupquestions(byDecember3rd).Also,weattendedapublicYouthLeaderpresentationtogainabetterunderstandingofhowtheywork(December14th).TheevaluationteamwillcompleteanIRBasnecessarypriortothestartofthenextsemester.Wewillmeetasawhole(EnlaceplustheYouthLeadersthatarehelpingwithquestioncreationandMelissa,Charla,andSonia)onJanuary22ndat11:00amtomakeanylastminuteadjustmentstoquestionsandsetdatesforthefocusgroups.InFebruary,wewillconductthefocusgroupsandbegintranscribingasnecessaryandanalyzingdatacollected.InMarch,wewillcontinuetoanalyzeifnecessary,butthemainfocuswillbeondraftingfindingsintoareportthatanswerstheevaluationquestionstobecompletedbeforeMarch15th.ByApril15th,wewillhaveafinalreportofourfindingswithsuggestionsforfutureevaluationoftheYouthLeadershipprogram.
FutureEvaluationEnlaceComunitarioisacomplexorganizationthathousesmanymoreprogramsthanjusttheoneweareevaluating.AsidefromcontinuingtheevaluationoftheYouthLeadershipprogrambyconductingsurveysofYouthLeaderalumni,EnlacehasexpressedagreatdealofinterestinevaluatingtheirHealthyRelatingcourse(howitisimpactingstudentsinself-confidenceandlifeoutsidejustrelationships)andinevaluatingtheirinterventionservices,particularlytodetermineiftheservicestheyareprovidingaretraumainformedandculturallyappropriate.Sincetheirbiggestevaluationgoalsareto:1.)Beabletotelltheirstorytofundersand2.)BecomereplicableinotherHispanicandLatinoimmigrantcommunitiesacrossthecountry,therewillalwaysbemoreevaluationthatcanbedoneinthecomingyearstoassessEnlace’seffectivenessinreducingDV/IPVcasesinLatinoimmigrantcommunities.TogaingreaterinsightonEnlace’splansforfutureresearch,pleaseseeAppendixD.
EnlaceComunitarioEvaluationPlan6
AppendixAOverviewofEnlaceComunitarioLogicModel
ThislogicmodelwascreatedduringEnlace’sevaluationoftheirPromotorasprogramin2011.ItshowsEnlace’sultimategoalsofcreatingchangesinsocialnormsthatwillleavetheimmigrantcommunityfreefromDomesticViolenceandthevariouswaystheorganizationseekstoachievethatgoal.Withthetwosides—preventionandintervention—EnlaceseekstoalleviatetheDVandIPVthatisbothhappeningcurrentlyandpreventanyfutureincidencesfromoccurring.YouthLeadersarefoundinthemiddleofthelogicmodelandcontributestothepreventionside.Theprogramhelpsfeedintodevelopingleadersandeducatingcommunityandserviceproviders.ThisevaluationseekstoidentifyanyimpacttheYouthLeadersprogramhashadoninfluencingchangeininstitutionsandsocialnorms.ExtendedLiteratureReviewArecentstudythatconsidereddatafromanationallyrepresentativesurveyfoundthat1stgenerationimmigrants5arelesslikelytoexperienceIPV(orreportit)thantheir3rdgenerationcounterparts.ThoughthestudyisnotspecificonlytoHispanics,Kimberetal.(2015)shows“beinga1stor2ndgenerationimmigrantdidnotinfluencetheoddsofperpetratingorbeingthevictimofIPV,”whichiscontrarytowhatpreviousresearchnotbasedonnationallyrepresentativesamplessuggested(1140).Studylimitationscenteredontheretrospectiveself-reportingandthechanceofunder-reportingduetomemoryorfearsofconsequencesthat5ImmigrantsrepresentedinthesurveyidentifiedasWhite,Black,AmericanIndian/AlaskaNative,Asian/NativeHawaiian/otherPacificIslander,orHispanicandthenidentifiedas1st,2nd,or3rdgenerationimmigrants.
EnlaceComunitarioEvaluationPlan7mayfollowreporting.Theauthorscallforfurtherreviewoftheeffectimmigrantgenerationalstatus(IGS)andacculturationhaveonIPVacrosstheUnitedStates,withemphasisonLatinoimmigrants.Because2ndand3rdgenerationimmigrantsarereportingIPVatahigherratethantheir1stgenerationcounterparts,thereisaneedformoreresearchtobeconductedonLatinoyouthinregardstoIPVtodeterminewhenIPVstartssomoreattentioncanbeplacedonpreventativeservicesandinterventionresourcesforthisgroup.
Onesuchreviewconsidersdatafromninefocusgroups(n=76)heldinMiami-DadeCounty,specificallyfocusedonLatinocommunities.Theresultsshowthecommunityismostconcernedfortheimmigrantpopulationforanumberofreasons(mainlythefearofcomingforwardwithIPVcases)withyouthbeingthesecondhighestriskgroup.ThisdocumentdiscussestheimportanceofrecognizingLatinoculturalnorms(“Ourparentstaughtustotolerateit[abuse]”(229))inanytypeofDVorIPVservices.The“blanketprograms6”thathavebeensetinthecommunitytohelpalleviateDVorIPVhavenotseemedtobeparticularlyeffectivefortheLatinocommunities,whichwasdeemedproblematicbecause“mainstreampreventionprogramsdonotsystematicallytakeintoaccountculturalfactorsthatmaybeassociatedwiththeoccurrence,severityandconsequencesofIPVwithin[theLatinoimmigrantcommunity]”(224).Furthermore,Gonzalez-Guardaetal.(2013)suggestthatcommunitymembersweremostconcernedaboutyouthsince“thisgroupwasattheagewherenormsandbehaviorsforintimaterelationshipsbegindeveloping”(232).Withthisinmind,thestudysuggeststhatanattemptatapreventionprogramshouldbeculturallyappropriateandshouldtargettheHispanicyouthinordertotakeanappropriate“firststepinpreventingIPVamongHispanics”(234).
AnotherstudythatwasconductedthroughsurveydatacollectionfromhighschoolteensfoundthatLatinoyouthare,infact,atgreatriskofexperiencingIPV(Ocampoetal.2007).SurveydatacollectiontookplacetwiceintwoacademicyearsinhighschoolslocatedintheLosAngeles,CaliforniavicinitytoresearchtowhomteenswentforadviceorwhatteenswoulddoregardingIPV.Thestudiesconsistedofhighschoolteenswhereamajority(81-99%)oftheschool’spopulationwasHispanic.Ofthispopulation,1,603studentscompletedthesurvey.Theresultsshowthatgreaterresourcesareneededinpublicinstitutions(e.g.,schools)tofacilitate,provideaid,educate,andeventuallypreventIPVinLatinocommunities.Thestudyconcludesthatthereisstrongneedtoteachskillstoteensaboutwhattheycandotohelpthemselvesandotherswhoareinanabusiverelationship.
6A“blanketprogram”isaprogramsaidtoworkforanyindividual,regardlessofethnicity,age,socialstatus,oreducationalbackground.
EnlaceComunitarioEvaluationPlan8
AppendixBEvaluationHistoryYouthLeaderPresentationEvaluationPresenter’sNameLocationofPresentation/EventNameOnascaleofonetofive(fivebeing“stronglyagree),towhatextent:
1. Didyouhavefun?2. Didthepresenterknowhisorhertopic?3. Wasthepresenterprepared?4. Didyoulearnaboutabuse?
Whatdidyouespeciallylikeaboutthepresentation?Whatdidn’tyoulike?Whatwouldyouchangeaboutthepresentation?Othercomments?ResultsFigure4.AudienceAgreesorStronglyAgreeswiththeStatements:
Figure5.AudienceAgreesorStronglyAgreeswithHavingFunduringthePresentation
Youth Had Fun
Presenters Knew Topic
Presenters Were Prepared
Youth Learned About Abuse
90%
96%
95%
93%
EnlaceComunitarioEvaluationPlan9
84%
95%
91%
94%2015
2014
2013
2012
EnlaceComunitarioEvaluationPlan10
AppendixCEvaluationPlanFocusGroupQuestions
• HowlonghaveyoubeenwiththeYLprogram?• Whatdidyoulearnthatyoudidn’tknowbefore?• HowdidyougettoparticipateintheYLprogram?• Haveyourbehaviorschangedinyourrelationships?How?• Giveusanexampleofhowyoudealtwithconflictbeforevs.afteryourtrainingasaYL.• Withyourtrainingasabackground,howwouldyoureacttoseeingconflict/unhealthybehaviorsina
friend,inyourclassroom,inyourschool,inyourownrelationships?• Ifyouwitnessanepisodeofcontrolling/unhealthybehavioramongpeers,howdoyouintervene?• Isthereanythinginyourenvironment(schools,communities,homes)thatreinforcesgood/healthy
relationships?Unhealthyrelationships?• Giveusanexampleofhowyourschool,community,home,doesnotallowunhealthyrelationshipsto
occur.Orhowtheydoallowunhealthyrelationshipstooccur.
EnlaceComunitarioEvaluationPlan11
AppendixDFutureEvaluationFigure6.
BigGoals Objectives BaselineData Activities ShortTermOutcomes
LongTermOutcomes
EvaluateeffectivenessoftheYLProgram(2015-2016)
• createnarrative• determineifit’s
bettertokeepleadersformanyyearsorgraduatethemafterone
• pre-tests• post-tests• evaluationpage• narratives
• createnarrative(March2016)
• phoneinterviews(asnecessaryin2016-2017)
• interviews(asnecessaryin2016-2017)
• onlinesurvey(asnecessaryin2016-2017)
• focusgroups(February2016)
• createnarrative(March2016)
• Tellstorytofunders(CLASP(federal),Kellogg,State,County)(startingMarch2016,continueasnecessaryin2016-2017)
• Becomereplicable(YL)programinotherLatinocommunities(future)
Becomereplicable(YL)programinotherLatinocommunities(potentialfor2016-2017)
• promotehealthyrelationships
• NationalLatinaNetworkwantstoreplicateEnlace’sYLProgramcomparedtootherYLprogramsinthecountry(MinnesotaorGeorgia)
• healthybreakuppresentations
• analyzewhatworksandwhathasn’t,whatchangeshavebeenmade,etc.
• putintowordswhatworksforEC
• createwebinarfornationalexposure
EvaluateeffectivenessofHealthyRelatingCourse(potentialfor2016-2017)
• promotehealthyrelationships
• pre-tests• post-tests• evaluationpage• narratives
• createtemplateforexcelfile(finishedNovember2015)
• digitalizationofdata(2016)
• developevaluationplan
• telldatastory
• Tellstorytofunders(CLASP(federal),Kellogg,State,County)
• Becomereplicable(YL)programinotherLatinocommunities
EnlaceComunitarioEvaluationPlan12
AppendixEReferencesCensusScopeforHispanicpopulationstatistics.Gonzalez-Guarda,R.M.,A.M.Cummings,M.Becerra,M.C.Fernandez,andI.Mesa.2013.“Needsand PreferencesforthePreventionofIntimatePartnerViolenceAmongHispanics:ACommunity’s Perspective.”TheJournalofPrimaryPrevention,Vol.34,Issue4:221-235.Kimber,Melissa,ChristineA.Henriksen,DanielleM.Davidov,AbbyL.Goldstein,NicoleY.Pitre, LilTonmyr,TracieO.Afif.2015.“TheAssociationBetweenImmigrantGenerationalStatus,Child MaltreatmentHistoryandIntimatePartnerViolence(IPV):EvidencefromaNationallyRepresentative Survey.”SocialPsychiatryandPsychiatricEpidemiology,Vol.50,Issue7:1135-1144.NationalIntimatePartnerandSexualViolenceSurvey—IntimatePartnerViolenceintheU.S.2010(provided byCDC)NMCensusdata2014.NewMexicoPregnancyRiskAssessmentMonitoringSystem(PRAMS)SurveyfromtheNewMexico DepartmentofHealth.RetrievedfromNM-IBISandNM-IBIS.Ocampo,BeverlyWeidmer,GeneA.Shelley,andLisaH.Jaycox.2007.“LatinoTeensTalkaboutHelpSeeking andHelpGivinginRelationtoDatingViolence.”ViolenceAgainstWomen,Vol.13,No.2:172-189.YouthRiskandResiliencySurvey(YRRS).RetrievedfromNM-IBIS.