COMPASS INSTITUTE INC...The following is a glossary of key terms used in this document. Attribution Attribution is the extent to which other events or activities contribute to the

COMPASSINSTITUTEINC.

SOCIALRETURNONINVESTMENT(SROI)EVALUATIONREPORTJANUARY2015

EVALUATIONCONDUCTEDBYMICHAELMCDADEANDCELIASWALES

2|SOCIALRETURNONINVESTMENTEVALUATIONREPORT,JANUARY2015

NOTESANDTHANKSThisreportwasmadepossiblebyNationalDisabilityServicesQueensland(NDSQld)whofundedaprojecttoutilisetheSocialReturnonInvestment(SROI)evaluationmethodologyinanumberoforganisationsinthedisabilitysectorinQueensland,Australia.

NDSistheAustralianpeakbodyfornon‐governmentdisabilityservices.Throughtheprovisionofinformation,representationandpolicyadviceNDSpromotesandadvancesservicesthatsupportpeoplewithallformsofdisabilitytoparticipateinalldomainsoflife.

ThepurposeoftheprojectistoexploretheSROImethodologyanddetermineifitwouldprovideapathwaytobroadenthediscussioninservicedeliverybeyondoutputstooutcomes.

TheCompassInstituteInc.mustbethankedfortheircommitmenttothisproject;manyresourceshavebeendivertedbyCompasstofacilitatetheirinvolvementinthisproject.Specialthanksmustalsogotothetrainees,carersandotherstakeholderswhoalsodedicatedtheirvaluabletime.

COMPASSINSTITUTEINC|3

CONTENTSNotesandThanks.............................................................................................................................................................2

Glossary................................................................................................................................................................................5

ExecutiveSummary.........................................................................................................................................................6

IntroductiontotheProject...........................................................................................................................................7

SROIMethodology.......................................................................................................................................................7

ReportScope..................................................................................................................................................................7

AboutCompassandtheEducationandTrainingUnits....................................................................................9

TheoryofChange...........................................................................................................................................................10

UnderpinningPhilosophy.....................................................................................................................................10

Aikido........................................................................................................................................................................10

SocialRoleValorisation.....................................................................................................................................10

Kaizen........................................................................................................................................................................10

Compass’Theoryofchange..................................................................................................................................11

TheStakeholders...........................................................................................................................................................12

Trainees........................................................................................................................................................................12

Carers.............................................................................................................................................................................12

Community..................................................................................................................................................................13

TheStaffandtheOrganisation............................................................................................................................13

Funders.........................................................................................................................................................................13

FinancialCustomers................................................................................................................................................13

CorporatePartners..................................................................................................................................................13

Inputs/Outputs...............................................................................................................................................................14

TraineeInputs............................................................................................................................................................14

Carerinputs.................................................................................................................................................................14

Staff/Organisationinputs......................................................................................................................................14

Funders.........................................................................................................................................................................14

Outputs..........................................................................................................................................................................14

OutcomesandtheirImpact.......................................................................................................................................15

NoteaboutDataCollection...................................................................................................................................17

TraineeOutcomes.....................................................................................................................................................17

TraineeOutcomeOne:Capacityandwilltolearn..................................................................................17

TraineeOutcomeTwo:Autonomy................................................................................................................19

TraineeOutcomeThree:SocialInclusion..................................................................................................21

TraineeOutcomeFour:HealthyLife............................................................................................................23


TraineeOutcomeFive:SenseofSelf‐Worth.............................................................................................24

CarerOutcomes.........................................................................................................................................................26

CarerOutcomeOne:PeaceofMindandConfidenceinTrainee’sFuture.....................................26

CarerOutcomeTwo:CapacitytodothingsotherthanCaring..........................................................28

FamilyOutcomes......................................................................................................................................................29

FamilyOutcomeOne:FamilyFunctioning................................................................................................29

CommunityOutcome..............................................................................................................................................31

CommunityOutcomeOne:SocialCapital(Excluded)...........................................................................31

OrganisationalOutcomes......................................................................................................................................32

OrganisationalOutcomeOne:ImprovedStaffProfessionalPractice(Excluded).....................32

OrganisationalOutcomeTwo:ImprovedOrganisationalPractice(Excluded)..........................33

SROICalculation.............................................................................................................................................................34

OngoingImpact.........................................................................................................................................................34

Conclusion........................................................................................................................................................................36

ServiceIntentionsandOutcomes......................................................................................................................36

ContextfortheRatio...............................................................................................................................................36

Resultingratio............................................................................................................................................................37

APPENDIX–ImpactMap...........................................................................................................................................38


GLOSSARYThefollowingisaglossaryofkeytermsusedinthisdocument.

Attribution Attributionistheextenttowhichothereventsoractivitiescontributetotheoutcomeseparatefromtheactivitybeingassessed.

Deadweight Deadweightreferstotheamountofchangethatwouldhappeniftherewasnointervention.

DropOff Therateofreductionintheeffectoftheoutcomeoverthedurationoftheoutcome.

Duration Durationisthelengthoftimetheoutcomelasts.

ImpactRatio TheimpactratioistheultimatesummaryofanSROIassessment.Itisaratiothatrepresentsthevaluecreatedforeachdollarinvestedintheactivitybeingassessed.Theimpactratioholdslittlemeaningwithoutunderstandingthejudgementsmadeindetermininghowandwhattomeasure(assetoutintheSROIreport)andthefinalcalculation(assetoutintheimpactmap).Theimpactratiointhisreportisbasedonpresentvaluewitharecommendeddiscountingrateof6%.

ImpactMap Theimpactmapisgenerallyrepresentedasaspreadsheet.Fortheactivitybeingassessedthemapdetailstherelationshipbetweeninputs,outputs,outcomesandthefinancialvalueplacedonthese.Italsoprovidessomesummarydetailbehindtheimpactratio

Indicator Anindicatoristhewayofdeterminingwhatchangehasoccurredforeachoutcome.

Kaizen Amethodofcontinuousimprovementandisapracticeofimprovingallareasofourlives.

Outcome Anoutcomedenotesthechange(s)experiencedbystakeholder(s)asaresultoftheactivitybeingassessed.OutcomesarenottobeconfusedwithoutputsandoutcomesformthefocusoftheSROImethodology.

Proxy Theproxyisavaluationusedtopriceanoutcome.Itisanapproximatevaluationofthechangeasdescribedbytherelevantstakeholders.

SocialRoleValorisation Thistheorystatesthatapersonwhoisvaluedbysocietyislikelytohavegreateraccesstothegoodthingsinlifesuchasaneducation,dignityandrespect(Osburn,2006)1

1Osburn,J.(2006).AnoverviewofSocialRoleValorizationtheory.The SRV Journal, 1(1), 4-13.


EXECUTIVESUMMARYThisreportisaSocialReturnonInvestment(SROI)assessmentoftheEducationandTrainingUnitsofCompassInstituteInc(Compass).

Theassessmentisapartofalargerproject,‘TheSocialImpactProject’,commissionedbyNationalDisabilityServicesQueensland(NDSQld).TheSocialImpactProjectarosefromadesiretoexploretheuseoftheSROImethodologyasatooltoevaluateservices.

CompassvolunteeredasapilotsiteforanSROIassessment.TheEducationandTrainingUnitswereselectedasthefocusofthisassessmentastheyaretwoverycloselyalignedserviceswithinthetotalCompassoffering.Thescopeisevaluativeandencompassesa12‐monthperiodduring2012–2013.

CompassisanorganisationfoundedontheprinciplesandpracticeofAikido,atraditionalJapanesemartialart.TothistheorganisationbringsastrongphilosophyofSocialRoleValorisationandthedisciplineofcontinuousimprovementknownasKaizen.Theseareappliedindailyserviceprovisiontobringtolifetheorganisation’svision:‘exploringtheartoflife’.Thedailylivedpracticescreateoutcomesforthreekeystakeholdergroups:traineeswithintellectualdisability,carersandtrainees’broaderfamilyunit.ThroughconsultationwiththeseandothermembersoftheCompasscommunitythefollowingoutcomeswereidentifiedandvaluedaspartoftheSROIassessmentprocess:

Capacityandwilltolearn Autonomy Socialinclusion Healthylife Self‐worth Peaceofmindandconfidenceintrainees’future Capacitytodootherthings Familyfunctioning

Threeotheroutcomeswereidentified;however,onassessmenttheyweredeterminedasnotsufficientlymaterialtotheimpactoftheEducationandTrainingUnits.Theseareoutlinedintheoutcomessectionofthisreport.Whileexcluded,webelievethe‘socialcapital’outcomewarrantsfurtherunderstandingwhenviewingthevalueofCompassasawhole.

ThefinalimpactoftheCompassEducationandTrainingUnitswasdeterminedbyapplyingtheindicators,proxiesandimpactmethodologyoftheSROIframework.Theresultingimpactratiois1:10.31.Inotherwords,forevery$1CompassinvestsintheEducationandTrainingUnits$10.31ofvalueiscreated.Tofullyunderstandthecontextofthisratioitisimportanttounderstandthejudgementsappliedduringtheassessmentprocess.Assuchtheyareoutlinedindetailwithintheoutcomessectionofthisreport.

WewouldliketothanktheopennessoftheCompasscommunity—thestakeholders,staffandmembersofthebroadercommunity—fortheirparticipationduringthisSROIassessmentandtrustthisreportwillbeusefultofutureservicedevelopment.


INTRODUCTIONTOTHEPROJECTThisprojectwascommissionedbyNationalDisabilityServicesQueensland(NDSQld)aspartofadesiretoexploretheuseoftheSocialReturnonInvestment(SROI)methodologyasatooltoevaluateservices.ThepurposeoftheprojectistodeterminetheusefulnessoftheSROImethodologyinassistingtheshiftofconversationswithstakeholdersandfundersfromoutputs,suchashoursofservicedeliveryornumberofpeoplesupported,todemonstratedimpactoroutcomes.Currentreportingonoutputsdoesnotenabledifferentiationbetweenhowservicesaredeliveredandwhatoutcomesareachievedthroughdifferingapproaches.Outcomesarenowofgreaterimportanceandbeingabletoprovideevidenceoftheseisbecomingincreasinglyimportantasthesectormovestowardsindividualchoiceandmobilefunding.

SROIMETHODOLOGY

ThetoolselectedbyNDSistheSROIframework,developedandpublishedbytheSROINetwork2.ThisframeworkisamethodologythatarosefromaprogramonmeasuringsocialvaluefundedbytheUKGovernment.TheSROIassessmentisdesignedtoincludeabroaderperspectiveonvaluebymeasuringchangecreatedandusingasteppedprocesstovaluethatchangeeconomically.Themethodologyreliesonasetofprincipleswhichareappliedduringtheassessment:

involvestakeholders understandwhatchanges valuethethingsthatmatter onlyincludewhatismaterial donotover‐claim betransparent verifytheresult

AspartoftheNDSprojectanumberofpeopleweretrainedinthismethodologyandthishasbeenalearningexperienceforallinvolved.ThroughoutthisassessmentwehaveattemptedtoidentifyandarticulatewhathasbeenlearntinordertomakerecommendationsforfutureuseofthistoolbybothservicesandNDS.

REPORTSCOPE

ToachievetheoverarchingpurposeofthisprojecttwoserviceswereselectedtoapplytheSROImethodology:Compass(thesubjectofthisreport)andALARA(thesubjectofaseparatereport).CompassisamemberoftheNDSnetworkandvolunteeredtobeapilotsite.TwocloselylinkedCompassprogramshavebeenselectedforthisassessment:

1. EducationUnit(Tertiary)2. TrainingUnit

2FormoreinformationabouttheSROIFrameworkvisit:http://www.thesroinetwork.org/publications/cat_view/29‐the‐sroi‐guide/223‐the‐guide‐in‐english‐2012‐edition


Thesetwounitshavepurposesthatarealignedandapplysimilarmethodologiesandthusitisusefultoviewtheimpactoftheseactivitiescollectively.Bothunitshaveabreadthofsubjectsbasedwithinanaccreditedcompetency‐basedframework.Subjectsincludeliteracyandnumeracy,socialandvocationaltraining.ThedifferencebetweenthetwoisthattheEducationUnitisanextensionofthesecondaryschoolenvironmentandthesubjectmatterismoregeneric,coveringeducational,socialandvocationalcontexts.TheTrainingUnitisanotherstepremovedfromtheschoolingcontextandtheemphasisshiftsfromthesocialtothevocationalcontextandonpracticingtheapplicationofskillsinavocationalcontext.

ThisSROIstudyisanevaluativeone;however,itisanticipatedthatCompasspersonnelcanthenusethisworkasabasisforforecasting.Thetimeperiodfortheassessmentisthe2012–2013financialyear.


ABOUTCOMPASSANDTHEEDUCATIONANDTRAININGUNITSPalmwoodsisasmalltownshipintheSunshineCoasthinterlandanditwasherein2003thatCompassstarteditsjourneybyprovidingpost‐schoolservicestothreepeoplewithanintellectualdisability.Now,in2014,Compasshasmorethan30staffandprovidesservicestomorethan70peoplewithdisabilities,theirfamiliesandcarersinCaboolture,Caloundra,GympieandPalmwoods.

CompassisauniqueorganisationinAustraliainthatitisfoundedontheprinciplesandpracticeofatraditionalJapanesemartialart,Aikido;Compassisanalignmentofresourcesandphilosophythatcreatesamediuminwhichpeoplewithadisabilitycanpracticelearningandapplyinglifeskillsthatbenefitthemandothers.ThisnotioniscapturedwithintheCompassvisionstatementas:“ExploringtheArtofLife”.

Compassisovertinstatingthattheirserviceisnotforeveryoneandtheydonotexisttoprovideactivitieswhichsimplyoccupyaperson;allactivitiesservethepurposeofexploringtheartoflife.InthissensetheCompassactivitiesareadailyexpressionoftheirvisionandmission.WhilsttheactionsofCompassmaygenerateanalternativefuturestatetheirpracticeinthepresentisalsothereasonitexists.ThefollowingisadescriptionofCompass’serviceoffering3:

1. InformationExchangeandInduction

Thisisessentiallythefirstcontactphaseoftherelationshipdevelopment:learningabouteachother.

2. FocusUnit

Developmentalprogramforpeoplewithspecialorhighneeds.

3. EnrichmentandCommunityProgram

Alifetimeofflexiblepersonaldevelopmentandgrowth.

4. EducationUnitTertiary

Educationinabroadrangeofsubjects.

5. TrainingUnit

Skills‐basedtrainingtowardsavarietyofvocationaloutcomes.

6. Pre‐vocationalUnit

On‐the‐jobtrainingandtransitionalemploymentinCompassbusinesses.

7. SupportedandUnsupportedEmployment

AvailablethroughCompassSocialEnterprisesorPlacementscheme.

Generally,apersonwithadisabilityjoinsCompassasatraineeafterleavingtheschoolsystem.TheythenenterintoanappropriateCompassprogramandthenchoosetomovebetweentheoptionsastheirskills,maturityandindependencedevelop.Ultimatelypeoplewithadisabilitymaybeabletoacquireasetofskillsthatenablesachoiceofworkforceparticipation.

3CompassInstituteInc.(2014).CompassInstituteInc.StrategicPlanDraft.CompassInstituteInc.


THEORYOFCHANGEIntheSROImethodologythetheoryofchangeisintendedtoarticulatetheintentionoftheserviceprovisionandhighlighttheactivitiesthatarethesourcesofvalueandhowtheyrelatetotheoutcomes(thechangetheserviceisexpectingtosee).InworkingthroughthisprocesstheCompasscommunitywereabletoarticulatenotonlythetheorybutalsotheunderpinningphilosophy(outlinedbelow).

UNDERPINNINGPHILOSOPHY

TherearethreekeyaspectsoftheunderpinningphilosophythatwereevidentinworkingwiththeCompasscommunity:Japanesemartialarts,SocialRoleValorisationandKaizen.

AIKIDO

Asmentioned,CompasshasevolvedwithinthephilosophyoftheJapanesemartialartAikido.TheCEOofCompass,SenseiDavidDangerfieldhasaninternationalprofileasahighlyrespectedandqualifiedpractitionerofAikido.ManyofthestaffmembersandtraineesaretrainedinAikidoandthemartialartspracticeformspartofCompass’weeklyactivities.

SOCIALROLEVALORISATION

Thistheorystatesthatapersonwhoisvaluedbysocietyislikelytohavegreateraccesstothegoodthingsinlifesuchasaneducation,dignityandrespect(Osburn,2006)4.Compassarepurposefulinensuringthatpeoplewithdisabilitiesareseenintheirlocalcommunitiesdoingusefulandvaluedactivitiesandalsobehaving,andbeingsupportedtobehave,inwaysconsistentwithsocialnorms.Doingsoencouragesthevaluingofthepersonwithadisabilitybytheirfriends,familyandcommunity.

KAIZEN

Thelastphilosophy,Kaizen,likeAikido,isalsoofJapaneseorigin.Itisamethodofcontinuousimprovementandisapracticeofimprovingallareasofourlives.HencetheCompassapproachthatlearningisanessentialandnourishingwayoflife.

WhilewearenotcompletelyunfamiliarwithJapanesemartialartphilosophy,SocialRoleValorisationtheoryandKaizenphilosophy,weareconsciousofnothavingthesamelevelofunderstandingorspiritualconnectionwiththeCompass’philosophy.ItisourobservationinworkingwiththeCompasscommunitythatthesethreeareevidentlymorethansimplystatementsofbeliefanddoformthebasisofthoughtsandactionsinservicedelivery.Allthreephilosophiessitcomfortablyalongsideeachotherandcollectivelyhaveastrong,guidingpresencewithinCompass.

4Osburn,J.(2006).AnoverviewofSocialRoleValorizationtheory.The SRV Journal, 1(1), 4-13.


COMPASS’THEORYOFCHANGE

ThedeliveryoftheactivitiesintheEducationandTrainingUnitsfollowtheCompassscriptbasedwithinJapanesemartialartsphilosophy.Theapproachincludespractice,repetitionandsystematicallyapplyingthisenhancedabilitytoadiversityofselectedactivities.Thisbuildsskillsandconfidencethatinturnenablegreaterindependenceandinclusivebehaviour.

Traineesseeninthispursuitprojectavaluablestatustoothersand,inturn,othersthenbestowagreatervaluedstatusontrainees.Thisstatusenhancestheself‐esteemofthetraineesthatthenfeedsbackintothisgenerativesystemtoamplifysubsequentlearning.

Similarly,theprocessoftrainingalsogeneratesfeedbackthatenablesCompasstoimproveitselfasalearningmedium.InthiswayCompass,thetraineesandthebroadercommunityareco‐creatingtheconditionsthatbestenablelearningandapplication.

AnobservationofthislastfeedbackcycleillustratingthelearningfocusorKaizenisevidentinthisanecdote:

John5hasbeeninvolvedasatraineeinCompassforthreeyears.AtfirstJohnfounditdifficulttolearntheskillshewantedtohavebecausethewayweweretrainingwasn’tenablingJohntolearn.Johntaughtustochangethewaywedidthingsandthishashelpedbothhimselfandothers.MostrecentlyJohnwentonaholidaywithhisparentsbecausehehadlearnttoapplytheskillsheneededtobeinanunfamiliarplace.John’sfamilyhadn’tbeenonaholidaytogethereverbefore.WhenJohn’smumtoldusthisstoryshehadtearsofjoyinhereyes.(DavidDangerfield)

Compass’TheoryofChangeisnotalinearprocess;ratheritiscircularandthepracticeitselfcreatesavirtuouscycleofvaluecreationandapplication.

5Alltraineenamesusedthroughoutthisreportarepseudonyms,usedtoensureanonymity.


THESTAKEHOLDERSStakeholdersareanessentialpartoftheSROImethodology.Theyprovideevidenceofthedifferencetotheirlivesasaresultoftheactivitybeingassessed.Thus,determiningwhichstakeholderstoincludeorexcludeintheassessmentisanimportantfirststep.Astakeholderlistwasinitiallydevelopedfromstaffinterviews.Representativesofeachstakeholdergroupwerethenaskedifthelistwasaccurateorrequiredexpansion.Allofthestakeholdergroupsonthesubsequentlistarediscussedherealongwiththerationaleforinclusion/exclusion.

WhetheraparticularstakeholdergroupisincludedinthecalculationoftheSROIisbasedontheprinciplesoutlinedintheSROIframework,inparticularwhethertheyexperienceoutcomesasaresultofwhatisbeingassessed.RegardlessofinclusionorexclusionallgroupsareoutlinedbelowaspartofthestoryoftheCompasscommunity.

TRAINEES

TraineesareconsideredtheprimarybeneficiaryofCompass’activities.EngagementwithtraineeswasbaseduponseveralvisitstoCompassatCaloundra,PalmwoodsCentralandthePalmwoodsfarm.Duringthevisitsmanyspontaneousconversationsandinteractionswiththetraineesalsooccurred,enablingustosubstantiatethetrainees’andcarers’perceptionsexpressedinthemoreformalinterviewandfocusgroupsettings.

Havingsomeexperienceincommunicatingwithpeoplewithlearningdisabilities,wefacilitatedsixsmalltraineefocusgroupsalongwithSallyRhyanen(CompassServiceManager)whoisahighlyskilledcommunicatorandintimatelyfamiliarwiththetrainees’needswithinthegroup.Ithastobesaidthatwefoundthisprocessespeciallyrewardinganditgaveusgreatinsightintothetrainees’perceptionsofCompassandalsotheprofessionalstandardsofCompassstaff.Importantly,aftertheinitialfocusgroupsseveralfollow‐upfocusgroupswereheldtotestthedistillationofoutcomes.

CARERS

Thisgroupincludestheparentsorcarersofthetrainees.TheywereabletoarticulatebenefitsexperiencedasaresultoftheEducationandTrainingUnits’activitiesthatwererelevantforthemaswellasvalidatethestoriestoldbytraineesaboutthebenefitstheyexperience.

Samplesofthetrainees’carerswereconsultedthreetimes.Firstly,threeone‐on‐oneinterviewswereheldtogarnertheseparents’perspectivesaboutCompass.Theseinitialinterviewstheninformedthestructureofthesecondconsultationphase,beingtwoeveningparentfocusgroups.Importantly,thesefocusgroupswereheldintheeveningsofthedaysonwhichthetraineefocusgroupsoccurred.Thisthenenabledustoseekfeedbackfromcarersabouttheperceptionsofthetrainees.OnceagainSallyRhyanenattendedallparentgroupsandwasabletoco‐facilitatethesessions.TheleveloffamiliarityandtrustthatSallywasabletobringtothesesessionsenabledveryinsightfulandattimesmovingstories.


COMMUNITY

Compassisveryengagedinthecommunitiesitoperateswithin.Thereisanargumentthatthewholecommunitybenefitsasaresultofincreasedparticipationofitscitizensandthatthestrengthofacommunityisinthisactiveparticipation.Thisisexploredintheoutcomessection;however,thisgroupwasultimatelyexcludedfromthefinalassessmentasbeingbeyondthescopeofthisassessment.

THESTAFFANDTHEORGANISATION

StandardSROIpracticeexcludesoutcomesforCompassanditsstaffasbeingincludedintheSROIcalculation.However,thereweretwoareasrelatingtostaffandorganisationaloutcomeswherewefeltitwasimportanttoshareinthisreportdespitethefinalexclusionofvalue.Thediscussionofthesetwooutcomesisincludedintheoutcomesectionofthisreport.

FUNDERS

Queensland’sDepartmentofCommunities,ChildSafetyandDisabilityServices(DCCS&DS)fundsCompassandthisfundingdirectlysupportstheEducationandTrainingUnits.Wedeterminedthatthefundersinthiscasearea‘purchaser’ofservicesandthustheoutcomesoftheservicesarenotrelatedtoorexperiencedbythefunders;theydonotexperienceincreasedvaluedirectlyfromtheservices.Thisstakeholdergroupwasexcludedfromthisassessment.Theyareincludedintheimpactmap(seeAppendix)todemonstratetheirinvolvementinprovidinginputs.

FINANCIALCUSTOMERS

ThisgroupincludespeopleororganisationsthathavepurchasedaproductorservicefromCompass.Thesetransactionsmayrangefromthepurchaseofsomejarsofchutneythroughtoregularusersofthegardenandmaintenancecrew.Forthemostpartthisisabusinesstransactionandwhileitcouldbearguedthatitisatransactionthathassome‘feelgood’elementthisisnotextensiveandsomeoftheincreasedawarenessandappreciationofwhatthetraineesaccomplishisaccountedforintheincreasedsocialinclusionoutcome.Thereforenoneofthesestakeholdersweredirectlyincludedinthisassessment.

CORPORATEPARTNERS

CorporatePartnersareindividualsorcompanieswhoworkinotherbusinessesandwhoareengagedinCompassactivities.Thisengagementincludes,butisnotlimitedto,visitstothefarmortrainingactivities,attendanceatCompassevents,andparticipationandorganisationoffundraisingevents.TwostakeholdersfromthisgroupwereinterviewedaspartofthisassessmentandbasedontheseinterviewsthisgroupwasexcludedfromthisassessmentasanyoutcomestheyexperiencearenotderiveddirectlyfromtheEducationandTrainingUnits,butratherfromtheorganisationalactivitiesasawhole.


INPUTS/OUTPUTS

TRAINEEINPUTS

Trainees’primaryinputintotheEducationandTrainingUnitsisattendanceandapplication.InkeepingwiththestandardSROIpracticetheirinputsarenotincludedintheSROIcalculation.Nevertheless,inkeepingwiththeholisticnotionoftheArt‐of‐Life,itisimportanttoaccentuatehowthetraineesareanessentialagentinthedesignofthelearningprocessbecauseofthecontinuous,incrementalimprovements(Kaizen)inprogramdeliverythattheirfeedbackprompts.Hence,thetraineeisnotapassiverecipientofinformation;rather,theyareco‐creatorsofknowledgewithinacycleofimprovement.

CARERINPUTS

Carerinputsarenon‐financial.Theyparticipateintrainees’goalsettingandmanyofthemsupportthetraineesinapplyingtheskillstheylearnatCompassinthehomeenvironment.

STAFF/ORGANISATIONINPUTS

Theorganisationalinputsincludedintheassessmentarethefundsthatareoverandabovethefundercontribution,createdthroughfundraisingandincome‐generationactivities.Stafftimeisrepresentedintheoperationalcostswhicharesplitbetweentheincomerepresentedhereandthefundingdiscussedbelow.

FUNDERS

Thefundinginputsareoutlinedintheimpactmap(seeAppendix).

OUTPUTS

TheoutputslistedinTable1aredirectlyrelatedtothekeystatisticsfortheEducationandTrainingUnitsofCompassfortheperiodoftheassessment.Someoftheseareusedinthefinalcalculationofimpact.Theseareshownintheimpactmap(seeAppendix).

Table1.Outputstatisticsrelevantfortheperiodofevaluation

Attendancetype No.

Trainees 47

EducationUnit–Hoursofattendance 13,950hrs

TrainingUnit–Hoursofattendance 20,430hrs

Carers 73


OUTCOMESANDTHEIRIMPACTTheSROImethodisdesignedtocreateafocusontheoutcomesofactivitiesratherthantheactivityitself;inotherwords,whathaschanged,forwhom,byhowmuch,andwhatisthevalueofthechange.

Thissectionpresentstheoutcomeschosenforeachstakeholdergroupandtherationalefortheirsubsequentvaluation.Foreachoutcomethereisadiscussionabouthowtheoutcomeisevidenced,followedbyhowthevaluehasbeencalculated.Therearethreepartsconsideredinthecalculationofvalue:

1. Whatwouldhavebeentheoutcomeifnothinghappened?(deadweight)2. Whatelsecouldhavecontributedtotheoutcome?(attribution)3. Whatisthereductionoftheoutcomeovertime?(dropoff).

Assuggestedalready,thereareanumberofoutcomesdiscussedherethathavebeenexcludedfromthefinalvaluation.TheseareincludedtodemonstratetheSROIprincipleoftransparencyandtopresentafullerpictureoftheCompassstory.

AnoverviewoftheoutcomesandtheirimpactforallstakeholdersisoutlinedinTable2.Adiscussionaroundthesubsequentvalueisprovidedinthefollowingsectionandtheimpactcalculationsaresummarizedintheimpactmap(seeAppendix).

Table2.OverviewoftheoutcomesandimpactsoftheCompassEducationandTrainingUnitsontraineesandcarers

Outcome Duration Indicator Proxy Impact

Deadweight Attribution Drop‐off

Trainee#1:Capacityandwilltolearn

1yr Changeincapacityandwilltolearn Differentialbetweentertiaryandsecondaryeducationearningcapacity(basedonminimumwage)

0% 25% 100%

Trainee#2:Autonomy 2yr Changeinskillsrelatedtoautonomy Societyvalueoneducation(basedonsubsidies)

25% 25% 50%

Trainee#3:Socialinclusion 1yrs Changeinlevelofcommunityparticipation

Lifesatisfactionfromincreasedsocialinteraction

25% 50% 100%

Trainee#4:Healthylife 1yr Changeinfitness Averageexpenditureonaccidentandhealthinsurance

0% 25% 100%

Trainee#5:Self‐worth 5yr Changeinconfidence Genderwagedifferential 0% 0% 20%

Carer#1:Peaceof mindandconfidenceinfuture

1yr Changeinpeaceofmindandconfidenceinthefuture(self‐report)

Costdifferentialbetweenpublicandprivateschooling

0% 25% 100%

Carer#2:Capacitytodosomethingelse

Iyr Changeincapacitytodosomethingelse(self‐report)

Costdifferentialbetweenpension/carerallowanceandminimumwage

0% 0% 100%

Family#1:Familyfunctioning

5yr Changeinparticipationinfamily Costdifferentialbetweencouplelivingcostsandindependentcohabitationcosts

50% 50% 20%

Compass#1:Organisationallearning

n/a Changeinknowledgeandorganisationalcapacity

n/a n/a n/a n/a

Compass#2Improvedstaffpractice

n/a Changeinknowledgeandcapabilityofstaffmembers

n/a n/a n/a n/a

Community#1:Socialcapital

n/a Increaseinstrengthofcommunityduetoincreasedparticipationofthetraineecohortinthecommunity

n/a n/a n/a n/a

17

NOTEABOUTDATACOLLECTION

Throughoutthisreportwehaveusedanumberofself‐reportandthirdpartyperceptionsandobservationsforindicators.Atfirstwewereconcernedaboutthesubjectivityofthesetypesofindicators;however,Powdthaveeetal.(2008)6offersomecomfortbyhighlightingstudieswhichsupportthevalidityofself‐reportingandthirdpartyperception.

Thirdpartyperceptionisparticularlyimportantinthisassessmentbecauseofthepotentialtoprojectoutcomesuponthetraineesduetointerpretivemisunderstanding.Hence,aftereachofthetraineefocusgroupswewouldseekconfirmationofourunderstandingfromcarerfocusgroupsandalsotheperceptionsofCompassstaffhavingsubstantiveknowledgeofeachtraineebothinsideandoutsideofCompass.

Importantly,wewouldliketoacknowledgethatthetraineesandcarersgaveusastrongsenseoftheirperspectiveofCompassandtheimpactbeingpartoftheCompassexperiencehasonthem.Thequotesthatarescatteredthroughoutthefollowingsectiondemonstratethisvibrantinvolvementofthetraineesandtheircarers.

TRAINEEOUTCOMES

TRAINEEOUTCOMEONE:CAPACITYANDWILLTOLEARN

Discussion

Frominterviews,anecdotesandone‐on‐oneconversationswithallstakeholdersitisclearthetraineesdevelopadesireandanincreasedcapacitytolearn.TheCompassmethodofteachinginvolvesrepetition,whetherthatisinthetrainingroom,outinthefieldsorintheDojo(amartialartshallfortraining).Repetitioncreatesahabitnotonlyintheformbeingpracticedbutalsothedisciplinerequiredtodoso.Successinsmallthingsleadstogreaterconfidenceand“…confidencecreatesstickinessforlearningnewthings…”(DavidDangerfield).

Arguablythisoutcomeandthenext(increasedautonomythroughlearningreal‐lifeskills)areveryconnected;however,theyarenotthesame.Thisisbecausehavinganincreasedcapacityanddesiretolearndoesn’tnecessarilylimittolearningthingsthatenablegreaterautonomyfromothersinthebasicfunctionsoflife.Forexamplechoosingtolearntoplayagame,orlearnhowtotype,orpaintmaybedevelopmentalbuttheydon’tnecessarilyleadtogreaterautonomyoranoutcomeforanyoneelseotherthantheindividual;nordoesthecapacitytolearnonitsownleadtogreaterautonomy.

Thedecisiontoseparateoutlearningskillsfromotherskillsisbasedonthereasoningthatlearningisafoundationskill;havingthisincreasesourabilitytoadaptandchangethroughoutourlives.Inmorerecentneuroscienceresearchthereisafocusontherelationshipoflearningandlife‐longmentalhealth.Theunderstandingthatbrainsgrowandchangethroughoutlifeandthelonger‐termhealthofmentalfunctioningisbeingrelatedtohowoftenwepracticetheskillswehavealreadylearnt,learningnewskillsandconfrontingnewsituations.Itthereforestandstoreasonthathavingacapabilityandwilltolearnwillhaveafundamentalimpactontheabilitytoachieveandanindividual’swellbeing.

6Powdthavee,N.(2008).Puttingapricetagonfriends,relativesandneighbours:Usingsurveysoflifesatisfactiontovaluesocialrelationships.TheJournalofSocio‐Economics,37,1459–1480.


Indicator

Theindicatorforthisoutcomeischangeincapacityandwilltolearnasidentifiedbytrainerobservationandissetat100%.

Duration

Instudyingthedurationofskillretentionresearchshowsthereisonlyaslightlylinearrelationshipbetweennon‐useandretention.Otheraspects,suchaswhetherataskisongoingorhasaspecificstartandend,thelevelofdiscretionalearnerhas,thelevelofconceptualcomplexityandthephysicalcomplexity,heavilyinfluenceretention.Interestinglydecayismostprevalentforsimplecognitivetasksbutnotfortasksthatarecognitivelycomplexormainlyphysicalinnature.7Thegreatestcountertodecayispractice,whichtiesintricatelywiththetrainingpracticesofCompass.

Consideringdurationasksustoformaviewonhowlongthe‘capacityandwilltolearn’willlastbeyondtheinterventionofCompass.Usingourunderstandingoftheresearchdiscussedaboveitseemedreasonabletoputforwardthatlearningismoreofasimpleconceptualtaskandassuchweselecteda12‐monthdurationforthisoutcome.

Proxy

Forpeoplewithintellectualdisabilityschoolingceasesatsecondarylevelunlesstheyhaveacapacitytoattendvocationalcollege.Compasswasinstigatedfromwatchingyoungadultswithintellectualdisabilityleaveschoolandseeingthem,forthemostpart,deniedtheopportunityoffurtheringtheireducationinaformalsettingandmaintainingandreinforcingtheskillsalreadyacquired.ThusthefocusoftheEducationandTrainingUnitsisoncontinuedlearningbeyondtheendofformalschooling.Thisopportunityfortertiaryeducationhasasignificantimpactonthosewhoareabletoundertakethestudy.Itisforthisreasonthatweselectedarelatedproxy.Theproxyfor‘increasedcapacityandwilltolearn’isthedifferentialinsuccessexperiencedbythosewhoaretertiaryeducated.WehaveusedAustraliandataforthe25–65agegroup8andappliedthisdifferentialtothebasicminimumwage.9Theappliedproxyequatesto$4,666perannum.

Impact

WithoutaccessingCompassitisunlikelytherewouldbesimilaroutcomesforthetrainees.Assuggestedmosttraineeswouldnothavehadtheopportunitytoexperiencethiscontinuededucationalpath.Manyotherdisabilityservicesarebasedon‘dayservices’(generallywithaskillsandsocialfocus)or‘businessservices’(workenvironments).Compass’approachspecificallytargetsthecapacitytolearn.ThecarerswespoketowereadamantthattheotherservicestheyviewedpriortojoiningCompassdidnotprovidethissupportandinfactsaidtheyconsideredthemequivalentto‘babysitting’.Forthisreasondeadweight,orwhatwouldoccurwithoutatraineeattendingCompass,issetat0%.

7Wang,X.(2010).Factorsinfluencingknowledgeandskilldecayinorganizationaltraining:Ameta‐analysis.Dissertation.DepartmentofPsychology:UniversityofOklahoma.8OECD.(2012).RelativeEarningsofworkers,byeducationalattainmentandagegroup.EducationataGlance2014‐OECDIndicators.OECD,p.143.9NationalMinimumWageOrder2014,TheFairWorkCommission.

19

Eachtraineecomeswithsomebaselineskillsinlearning.Regardlessoftheindividualbaselinesthroughtheprogramthetraineesareabletoincreasethiscapacity,asdemonstratedbytheindicator.Themainsourcesofattribution,orotherplaceswheretraineesgainincreasedcapacityandwilltolearn,arelikelytobethehomeenvironmentandanyotherservicestheindividualmayattend.Whiletheseotherenvironmentswillhaveanimpactonthetrainees’overall‘bagofskills’itisdeemedunlikelytheyhavethesamefocusonlearningcapacity.Forthisreasonwehaveadoptedalevelofattributionforthisoutcomeof25%.

Intalkingwithcarersabouthowquicklythis‘capacityandwilltolearn’woulddeclinetheyofferedcompetingexperiences.Onlongerholidayscarershaveseensometraineeslosemomentum.Arguablythisisanexperienceweallshare.Otherstoriespresentedanargumentforthiscapacitytobealifelongone.Inexaminingthewholepicturetheassessorshaveadoptedaconservativedropofffigureof100%.

TRAINEEOUTCOMETWO:AUTONOMY

Discussion

Trainees,carersandtrainersconsistentlyspokeaboutincreasedautonomy.Wealsoobservedmarkedincreasesinthecapacityofseveralofthetraineeswemettocareforthemselveswithinthetimeframeofthisproject.Inonecaseweobservedthatatraineehadlearnttogotothetoiletbythemselvesandmanagetheirownpersonalcarebetweenthefirstandsecondfocusgroups.

Carersspokeofhowtheirtraineesnowcookorhelppreparemeals,ordressthemselvesinthemorning.Somearenowabletogetaboutinthecommunitytomeetfriendsorcatchabushome:

…wecangoawayfortheweekendorleavetogotosomewhereknowingthat(he)willdresswellandifhegoesouthe’lllookOK…(parent)

…oneday(she)gotonthewrongbuslikeanyofuscouldandsheendedupmilesaway.Butsomehowshemanagedtoworkitoutandgetbackhome…(parent)

TheIndicator

Theindicatorforthisoutcomeisanincreaseinskillsrelatedtoautonomy,sourcedfromtrainingrecordsandsetat100%

Duration

Usingtheresearchdiscussedinthepreviousoutcomeaboutskillretentionandapplyingittotheskillsrelatingtoautonomyrequiresustoconsiderwhatthetraineesarelearning.Withoutspecific,relatedexpertisetheviewadoptedhereisthattheskillsrelatedtoautonomywouldhaveahigherphysicalcomponent,whichaccordingtotheresearchisassociatedwithlongerretention.WealsosoughttoreflectthenatureoftheseskillsasbeingfundamentallifeskillsandmostlikelyusedindailylifeoutsideofCompass.Forthisreasona2‐yeardurationhasbeenselectedforthe‘autonomy’outcome.


TheProxy

Atraineewhocannowforexamplegotothetoiletbythemselvesisn’tnecessarilyautonomous.Theymightbeautonomousinthissituationmostofthetimehowevertheyaren’tnecessarilyeverytime.Similarly,apersonmightneverreachasituationinwhichtheycanlivealoneandnormaytheywantto.Infact,asonestaffmemberstated‘acarermayinsteadofmakingasandwichfortheirson/daughter,nowobserveandsupportthemtomakeasandwichforthemselves’.However,whatisundeniableistheshiftorchangeinautonomythatthetraineeexperiencesasaresultofparticipatingintheEducationandTrainingUnitsatCompass.

Initiallyweconsideredthecostofcarownership—somethingthatprovidestheopportunityofindependenceandeachcarownervariesintheirrelianceanduseoftheirvehicle.However,thisrepresentspurchasingautonomyratherthanthevalueofautonomy.Whatinformedthefinalproxyisanunderstandingofthevaluethatthecommunityplacesonbuildingmasteryinlifeskills.Australiansocietyvaluestheideaofbuildinglifeskillsthroughthefreeeducationofferedbythefederalgovernment.Theproxyistheamounttaxpayersarewillingtopaytosupportallyoungpeopletopursuethebasicfoundationlifeskills.Thusthevaluationisaprojectionofthecostthatsociety,astaxpayers,arepreparedtosubsidisethegreatercommunitytoalsoacquirethispropensityviaschooling.UsingcostofgovernmentfundingtoschoolsinQueensland10in2011‐12thisallowsfor$13,154peryear,perstudent,perannum.

Impact

Similartothe‘capacitytolearn’outcomediscussedabove,stakeholdersreportthatwithoutCompass’inputthetraineeswouldnotachievetheseoutcomestotheextenttheydo.Formostcarerstherewasadesirefortheirson/daughtertobeaccessingaserviceandcarerswouldseekoutasimilarserviceifCompassdidnotexist.Withoutexceptioncarersofferedtheviewthatotheralternativeswouldnotbeacceptable.Onecarerevensuggestedtheywouldneedtostayhometoprovidethislevelofactivesupporttotheirson/daughter.Forthisreasonthedeadweight,orwhatwouldhappenwithoutCompass,representsboththeavailabilityofotherservicesandthelackofpreferenceforthesebytheCompassstakeholdersandissetat25%.

Thereareotherplaceswhereautonomyisgained.ManycarersseethemselvesinpartnershipwithCompassandsupporttheapplicationoftheskillsthatbringaboutautonomyinthehomeandotherenvironments.Someofthetraineesaccessotherservicesororganisationsthatprovidesportingandrecreationalopportunities.Boththehomeenvironmentandotherservicessupportratherthanreplacetheintenselearningandgoalachievement‐focusofCompass.Attribution,orothersourcesofautonomyfortrainees,isthereforesetat25%.

Recallingthediscussionofdropoffinskillsfor‘autonomy’thedifferencehereisthattheskillsareindailyuseregardlessofCompass’involvementinatrainee’slife.Forthisreasonwehaveappliedaslightlylessconservativefigureof50%fordropoffforautonomy.

10ProductivityCommission.(2014).ReportonGovernmentServices.ProductivityCommission.Chapter4,p4.5.

21

TRAINEEOUTCOMETHREE:SOCIALINCLUSION

“…theChristmasmarketmakesmefeelhappy–IliketotalktopeopleandIpracticetalkingtopeople….Iambetternow,it’seasiernow”

Discussion

IntheparentmeetingsthereweremultiplereferencestohowCompasshaddevelopedtheirsons’ordaughters’socialskillsandhowhavingtheseskillshasenabledthefamilytofeelmoreincludedandrelaxedinsocialsituations.WeobservedinthePalmwoods’communityseveraltraineeswalkingdownthestreetatlunchtimeandengagingingeneralconversationwithothercommunitymembers.Thereisaveryrealsenseofinclusionandbelonging.

Howtheseskillsaretaughtisbasedonconsistentrolemodellingandbestowingsocialexpectationsuponthetrainees.Forexample,almostinevitably,uponenteringoneoftheCompassfacilitiestraineeswouldapproachuswithconfidencetotellusaboutthedaytocome,orthingstheyhavemade,orsomethingofinterestintheirlife.Priortostartingthisconversationtheywouldobserveintroductoryprotocolssuchasshakinghands,lookingattheperson,respondingtoquestionsof“howareyou”andthenreciprocatingwiththesameorsimilarinquiry,andsoon.

TheemphasisonthispracticeagainseemsadistinctiveattributeofCompassandDavidDangerfieldisconfidentthatimpartingtheseskillsandexpectationsenablesapersontobuildbiggersocialnetworks,notjustfromcommunityinclusionbutalsothroughproactiveacquisition.Anoutcomeofthisisthatthepersonthendevelopsavaluedsocialstatusand,inkeepingwithSocialRoleValorisationtheory,accessesmoreofthebenefitsthatsocietyimpartstopeoplewithgreaterstatus.

TwoexamplesofwheretraineesvisiblygainedstatusweresharedwithusduringourvisitstoCompassservices.ThefirstwaswhereCompassgainedaccesstoanalmostderelictcommunityfacilityinCaloundra,anoldsportingclubhousedesperatelyinneedofmaintenanceinaveryprominentandfrequentedarea.Traineesrolleduptheirsleevesandworkedhard—mostlybrickbybrick—andthecommunitysawthemtakingcontroloftheprocessandre‐establishingthefacilityasacommunityasset.ThesecondexamplegivenwaswhenthetraineesworkedtirelesslyonaparticularlyhotdayhelpingthecommunitytocleanupaparkinPalmwoodsandhowrespectinthecommunitywasbuiltbyworkinghard,stayingfocusedandgettingthejobdone.

Threecarerstalkedabouttheimpactofincreasedinclusiononthelivesoftheirdaughters.Thesearethestories(paraphrased):

Sheisconfidentandverysocialandcanspenduptotwohoursgoingaroundthetownandvisitpeopleandshopsbyherself,everyoneknowsher.

Shewasinvitedtoafamilyeventwhichshewouldnothavebeeninvitedtobefore.

WhenIgototheshopswithhereveryonecallsouttosayhello,sheknowsmorepeoplethanIdo.


Indicator

ThescopeandcapacityofthisSROIanalysisdoesn’tallowforacomprehensivecommunitystudyintothelevelofvisibilityandinclusionofthetrainees;however,basedontheevidenceathand,webelievethattheoutcomeofincreasedmeaningfulparticipationisrealandaconsequenceofhowCompassworks.Thisisassumedtobereasonablylocalbecausetheanecdoteshavefocusedmostlyuponthetraineesbeingseen,literally,positivelyinallofthecommunitiesCompassoperateswithin.Theindicatorusedis‘changeincommunityparticipationbytraineeswithinthepast12months’andissetat80%.

Duration

Arrivingatanunderstandingofthedurationofthisexperienceofincreasedsocialinclusionisnotstraightforward.Theprecursorisbuildingthecapacityfortraineestoincreasetheirsocialparticipationthroughthetechniquesdescribedaboveofmodellingandexpectation.Inapplyingtheseskillsinthecommunitytheresultingoutcomeexperiencedhereisincreasedpersonalnetworks.TheskillsapplyinanysettingandthenetworkswillalsoinevitablybeexperiencedbeyondCompass.Usingstakeholderfeedbackthedurationforthissocialinclusionoutcomeissetat2years.

TheProxy

Wehavechosenaproxyrelatedtolifesatisfactionforthisoutcome.Powdthavee(2008)11wroteatlengthaboutthelinkageofincreasedsocialnetworksandparticipationinsocialcommunitybeingtangiblyandpositivelylinkedtolifesatisfaction.WhilePowdathavee’spaperquotes£85,000peryearastheupperlimitofthevalueofthissatisfactionanamountof£15,500isofferedasbeingmorerepresentativeofthelargerpartofthestudyparticipants.GiventheaveragewageintheUKatthetimeofthestudywas£9,800weusedthistorepresentthevalueasanincreaseof158%oftheaveragewage.RatherthanapplyingthispercentagetotheaverageAustralianwage,forconsistencywehaveusedtheNationalMinimumWageannualisedat$33,327,whichresultsinafinalfigureforthisproxyof$52,711.

Impact

BuildingtheskillsandapplyingtheseskillsisaspecificattributeofCompass’approach.InthearenaofsocialparticipationthisprovidesevidencethatCompassisasignificantcontributortotheexperienceofthisoutcome.Somecarersspokeoftheexperienceofhavingtheirson/daughtersitonthecouchintheabsenceofCompass.Aspreviouslydiscussed,theideathatCarerswouldseekoutanotherservicecannotbediscounted.TheofferingofthefocusedsupportofCompassandthestatusofbeingaCompasstraineeleadsustooptforadeadweight(orwhatwouldbeexperiencedwithoutCompass)of25%.

Inunderstandingwhereelsetraineeswouldexperiencesocialinclusionitisimportanttorecognisetheinvolvementoffamilies.Familiesparticipateinvaryingdegreesintheirlocalcommunitiesandthustraineeswouldbeapartofthisinteraction.Anumberoftraineesalsoparticipateinsportingeventssuchasthe‘SpecialOlympics’,socialgroupsandothernonCompassrelatedservices.Inrecognitionoftheinvolvementoffamiliesandotherservicestheattributionissetat50%.

11Powdthavee,N.(2008).Puttingapricetagonfriends,relativesandneighbours:Usingsurveysoflifesatisfactiontovaluesocialrelationships.TheJournalofSocio‐Economics,37,1459–1480.

23

DropOff

Whilesocialnetworksareoftenveryrobust,intheinstanceofwherethisisnotonlyanetworkbutalsoaskill‐relatedoutcomethedropoffissetat50%

TRAINEEOUTCOMEFOUR:HEALTHYLIFE

Discussion

BeingbasedwithinamartialartsparadigmCompassexplicitlypromotesgooddiet,exerciseandhealthylifestyleandeverydaypracticalexamplesofthispracticeareevident;attheCompassfarmorganicfoodisgrownandprocessed;carerscommentonhowtheirsonsanddaughterscomehomeandproudlypresentfreshproduceharvestedthatday.Similarly,oneachvisittothefarmweweremadeawareoftheimportanceofbeingableto‘climbthehill’upbehindthefarm.Itwassaidthatwhentraineesfirstarrivemanyareunabletoachievethis;however,aftergainingfitnesstheygenerallycan.

HavingexperiencewithinthedisabilitysectorourobservationisthatthisomnipresentfocusonhealthandexerciseissomethingthatsetsCompassapartfromotherservices.Hence,valuingthisoutcomeappropriatelyisimportant.

TheIndicator

Theindicatorusedforthisis‘changeinfitness’asidentifiedthroughtrainerobservationsandrecordsandissetat60%.Itisacknowledgedthatthisisasubsetofahealthylife;however,itisaverytangibleelementofhealthandonethatisvisiblyevidentatCompass.

Duration

Thedurationofthisoutcomeisdeterminedtobe12monthsbasedontrainerperceptions.

TheProxy

Wehavefoundthisparticularvaluationdifficultforafewreasons.Thefirstreasonbeingthatthechangeinhealthfortraineescouldnotbequantified.Secondly,thereisabroadrangeofproxiesthatcouldbeconsidered,givingvastlydifferentoutcomesintermsofvalue.Weexplorethreeseparateproxieshereandthenprovidearationaleforthefinalselection.

Initiallywesettledonthecostofachievingthisoutcome:gymmembership.UsingtheinformationfromtheAustralianBureauofStatisticstheaveragehouseholdexpenditureperweekonhealthandfitnessstudiochargesis$2.71.12However,thisisnotanidealmeasureasitismerelyreplacingthecostofservicedeliveryatCompasswiththecostofbuyingtheoutcome.

Insuranceisawayofexpressingwhatpeoplearewillingtopaytoavoidtheoutcomeofpoorhealth.Assuch,expenditureonhealthinsurancewasthenextproxyweconsidered.AgainapplyinginformationtakenfromtheAustralianBureauofStatisticsin2012,householdsspent$26.24perweekonaccidentandhealthinsurance.13

12AustralianBureauofStatistics.(2011).4156.0‐SportsandPhysicalRecreation:AStatisticalOverview,Australia,2011.AustralianBureauofStatistics.13AustralianBureauofStatistics.(2012).TheYearBookAustralia2012.AustralianBureauofStatistics.


Theseinitialproxiesseemedtounderstatethevalueofthisoutcome,failingtocapturehowmuchpeoplevaluetheirhealth.Forexample,ifapersonbecomessickitisassumedtheywouldbepreparedtopaymuchmoretobehealthyagainthansimplythecostofgoingtothegymorhealthinsurance.Consequently,theproxybestabletoexpressthisthinkingistheaverageexpenditureonhealthservicesperpersoninAustraliaasageneralreflectionofhowmuchanAustraliancitizenvalueshealth:

In2011–12,Australiaspentaround$140.2billiononhealth…Expenditureincreasedfrom$4,276perpersonin2001–02to$6,230in2011–12.14

Thisvalueofhealthisthenprojecteduponthetraineesandappliedat$6,230peryear.

Thereisasignificantdifferenceintheseexpendituresonaweeklylevelfrom$2.71(gym),$26.24(healthinsurance)throughto$119.80(expenditureonhealth).Toapplyeitherthegymortheexpenditureonhealthseemedtorespectivelyunderandovervaluethisoutcome.ThereforeinlookingatallthreeproxieswedeemedthehealthinsuranceproxyasthebestrepresentationofthevalueofthefocusonhealthatCompassandvaluedthisat$1364.48perannum.

Impact

TherewassignificantanecdotalevidencefromcarersthatthisisanoutcomethatwouldnotbeachievedwithoutattendanceatCompass.Asforalternativeservices,inourexperiencetherearefewservicesthatweareawareofthathavethisemphasisonhealthandwellbeing.Thedeadweightissetat0%,meaningthatifthetraineedidn’tattendCompasstherewouldbelittlechangeintheirhealthandwellbeing.

DespitetherationaleoutlinedaboveoffewothersourcesbeingevidentitcannotbearguedcategoricallythattraineesdonothingtowardsahealthylifeoutsideCompass.Forexampleonefamilyspokeofaneveningwalkroutinetheywereintroducingtotheirlifestyle.Forthisreasonattributionissetat25%;thatis,that25%ofthehealthoutcomescomefromsourcesoutsideCompass.

Dropoff,orhowquicklythehealthoutcomeswouldfallawayifCompasswerenotavailabletotrainees,isseenasveryhigh.Thisfallsintothelivedexperienceofmostofus—thatwhenstoppingahealthregimethedownfallisquick.Forthisreasondropoffissetat100%.

TRAINEEOUTCOMEFIVE:SENSEOFSELF‐WORTH

Discussion

Thereisclearevidenceoftraineestakinggreatprideintheirachievements.Asmentionedpreviouslytherewasarealdesireamongsttraineestoshoworexplaintousexamplesoftheirachievementsbothonmeetingusandinthefocusgroups.Similarly,carersalsospokeoftheirsonsanddaughtersbeingproud:“…helovescominghomewithfreshvegiestogivetome”(Parent).

Whatthevalueofself‐worthistoanindividualissimilarinconcepttothepreviousdiscussionaboutahealthierlife.Inasummaryoftheacademicliteratureregardingself‐esteem(arelated

14AIHW.(2014).http://www.aihw.gov.au/WorkArea/DownloadAsset.aspx?id=60129548150

25

concept)Baumeisteretal.(2003)15identifythat“…highself‐esteemfacilitatespersistenceafterfailure…”andthatthey(theresearchers)were“…persuadedthathighself‐esteemdoesseemtoleadtogreaterhappiness.”Thesenotionsseemtofitwellwiththegeneralfeedbackaboutthetraineespracticingrepetitionandlearningthedisciplinestheyneedtolearnmoreandthehappinesstheyclearlygainfromacquiringnewskills.

Thisoutcomeisverydifficulttomeasureandvalue;however,whenfacedwiththefollowingstatementswedeemeditimportanttoincludeitinthefinalimpact:

…ImadeaspeechandIwashappy—everyonewasclapping…IcooklunchhereatthecanteenandathomeIcookpotatobake.

…Icangotothetoilet.Idon’tneedanyhelp.

…IlikewritingandIamaverygoodwriter.

…Ifeelgood—Icandoanything—Ifeelyounger—mumanddadareproudofme.

…there’salotofpicturesofme[doingthings]…Ifeelproudandsharing.

Indicator

Theindicatorusedis‘changeinconfidence’asidentifiedbytrainerobservationsandissetat100%.

Duration

KusterandOrth(2013),16intheirlongitudinalstudyofthestabilityofself‐esteem,aconstructrelatedtoself‐worth,foundthatthestabilityofself‐esteemisrelatively“large,evenacrosslongperiods”.Infactconsideringanindividual’sself‐esteemitislikelytobesimilar5,10andeven30yearslater.Consideringthisresearchaverylongdurationcouldbeselectedforthesetraineesforthisoutcome.However,weareconcernedthattheoldertraineesbecomethegreatertheinfluenceontheirself‐worthwillcomefromotherareasofatrainee’slifeanditisreasonable,therefore,toapplya5‐yearduration.

Proxy

Initiallyweturnedtoresearchandtheacademicviewofself‐worth.Baumeisteretal.(2003)17inthepaper“Doeshighself‐esteemcausebetterperformance,interpersonalsuccess,happiness,orhealthierlifestyles?”foundtheonlyclearlinkbetweenhighself‐esteemandanoutcomewasthatofhappiness.However,wewereconcernedabouttheexpansivenessoftheconceptofhappinessandthemeasurementofthisinrelationtoselfworth.Muchoftheeconomicvaluelinkedtohappinessfocusesonthecausality.

Nextweconsideredtheideaofsocialstatusasanexternalexpressionofself‐worth.Whilewhatwesawinthetraineeswasaninternalsenseofidentity,purposeandplaceintheworlditseemedasmoothtransitiontoviewapotentialproxyofthatprojectedexternally.Inseekingto15Baumeister,R.Campbell,J.Krueger,J.&Vohs,K.(2003).Doeshighself‐esteemcausebetterperformance,interpersonalsuccess,happiness,orhealthierlifestyles?PsychologicalScienceinthePublicInterest,suppl.4.1.16Kuster,F.andOrth,U.(2013).TheLong‐TermStabilityofSelf‐Esteem:ItsTime‐DependentDecayandNonzeroAsymptote.PersonalityandSocialPsychologyBulletin, 39(5),677–690.17Baumeister,R.Campbell,J.Krueger,J.&Vohs,K.(2003).Doeshighself‐esteemcausebetterperformance,interpersonalsuccess,happiness,orhealthierlifestyles?PsychologicalScienceinthePublicInterest,suppl.4.1.


expresstheexperienceofsocialstatusweinvestigatedwherethisisexpressedfinancially.Whilepotentiallycontentious,oneofthemostvisibleanddiscusseddifferentialsinstatusisthedifferenceingendersasexpressedbythedifferenceinaveragewagesbetweenmenandwomen.

Thishasbeenbasedontherebeingarealdifferenceinwagesbetweenthesetwocohortsfornologicalreasonotherthanaperceiveddifferenceinstatusbythosewiththepowertodistributeresources(atasumcollectivelevel)andisthereforeanexampleofthevalueofstatusforaportionofthepopulation:

InNovember2013,thegenderpaygapstoodat17.1%.Theaverageweeklyordinarytimeearningsofwomenworkingfull‐timewere$1,270.30perweek,comparedtomenwhoearnedanaverageweeklywageof$1,532.80perweek,makingwomen’saverageearnings$262.50perweeklessthanmen18.

Inthinkingaboutaproxyforself‐worthwehaveselectedtheproxyofthedifferentialofwagesbetweenmen’sandwomen’saverageearningsandappliedthisas$262.50perweek,or$13,650perannum.

Impact

Inlisteningtothecarers,thetraineesandthetrainerswehaveformedaviewthattheself‐worthofthesetraineeswouldremainunchangedwithoutCompassintervention.Whiletherewouldbeotherservicesandrelationshipsthatmayimpactonself‐worthitappearsthattheparticularmixoftheCompassphilosophyinpracticecreateschangeinthisareawhereitwouldperhapsotherwiseremainstable.Forthisreasondeadweightandattributionaresetat0%.Giventherelativelystablenatureofself‐worthadropoffrateof20%hasbeenselectedbasedonourpersonaljudgement.

CAREROUTCOMES

CAREROUTCOMEONE:PEACEOFMINDANDCONFIDENCEINTRAINEE’SFUTURE

Discussion

ManycarersspokeaboutthelongsearchestheyhadundertakentofindCompass.IntheiropiniontheavailablealternativestheyfounddidnotcreatetheopportunitiesthatCompassoffers.Therewerestoriesofvisitingnumerousservicesandthefrustrationsoffindingapaththroughthebureaucracyofpost‐schooloptions.Acrosstheboardcarersspokeofasenseofpeace,aconfidenceinthefutureandaknowingthattheyhadmadetherightdecisioninaccessingCompassfortheirsonordaughter:

MysonBillhasbeenatCompassfor5yearsnow.WearereallyhopinghedevelopstheskillstoworkontheCompassFarmoneday.MywifeandIreallyfeelcomfortableknowingthatBillislearningataplacethathasthesamevaluesasourfamily.It’sreallyimportanttodoconstructivethingsinlifeandthat’swhatCompassdoes—constructivethings.Billlikesthisandthismakesushappytoo.(Parent)

18WorkplaceGenderEqualityAgency.(2014).Genderpaygapfactsheet[online].Availableat:https://www.wgea.gov.au/sites/default/files/2014‐03‐04‐Gender_Pay_Gap_factsheet_website.pdf

27

IreallywantmydaughterJanetodevelopherlifeskillsbecausethiswillenablehertoparticipatemoreindependentlyinlife;thisisgoodforherandit’sgoodforourbroaderfamilybecausewecanenjoyourrelationshipdifferently.Mostchoicesavailabletousaremorebabysittingorentertainmentoptionsandwhilstthisisgoodforhersocially,it’sgreathavingCompassthatpackagesupactivitiesandtrainingtogether.ItmeanswestillgetthebenefitsofbeingabletodootherthingswhileJaneisatCompass,butwealsogetthebenefitsofknowingJaneishappyandsafewhilstlearninglifelongskills.It’savirtuouscircle.(Parent)

Indicator

Theindicatorisbasedonself‐reportofincreasedpeaceofmindbycarersexpressedinthefocusgroups.Whilstwearenotabsolutelycomfortableusingthistypeofindicatorduetoitssubjectivenaturetherewasoverwhelmingaffirmationfromallcarersthatthiswasanoutcometheyexperience.Themagnitudeoftheindicatoristhereforeapplieduniversallyat100%.

Duration

Whilethecarerspresentedwithaverystrongsenseofpeaceofmind,allcarerswereawarepeaceofmindcanchangeinaveryshortperiodoftime.Forthisreasonwewereuncomfortableusinganydurationbeyond12months.

Proxy

Ifthispeaceofmindwasenduringitwouldbepriceless.However,theintentionhereistoplaceaneconomicvaluethatisproportionatetotheotherproxies.Arguablyasimilarsituationoccurswherecarersnegotiatethecostdifferencebetweenprivateandpublicschooling.Oneofthekeydecisionscarersmakeintheirchild’slifeisabouteducation.Wheremoneyisnotthesoledeterminantthisdecisionrepresentsanexpressionofwhatcarersbelieveisthe‘rightpath’fortheirchildincreatingthefuturetheydesireforthem.Wheretheychoosepublicschoolingtheyaresavingthecostoftheprivateeducation,wheretheyselectprivateschoolingtheyareinvestingthatcost.Thisisofcoursebasedonthepremisethateitherchoiceprovidescarerswithcomfortaboutmakingtherightchoicefortheirchild.Wehaveselectedaproxyofthedifferentialcostofpublicandprivateschoolingandapplythisproxyasthe‘costsaving’or‘investmentcost’thatrepresentstherightdecisionforthatfamily.Thevalueofthisdecisionis$17,955.00perannum,andisthedifferentialbetweenwhatitcoststosendachildtoagovernmenthighschoolandtheequivalentcostofsendingachildtoaprivatesecondaryschool.19

Impact

Withoutexploringthedynamicsofeachfamily,whattheyvalueandhowtheygainpeaceofminditisdifficulttoapplydeadweightandattribution.DeadweightisalittlemorestraightforwardascarerswereveryvocalaboutCompass’sroleintheirconfidenceinthefuturefortheirson/daughter.ForthemCompassisintegraltothisexperienceofpeaceofmind.WithoutCompassthecarerssaytheywouldhavetoaccessaservicethatwouldnotprovide

19AustralianScholarshipGroup.(2014).ASGEducationCostEstimatesMetropolitanAustraliaSchoolingCosts2014.AustralianScholarshipGroup.Availableat:http://www.asg.com.au/assets/files/asg_edcosts_schoolcosts_2014_%20nat_metro.pdfaccessed1December2014


themwiththesamesenseofpeace,ortheywouldneedtoreconstructtheirlivesinordertoprovidethisdevelopmentalexperiencethemselves.Forthisreasonwehavesetadeadweightof0%torepresentthisfaithinCompass.Attributionismoreproblematicaspermutationsofpotentialsourcesofpeaceofmindareasvariedasthenumberoffamilies,carersandtrainees.AttributionfromothersourcesisstilldeemedtobeintheminorityinthefaceoftheoverwhelmingsupportbytraineesandcarersoftheroleofCompassinachievingtheirgoalsandthereforewehavesetattributionat25%.

Thedropoffforthisoutcomeisnotimmediate;however,continuinginvolvementofCompassisimportantinmaintainingthisconfidenceinthefuture.Thereforetheamountofpeaceofmindthatwillfallawayis100%withinthe12‐monthdurationofthisoutcome.

CAREROUTCOMETWO:CAPACITYTODOTHINGSOTHERTHANCARING

Discussion

Thecapacitytodothingsotherthancaringspeakstotheexperiencesofthecarers’storiesofwhattheyarenowabletodoasaresultofhavingCompassintheirson’s/daughter’slife.

OnecouplearticulatedthisinexplainingtheconsequencesofnothavingCompass.Hewouldhavetopullbackfromthebusinesstheyruninordertobemoreavailable.AnothercarerspokeabouttheabilitytonourishherselfasaresultofCompassbeinginplace.Carersspokeatlengthonthedifferentexperiencesinparentingtothoseintheirsocialgroup.Otherparentswithchildrenthesameagesasthetraineesareabletofreeuptheirtimeandengageinotheractivities;inacarerrolethisisnotthenaturaltransitionofmaturation.HavingCompassmadethisexperiencemoreavailable.

Howeachcarerusesthiscapacityisdifferent.Whatisthesameistheunderlyingexperienceofbeingabletostepawayfromthecaringroleandengageinsomethingoutsideofthatrole.Thisoutcomeisaboutvaluingtheabilitytoengageinsomethingofthecarer’sownchoice,whetherthatbeemployment,socialorrecreational,oreducational.

Indicator

Aswiththeabovecareroutcomeof‘peaceofmind’theindicatorusedisself‐reportofcapacitytodosomethingoutsidethecarerrolebycarersinfocusgroups.Thesameconcernsexpressedabovearereiteratedhere.Theindicatoris100%.Thisisappliedtoeachfamilyratherthaneachcarertoavoiddoublecounting.Thisindicatoralsoexcludesthosecarerswhohavesons/daughtersinsupportedaccommodation.

Duration

Theapproachofthecarersinvolvedinengaginginotheractivitiesismedium‐andlong‐terminnature,suchasbuildingtheirownbusinessorbeinginemployment.Whilethisoutlookpointstoalongerduration,takeawayCompassinvolvementandthischangesimmediately.Despiteadesiretohonourthissenseofstatusquo,duetothelatterstatementthedurationofthisoutcomeissetatthelowesttermallowableintheSROImethodology—12months.

Proxy

Theproxyselectedhereis‘seekingtoexpressthevalueofthechoicetostepawayfromthecarerroleanddosomethingdifferent’.Thusitisthedifferencebetweenthepensionpluscarersallowanceandtheminimumwage.

29

Thepensionof$842.80perfortnight(inclusiveofbase,pensionsupplementandcleanenergysupplement)isselected,asitisarepresentationofwhatthecommunitydeemsanappropriateincomeforindividualswhoarenotengagedinemployment.Thecarer’sallowanceof$118.20perfortnightisaddedtothisasitrepresentstheadditionalroleofcarer.20Thismaybealargelyfictitiousscenarioinpractice;however,wedeemedthatjustusingthecarer’spensionalonetorepresenttheroleofcarerwouldleadtoanoverstatementofthevalueofthisoutcome.

Therepresentationofachoicetostepawayfromthecarerroleistheminimumwagesetat$640.90intheNationalMinimumWageOrder2014.WeconsideredusingtheaveragewageofAustralianworkersbutwereconcernedthiswouldalsoleadtooverstatement.

Theproxyofthevalueof‘thecapacitytodothingsotherthancaring’istherefore$160.40perweek.

Impact

Theimpactofthisoutcomeisverysimilartothecareroutcomeofpeaceofmind;bothareexperiencedinthemomentandasaconsequenceofthepresenceofCompassinthefamily’slife.Thereforedeadweightandattributionaresetat0%anddropoffissetat100%withintheyear.

FAMILYOUTCOMES

FAMILYOUTCOMEONE:FAMILYFUNCTIONING

Discussion

Inseekingtounderstandthisoutcomeweengagedinaconversationatthecarerfocusgroupsaroundchangesinfamilylifeasaresultoftheirson/daughterattendingCompass.Oneofthecouplessharedthattheywereonlyabletoattendthiseveningsession(asacouple)becausetheirdaughterwasabletostayathomeandmakedinnerforherself.Similarstoriesweretoldwithdifferinglevelsofindependencebutsimilarlevelsofchange.Anothercarerillustratedherstorybysaying“…itislikeIamsharingahousenow”.Otherstorieswereaboutchangesinrelationshipsbetweensiblings.Clearly,therearemanyrelationshipswithinafamilyandsohowthisoutcomeisevaluatedisdetailedinthediscussionbelowaboutthechosenproxy.

Indicator

Theindicatorusedis‘increasedcontributionoftraineetofamilylife’asratedbytrainerobservationandissetat80%ofthecohort.

Duration

Thedurationofthischangeisjudgedtobelongtermbecauseitisassumedthatfamilymembersreinforcethechangeinthestateofthefamilyrelations.Neverthelesstonotoverclaimthevaluebasedonthisassumption,a5‐yeardurationisselected.

20Centrelink.(n.d.).Paymentsfor[online].Availableat:http://www.humanservices.gov.au/customer/dhs/centrelink.Accessed27November2014


Proxy

…itislikeIamsharingahousenow.[parent]

Itwasthisparticularobservationbyacarerthatleadustoconsidertheanalogyofahouseholdofadultslivingindependentlycomparedtoafunctionalfamilysituationinwhichcarersandadultoffspringlivetogetherwithincaringrelationships.Differentcostsoflivingapplyineachcircumstance.

Forthisproxyanextrapolationofthecostdifferencewasdevelopedusingcostoflivingforanindependentretiree(excludingcostofhousing)tothatofaretiredcouple.Baseonamodeststandardoflivingtheannualdifferenceis$6531perperson.21

Thisisthevalueperperson.Toapplythissavingwouldmeanapplyingtheperpersonvaluetoeachpersoninthefamily.Ifthislogicwasappliedprorata,accordingtothesizeofthetrainee’sfamilythisfigurecouldbecomeextremelylargeandforthisreasonwefeeltheproxywouldlosecredibility.Toavoidthis,thenotionofwhatconstitutesafamilyistakenandappliedasitssmallestformbeingtwopeople,whichattractsaproxyvalueof$13,062perannum.Thisfullamountisappliedtoeachfamilyinwhichbetterfamilyfunctioningisperceived.

Importantly,ifatraineelivesoutsideoftheirparent(s)/familyhome,thesameoutcomeisconsideredandvalued,usingthesameproxy,becausewejudgethesetoffamilyrelationshipsnottobeboundedbyphysicalproximity.

Impact

Amaturationprocessoccursfortraineesandthussomeofthesechangescouldoccurwithoutanyintervention.However,thespeedofthismaturationisverymuchincreasedbytheintensiveeducationandtrainingfocusatCompass.Thereforethedeadweightissetusingpractitionerjudgmentat50%.

Givencarersareactivelyinvolvedintrainees’goalsettingintheeducationandtrainingactivitiesofCompasstheyarepotentiallytargetedaroundthespecificdynamicsofeachfamily.However,thesourceofattributionwouldshifttothefamilymembersfairlyquicklyastheywouldreinforceandbecomethekeysourcetoreinforcethischange.Thereforeattributionissetatarateof50%.

Itisunlikelytherewouldbemuchdropoffasthechangesoncemasteredwouldbereinforcedbythefamilyunit;however,ratherthansetit0%wehaveusedamoreconservativedropoffof20%.

21ASFA.(n.d.)ASFARetirementStandard[online].Availableat:www.superannuation.asn.au/resources/retirement‐standard,accessed3December2014.

31

COMMUNITYOUTCOME

COMMUNITYOUTCOMEONE:SOCIALCAPITAL(EXCLUDED)

InthisanalysissocialcapitalisinterpretedasbeinggoodwillamongstcommunitymembersandisdiscussedhereinthecontextofthecommunitiesinwhichCompassoperate.RobertPutnam(1995)22elevatedthenotionofsocialcapitalafterthereleaseofhisessay‘BowlingAlone:America’sDecliningSocialCapital’.

Putnampresentedthecasethatcommunitieswerelosingasignificantcomponentoftheirinfrastructureaspeopledisengagedfromtheparticipatorynormsofasocietysuchasbelongingtoandattendingchurch,orbeinginvolvedinexpressionsofcivicengagement.Inwhichcasethereisanerosionofgoodwillamongstpeopleandthepropensityforactivitiesthatfurtherdestroycommunityvalueincreases,suchascrimeandalackofcommunitypride.

InthecaseofCompasswhatisbeingsuggestedisthatinthecommunitiesinwhichCompassparticipatesthereisadditionalgoodwill.ThePalmwoodscommunity,forexample,isbetteroffbecauseofCompass’presenceandsothetrainingandeducationprograms,asanintegralpartofCompass,arethereforegeneratingpartofthisvalue.

InpreviousdiscussionsaboutsocialinclusionandsocialrolevalorisationweacknowledgedthatthetraineesgainvaluefromtheirclosestcommunitiesbecauseoftheirincreasedsocialstatusandaproxyvaluationisalreadyinclusivewithintheSROIratioofthisvalue.ArguablythoughthisisasubsetofthetotalsocialcapitalstimulatedbyCompass’activities.ForexamplepeopleexperiencingasenseofcommunityattheCompassWabiSabishopinPalmwoodsmaybeinclinedtoexpressgoodwillorgenerositytoothermembersofthecommunity.

Directpracticalexamplescanbeseenintheexperiencesofthetwobusinesspeopleinterviewedduringthestakeholderconsultation:

DavidalsoinvitedthesalesteamtotheDojoandtheCompasstraineesandstudentsputonanexhibitionforus.Itwassomotivatingtowatchandbeapartof.Itgotusoutofthenormaldaytodayandintoanotherworldwhichwasincrediblyinspiring.Ithinkwealltakethisbackintoourwork.(JulieRyan,HotFMPrimeRadioSunshineCoast)

Igototheawardsnightandthisisagreatnight.Itreallymakesmefeelgreatseeing[thetrainees]uptheregettingtheawardstheyhaveearned.Theyallgetoneandtheprideandanticipationis…wellit’sunbelievable.Itputsmylifeintoperspective.Iamaluckyman.(RussellKay,CoastLifeHomes)

Nevertheless,whilewehadadesiretopursuethevaluationofthisoutcometherearetwoelementswhichpreventinclusionintheSROIratio.FirstlytheresourcesrequiredtoconductafullimpactassessmentofthecommunitiesCompassoperateswithinareprohibitiveandsecondlyunderstandingthedirectimpactthattheEducationandTrainingUnitshaveascomparedtotheimpactofCompassasawholeisproblematic.

Nevertheless,weacknowledgethatsocialcapitaldoesexistanditsvalueisatleastpartiallyacknowledgedwithinthevaluationof‘increasedsocialinclusion’.

22Putnam,R.(1995).Bowlingalone:Americasdecliningsocialcapital.JournalofDemocracy,Jan,65–78.


ORGANISATIONALOUTCOMES

Therearetwooutcomesconsideredhere:

Improvedstaffprofessionalpractice Improvedorganisationalpractice

BotharerelatedtotheKaizenapproachwherelearningisincorporatedintothedailypracticesofCompass.

GenerallytheSROImethodologydoesnotincludeorganisationaloutcomes.Anybenefitgeneratedmustbeattributabletoastakeholdergroupwhoexperiencesthebenefit.Thisbenefitoncequantifiedisthenassessedagainstotheralternatives(attribution,deadweight)aspartofdeterminingwhatimpactCompasshasoverandaboveanyothersourceofvalue.Thisiswheretheargumentbecomesproblematicandtheultimatereasonwhyboththeseoutcomesarenotincluded.

ORGANISATIONALOUTCOMEONE:IMPROVEDSTAFFPROFESSIONALPRACTICE(EXCLUDED)

Discussion

IninterviewsandthemanydiscussionswehadwiththeCompassstaffitwascleartheyallfeltthattheorganisationwasdevelopingthemasprofessionalswithinthedisabilitysector.DavidDangerfield’sexplanationofhowCompassextendsstaffrecruitmenttopeoplefromoutsidethedisabilitysectorandthenteachesthemtheskillsneededtoworkatCompassandwithinthedisabilitysectorreinforcedthistheme.StaffalsoarticulatedstaffdevelopmentwithinthecontextofKaizenasapracticeofCompass.OnfacevalueitseemsreasonabletoincludeimprovedstaffprofessionalpracticeintheSROIcalculation.

Inthisoutcomethevaluestayswiththeindividualstaffmember,thechangeexperiencedisthattheyhavegreaterprofessionalcapacityasaresultofworkingwithCompassinthewayCompassworks.Tobeginisolatingthevaluecreatedisproblematicandmustbegreaterthantheinputprovided.Thevaluewouldneedtobegreaterthansalaryandconditionsandtheseconditionswouldneedtoexcludeanyprofessionaldevelopment.Ifthiscouldbequantifiedtheimpactconsiderationscomeintotheevaluation.Consideringdeadweight,orwhatwouldoccurwithoutCompass,itislikelyastaffmemberwouldbeemployedelsewhereandthehypotheticalalternativesofthenatureofthisemploymentareendlessandunknown.

Consequently,wehaveexcludedthisoutcomefromthecalculationoftheSROIindex,butindoingsoreinforcethatnotincludingthiscommentarywouldbeoverlookingasignificantaspectoftheCompassstory.ThisisparticularlyimportantforthefuturepositioningofCompassinnewcommunities;Compasscanprojectthemselves,withcompleteintegrity,asbeingadeveloperofstaffandconsequentlyindustrycapacity.

33

ORGANISATIONALOUTCOMETWO:IMPROVEDORGANISATIONALPRACTICE(EXCLUDED)

Discussion

ThisoutcomeisaresultofCompassapplyingthephilosophyofKaizeninpractice.Twoexamplesofimprovedpracticeforstakeholders,asaresultofKaizen,havealreadybeendiscussed:traineesasagentsintheco‐creationofthetrainingandeducationpractice(page14),andstaffhavingtheirprofessionalskillsdeveloped.However,inthiscaseimprovedpracticeisreferencingpolicies,proceduresand,generally,non‐humanresourceorganisationalinfrastructure.Forexample,knowledgeiscreatedbytheprocessoftrainingandeducationandKaizenthenpromotesthecaptureandapplicationofthisknowledgetocreatefurtherlearning.

Thereisresearchthatsupportsthevalueofalearningculturehavingafinancialimpactonorganisations.Ellinger,Ellinger,YangandHowton(2002)23researchedtheimpactofbeingalearningorganisationoncompanyfinancialperformanceandfoundthereisapositiverelationshiptofinancialperformancewhereanorganisationhasadoptedlearningorganisationpractices.

However,therationaleforexclusionisrelativelystraightforwardbecauseasanot‐for‐profitCompassisexpectedtoreinvestthevalueitretainsbackintothepurposeoftheorganisationandhencebetterorganisationalpracticeultimatelymanifestsasanoutcomeforCompassstakeholders.Inlinewiththiswebelievethevaluethiscreatesaccountsforthequantumofthetrainee,carerandfamilyoutcomescontainedwithinthefinalassessment.

23Ellinger,D.,Ellinger,A.,Yang,B.,andHowton,S.(2002).Therelationshipbetweenthelearningorganizationconceptandfirms’financialperformance:Anempiricalassessment.HumanResourceDevelopmentQuarterly,13(1),5‐22.


SROICALCULATIONThefinalSROIcalculationandresultingratioforCompassis1:10.31;inotherwords,forevery$1investedintheEducationandTrainingUnitsofCompass$10.31ofvalueisderived.

Inseekingtounderstandthemake‐upofthisvalueweseethatthelargestcontributioncomesfromthetrainees’experienceofself‐worth.Thismakesupapproximately40%ofthetotalimpactcalculation.ThisoutcomeisoneoftheultimateexperiencesofthecyclicalnatureofvaluecreationarisingfromthewayCompassoperates.

Thenextlargesttraineeoutcomecontributingtothevalueistheincreaseinthetrainees’autonomy,whichiscentraltotheactivitiesoftheEducationandTrainingUnits.

Togetherthetwocareroutcomesof‘carerpeaceofmindandconfidenceintrainee’sfuture’and‘carercapacitytodosomethingelse’makeupapproximately20%ofthevalue.Whiletheseoutcomescouldbepredictedtheysitslightlyoutsidethefocusoftheeducationandtrainingactivities.

Thesmallestcontributiontothevalueistheexperienceofhealthylife,whichisalsorelatedtothetransientnatureofthisoutcome.Thisrequiressustainedefforttoreaprewardsandfallsawayveryquickly.Thiswasoneoftheoutcomeswherewewereconcernedaboutthechoiceofproxyasoutlinedinthediscussionofthisoutcome.Table3providesaviewofallthreepotentialproxiesandtheirimpactontheratio.

Table3.Threeproposedproxiesforthehealthylifeoutcome

PotentialproxyValueperweek

Ratio

Householdexpenditureperweekonhealthandfitnessstudio(i.e.expenditureongym)

$2.71 1:10.25

Householdexpenditureonaccidentandhealthinsurance

$26.74 1:10.31

Averageexpenditureonhealthservicesperperson $119.80 1:10.51

Weareconfidentthattheselectionoftheproxyrelatingtoaccidentandhealthinsuranceisrepresentativeofthevalueexperiencedbythetrainees.

ONGOINGIMPACT

Onesignificantareawhichisworthyofanin‐depthdiscussionisthatofthedurationoftheoutcomes.Halfoftheoutcomeshavebeencalculatedinlinewiththeeffectofthatoutcomedissipatingwithin12months.Theotherfour—autonomy,socialinclusion,self‐worthandfamilyfunctioning—havedurationsvaryingbetween2and5years.Therewassomedifferenceofopinionwiththisdurationdata.ThedurationsoutlinedintheimpactmapintheAppendixofthisreporthaveasignificanteffectonthefinalratioof1:10.31arebasedoncarerfeedbackandsomeresearchdata.Thestaffperspectivesvaryfromthisinformation.Staffperspectivesarethattheimpactofintellectualdisabilityontheretentionofthechangeexperiencedislikelytofallawaymorequicklythanforabroaderpopulation.Thereforestaffadvocatethatalloutcomes

David Dangerfield

Highlight

David Dangerfield

Highlight

David Dangerfield

Highlight

35

wouldbeexperiencedfullybutonlywithina12‐monthtimeframe.Thisisbasedontheirexperiencethatforpeoplewithintellectualdisabilitysustainingchangewouldrequireongoingintervention.Whiletherewassomesupportforthefouroutcomeslistedabovehavingthepotentialforextendedtimeframeswehaverecalculatedtheimpactratiotorepresentthisviewofloweredsustainabilityandincludeithereasanalternativeratioworthyofseriousconsideration.Using100%dropofffiguresforalleightoutcomesleadstoafinalimpactratioof1:6.01;thatis,forevery$1investedinCompassthereis$6.01worthofvaluecreated.


CONCLUSION

SERVICEINTENTIONSANDOUTCOMES

TheprinciplesandpracticeofAikido,thetheoryofSocialRoleValorisationandthedisciplineofKaizenunderpintheapproachCompassundertakestoservicedelivery.WithintheEducationandTrainingUnitsthisisputintopracticethroughadisciplinedapproachtolearningandapplyingtheskills,expectationsandactiveparticipationoftraineeswithinthesocialarenasofCompass,thefamilyunitandthecommunityinwhichthetraineeslive.Thiscreatesacycle,buildingaseriesoflinkedoutcomesexperiencedbytrainees,theircarersandthefamilyunit.Theoutcomesincludedinthisassessmentofimpactare:

Capacityandwilltolearn Autonomy Socialinclusion Healthylife Self‐worth Peaceofmindandconfidenceintrainees’future Capacitytodootherthings Familyfunctioning

ThetheoryofchangeforCompassbeginswithfocusedlearningappliedacrossdiversesettings.Addedtothisareclearbehaviouralexpectationsinsocialsettingsandtheopportunitytointeractinthecommunityinawaythatresultsintheexperienceofavaluedstatusfinallyresultinginanexperienceofself‐worth.ItisfittingthatthisfinalaspectofthetheoryofchangeforCompassisthemostimpactfulintermsofvalue.Theunintendedoutcomesrelatingtocarersandbroaderfamilydonotformthecoreofthetheoryofchange.ItisnotintendedheretosuggestthatCompassreformtheirtheoryofchange.Thepoweroftheoutcomesisderivedfromthefocusontrainees’learning;however,thisassessmentreinforcesthecompoundingvalueexperiencedbythosemostclosesttothetrainees.

CONTEXTFORTHERATIO

Oneofthechallengesfortheassessmentwasteasingoutandisolatingthevariousmaterialimpacts.Whileweareconfidentthattheoutcomesincludedinthecalculationrepresentthevaluecreated,wearealsoconsciousofimportantexclusions.Scopemadeitappropriatetonotincludesocialcapital,andlogicexcludedprofessionalandorganisationallearning.However,itisimportantforCompasstokeepawarenessofsocialcapitalasasignificantpartoftheirtotalvalueproposition.Similarly,astaticratiodoesn’tarticulatetheamplifyingeffectofKaizenuponprofessionalandorganisationaldevelopment;afundamentalingredientofexploringtheartoflife.

Themostsignificantissuerelatingtothedatausedinthevaluationisthedifferenceinperspectivebetweenstakeholdersandstaffmembersaroundthelengthoftimethesechangesaresustained.Thereis$4.22differencebetweenviewingthestakeholder/research‐basedapproachtodurationandthestaffmembers’experience‐basedapproach.

Compassmayconsiderputtinginplaceoutcomemeasurestounderstandthequantumofchangeandthedurationofthatchangeingreaterdetail.

37

RESULTINGRATIO

TheresultingratioforCompass’EducationandTrainingUnitsis1:10.31.Thisratiomustbereadinthecontextlaidoutinthisreportandinparticularthechallengessetoutinthepreviousparagraphs.Itisaclearindicationthattheconsideredphilosophyanditsdeliberateimplementationareachievingveryrealoutcomesfortraineesandtheirfamilymembers.


APPENDIX–IMPACTMAP

39

Documents

COMPASS INSTITUTE INC...The following is a glossary of key terms used in this document. Attribution Attribution is the extent to which other events or activities contribute to the