Measuring your ImpactMeasuring your Impact

Good pracce briefingGood pracce briefing

Measuring your ImpactMeasuring your Impact

This briefing reflects the good prac�ce showcased at our recent ‘Measuring your Impact’ event in This briefing reflects the good prac�ce showcased at our recent ‘Measuring your Impact’ event in This briefing reflects the good prac�ce showcased at our recent ‘Measuring your Impact’ event in

September 2011. It looks at the ways different projects can measure the effects of what they do, and howSeptember 2011. It looks at the ways different projects can measure the effects of what they do, and howSeptember 2011. It looks at the ways different projects can measure the effects of what they do, and how

these results can be captured.these results can be captured.these results can be captured. A range of different case studies and good prac�ce examples are A range of different case studies and good prac�ce examples are A range of different case studies and good prac�ce examples are

highlighted which show the importance not only of measuring hard outcomes, but also why so#er highlighted which show the importance not only of measuring hard outcomes, but also why so#er highlighted which show the importance not only of measuring hard outcomes, but also why so#er

achievements are as important and can also be recorded.achievements are as important and can also be recorded.achievements are as important and can also be recorded.

Increasingly Welsh Government (WG) sees the applica�on of an outcome based approach through Increasingly Welsh Government (WG) sees the applica�on of an outcome based approach through Increasingly Welsh Government (WG) sees the applica�on of an outcome based approach through

systems such as the Results Based Accountability (RBA) method as an important tool in “establishing a systems such as the Results Based Accountability (RBA) method as an important tool in “establishing a systems such as the Results Based Accountability (RBA) method as an important tool in “establishing a

line of sight from results back to means”. Recent examples include the Housing Department's Self line of sight from results back to means”. Recent examples include the Housing Department's Self line of sight from results back to means”. Recent examples include the Housing Department's Self

Assessment process and the proposed approach to delivering the new Communi�es First programme.Assessment process and the proposed approach to delivering the new Communi�es First programme.Assessment process and the proposed approach to delivering the new Communi�es First programme.

i2i examined these and related issues in a series of regional events across Wales during September 2011i2i examined these and related issues in a series of regional events across Wales during September 2011i2i examined these and related issues in a series of regional events across Wales during September 2011

a+ended by over 100 people. The Measuring Your Impact seminars showcased best prac�ce from hous-a+ended by over 100 people. The Measuring Your Impact seminars showcased best prac�ce from hous-a+ended by over 100 people. The Measuring Your Impact seminars showcased best prac�ce from hous-

ing associa�ons, local authori�es and third sector organisa�ons where a variety of methodologies were ing associa�ons, local authori�es and third sector organisa�ons where a variety of methodologies were ing associa�ons, local authori�es and third sector organisa�ons where a variety of methodologies were

examined, as well as case studies from different disciplines such as financial inclusion, health and regen-examined, as well as case studies from different disciplines such as financial inclusion, health and regen-examined, as well as case studies from different disciplines such as financial inclusion, health and regen-

era�on.era�on.era�on.

It is important to remember one basic rule, that we are all in the business of producing It is important to remember one basic rule, that we are all in the business of producing It is important to remember one basic rule, that we are all in the business of producing outcomes outcomes outcomes

through our ac�vi�es through our ac�vi�es through our ac�vi�es --- it is rela�vely easy to set up systems which measure outputs i.e. the specific out-it is rela�vely easy to set up systems which measure outputs i.e. the specific out-it is rela�vely easy to set up systems which measure outputs i.e. the specific out-

comes which relate to our project, but it requires a more structured approach to measure the things that comes which relate to our project, but it requires a more structured approach to measure the things that comes which relate to our project, but it requires a more structured approach to measure the things that

happen in the longer term as a result of achieving those outputs. Evidencing that change is the true markhappen in the longer term as a result of achieving those outputs. Evidencing that change is the true markhappen in the longer term as a result of achieving those outputs. Evidencing that change is the true mark

of a successful project or ac�vity in our communi�es of a successful project or ac�vity in our communi�es of a successful project or ac�vity in our communi�es --- but in doing so it is vital to fit the tool around yourbut in doing so it is vital to fit the tool around yourbut in doing so it is vital to fit the tool around your

outcomes outcomes outcomes --- not the other way around.not the other way around.not the other way around.

In harsh economic mes such as these, it is even In harsh economic mes such as these, it is even

more important that organisa ons can provide more important that organisa ons can provide

evidence to funders and other stakeholders evidence to funders and other stakeholders

showing both the value of their ac vi es, and showing both the value of their ac vi es, and

the impact their work is having. Some of the the impact their work is having. Some of the

models men oned in this briefing can be used to models men oned in this briefing can be used to

assign a monetary value to a par cular ac vity, assign a monetary value to a par cular ac vity,

measuring the “mul plier” effect which can add measuring the “mul plier” effect which can add

value to local economies. value to local economies.

MethodologyMethodology

The Crew ToolkitThe Crew Toolkit

Background informa�onBackground informa�onBackground informa�on

The Centre for Regenera�on Excellence in Wales (CREW) was established in 2010 with the aim of The Centre for Regenera�on Excellence in Wales (CREW) was established in 2010 with the aim of The Centre for Regenera�on Excellence in Wales (CREW) was established in 2010 with the aim of

promo�ng integrated sustainable regenera�on prac�ce in Wales. CREW iden�fies disseminates and promo�ng integrated sustainable regenera�on prac�ce in Wales. CREW iden�fies disseminates and promo�ng integrated sustainable regenera�on prac�ce in Wales. CREW iden�fies disseminates and

promotes good prac�ce developing crosspromotes good prac�ce developing crosspromotes good prac�ce developing cross---disciplinary skills for regenera�on prac�ce for regenera�ondisciplinary skills for regenera�on prac�ce for regenera�ondisciplinary skills for regenera�on prac�ce for regenera�on

prac��oners. prac��oners. prac��oners.

The ResearchThe ResearchThe Research

The CREW toolkit is a piece of research funded by the The CREW toolkit is a piece of research funded by the The CREW toolkit is a piece of research funded by the

Joseph Rowntree Founda�on which considers how wider impacts Joseph Rowntree Founda�on which considers how wider impacts Joseph Rowntree Founda�on which considers how wider impacts

can be measured based on the experiences in different parts can be measured based on the experiences in different parts can be measured based on the experiences in different parts

of the UK. Some of the key findings underlined the importance of of the UK. Some of the key findings underlined the importance of of the UK. Some of the key findings underlined the importance of

management prac�ce and the importance of corporate backing to what is being delivered. management prac�ce and the importance of corporate backing to what is being delivered. management prac�ce and the importance of corporate backing to what is being delivered.

BarriersBarriersBarriers to successful measurement include: to successful measurement include: to successful measurement include:

••• the skills of the researchers, and the skills of the researchers, and the skills of the researchers, and

••• the corporate buy in of the organisa�on the corporate buy in of the organisa�on the corporate buy in of the organisa�on

If the organisa�on is not commi+ed then the project will not be able to show clear outcomes. This must If the organisa�on is not commi+ed then the project will not be able to show clear outcomes. This must If the organisa�on is not commi+ed then the project will not be able to show clear outcomes. This must

be thought about at the earliest possible stage in the project as there is no point in ge6ng half way and be thought about at the earliest possible stage in the project as there is no point in ge6ng half way and be thought about at the earliest possible stage in the project as there is no point in ge6ng half way and

realising that there is no corporate "buy in" for the work. realising that there is no corporate "buy in" for the work. realising that there is no corporate "buy in" for the work.

Key points

How you measure your impact must be built into the design of the How you measure your impact must be built into the design of the How you measure your impact must be built into the design of the

tool.tool.tool.

Delivery must be measured and monitored at all stages to be Delivery must be measured and monitored at all stages to be Delivery must be measured and monitored at all stages to be

successful.successful.successful.

Resources for the process are a key requirement and many projects Resources for the process are a key requirement and many projects Resources for the process are a key requirement and many projects

undervalue this right at the start. CREW advise that most projects undervalue this right at the start. CREW advise that most projects undervalue this right at the start. CREW advise that most projects

should allocate 6 should allocate 6 should allocate 6 ––– 7 % of project cost for measuring and evalua�on.7 % of project cost for measuring and evalua�on.7 % of project cost for measuring and evalua�on.

Context is important as nothing we do is in isola�onContext is important as nothing we do is in isola�onContext is important as nothing we do is in isola�on--- it's important to it's important to it's important to

a�ribute and account not only a project's own achievements but a�ribute and account not only a project's own achievements but a�ribute and account not only a project's own achievements but

what others have achieved also.what others have achieved also.what others have achieved also.

The CREW toolkit itself recommends a three pronged approach considering Atmosphere, Landscape and The CREW toolkit itself recommends a three pronged approach considering Atmosphere, Landscape and The CREW toolkit itself recommends a three pronged approach considering Atmosphere, Landscape and

Horizons Horizons Horizons --- the ALH model. the ALH model. the ALH model.

Atmosphere Atmosphere Atmosphere ––– refers to the “feel” of refers to the “feel” of refers to the “feel” of

a placea placea place

If someone told you that you had to If someone told you that you had to If someone told you that you had to

live in a certain place tomorrow how live in a certain place tomorrow how live in a certain place tomorrow how

would you feel about it? If you would you feel about it? If you would you feel about it? If you

walked around the community and walked around the community and walked around the community and

asked people who were there how asked people who were there how asked people who were there how

they felt while out and about, what they felt while out and about, what they felt while out and about, what

would they say? Would it be be+er would they say? Would it be be+er would they say? Would it be be+er

or worse than 10 years ago? Is it safe, or worse than 10 years ago? Is it safe, or worse than 10 years ago? Is it safe,

dangerous, welcoming or hos�le? Is dangerous, welcoming or hos�le? Is dangerous, welcoming or hos�le? Is

the community celebra�ng itself or is the community celebra�ng itself or is the community celebra�ng itself or is

it concerned?it concerned?it concerned?

Landscape Landscape Landscape ––– access the physical nature access the physical nature access the physical nature

of the neighbourhoodof the neighbourhoodof the neighbourhood

What is its layout like? Quality and ap-What is its layout like? Quality and ap-What is its layout like? Quality and ap-

pearance of the housing? Are gardens, pearance of the housing? Are gardens, pearance of the housing? Are gardens,

green spaces, and quality public spaces green spaces, and quality public spaces green spaces, and quality public spaces

available? Are there play and sports available? Are there play and sports available? Are there play and sports

spaces, community buildings, and things spaces, community buildings, and things spaces, community buildings, and things

that improve the quality of people’s that improve the quality of people’s that improve the quality of people’s

lives? Is the community well connected lives? Is the community well connected lives? Is the community well connected

to the external world by road, public to the external world by road, public to the external world by road, public

transport and the internet?transport and the internet?transport and the internet?

Horizon Horizon Horizon ––– refers to the social horizon refers to the social horizon refers to the social horizon

which residents of communi es feelwhich residents of communi es feelwhich residents of communi es feel

How far do residents look outside their How far do residents look outside their How far do residents look outside their

communi�es? Do people feel equipped to communi�es? Do people feel equipped to communi�es? Do people feel equipped to

travel outside their area (socially and travel outside their area (socially and travel outside their area (socially and

physically)? Do young people live en�rely physically)? Do young people live en�rely physically)? Do young people live en�rely

in their family and peer culture or are in their family and peer culture or are in their family and peer culture or are

there social and cultural experiences there social and cultural experiences there social and cultural experiences

which challenge and change these ideas?which challenge and change these ideas?which challenge and change these ideas?

How it worksHow it worksHow it works

The toolkit itself stresses the need for both The toolkit itself stresses the need for both The toolkit itself stresses the need for both qualita�ve qualita�ve qualita�ve and and and quan�ta�ve quan�ta�ve quan�ta�ve data. The inclusion of na�onally data. The inclusion of na�onally data. The inclusion of na�onally

approved sta�s�cs is important but needs to be counter balanced by talking to people whose lives have approved sta�s�cs is important but needs to be counter balanced by talking to people whose lives have approved sta�s�cs is important but needs to be counter balanced by talking to people whose lives have

been impactedbeen impactedbeen impacted--- the involvement of residents in this regard is cri�cal.the involvement of residents in this regard is cri�cal.the involvement of residents in this regard is cri�cal. The processes of se6ng a base line, The processes of se6ng a base line, The processes of se6ng a base line,

providing a medium term and final evalua�on are also important but it is important to use the right lan-providing a medium term and final evalua�on are also important but it is important to use the right lan-providing a medium term and final evalua�on are also important but it is important to use the right lan-

guageguageguage

Part of the research also included a study of a group of indicators and the final report will highlights 22 Part of the research also included a study of a group of indicators and the final report will highlights 22 Part of the research also included a study of a group of indicators and the final report will highlights 22

indicators which passed the test in terms of spa�al and �me series availability. It was important to look indicators which passed the test in terms of spa�al and �me series availability. It was important to look indicators which passed the test in terms of spa�al and �me series availability. It was important to look

for data that could be con�nually updated. Hence census data may not the best approach as it becomes for data that could be con�nually updated. Hence census data may not the best approach as it becomes for data that could be con�nually updated. Hence census data may not the best approach as it becomes

outdated by the �me the results are publicly avaliable, however it can be helpful and a good source of outdated by the �me the results are publicly avaliable, however it can be helpful and a good source of outdated by the �me the results are publicly avaliable, however it can be helpful and a good source of

informa�on if there is a need to measure longer term impacts.informa�on if there is a need to measure longer term impacts.informa�on if there is a need to measure longer term impacts. The research also highlighted the im-The research also highlighted the im-The research also highlighted the im-

portance of Community Surveys and audits, a good example being the New Deal for Communi�es pro-portance of Community Surveys and audits, a good example being the New Deal for Communi�es pro-portance of Community Surveys and audits, a good example being the New Deal for Communi�es pro-

gramme in England which undertook MORI polls every two years. gramme in England which undertook MORI polls every two years. gramme in England which undertook MORI polls every two years.

All of these examples provide useful evidence. All of these examples provide useful evidence. All of these examples provide useful evidence.

Whatever the approachWhatever the approachWhatever the approach--- be it sta�s�cal capture be it sta�s�cal capture be it sta�s�cal capture

or qualita�ve evalua�on, it is important to measor qualita�ve evalua�on, it is important to measor qualita�ve evalua�on, it is important to meas

ure the result through Triangula�on with at least ure the result through Triangula�on with at least ure the result through Triangula�on with at least

THREE data sources to ensure findings were THREE data sources to ensure findings were THREE data sources to ensure findings were

accurate. accurate. accurate.

The repor�ng framework needs to be iden�fied at the project outset and not (as commonly happens) at The repor�ng framework needs to be iden�fied at the project outset and not (as commonly happens) at The repor�ng framework needs to be iden�fied at the project outset and not (as commonly happens) at

the end. In so doing it needs to use the atmosphere, landscape, and horizon structure and can then in-the end. In so doing it needs to use the atmosphere, landscape, and horizon structure and can then in-the end. In so doing it needs to use the atmosphere, landscape, and horizon structure and can then in-

form programme delivery and ac�on planning if used at the beginning of a project.form programme delivery and ac�on planning if used at the beginning of a project.form programme delivery and ac�on planning if used at the beginning of a project.

The detailed report is expected to be launched later in the year. The detailed report is expected to be launched later in the year. The detailed report is expected to be launched later in the year.

Contact : Dave Adamson: dave.adamson@regenwales.orgContact : Dave Adamson: dave.adamson@regenwales.orgContact : Dave Adamson: dave.adamson@regenwales.org

Techniques Techniques Techniques

⇒⇒⇒ community surveys, community surveys, community surveys,

⇒⇒⇒ focus groups, focus groups, focus groups,

⇒⇒⇒ community panels, community panels, community panels,

⇒⇒⇒ event based consulta�ons and event based consulta�ons and event based consulta�ons and

⇒⇒⇒ interview with long term residents, interview with long term residents, interview with long term residents,

community leaders, elected members community leaders, elected members community leaders, elected members

and on the ground workers and on the ground workers and on the ground workers

Social Return on Investment Social Return on Investment Social Return on Investment

(SROI)(SROI)(SROI)

Primarily SROI has been developed to measure the VALUE of ac�vity, logging the CHANGE that has taken Primarily SROI has been developed to measure the VALUE of ac�vity, logging the CHANGE that has taken Primarily SROI has been developed to measure the VALUE of ac�vity, logging the CHANGE that has taken

place. It relies on qualita�ve, quan�ta�ve and financial data and can be accredited and used to illustrate place. It relies on qualita�ve, quan�ta�ve and financial data and can be accredited and used to illustrate place. It relies on qualita�ve, quan�ta�ve and financial data and can be accredited and used to illustrate

the financial, social and organisa�onal worth of an ac�vitythe financial, social and organisa�onal worth of an ac�vitythe financial, social and organisa�onal worth of an ac�vity

SROI can help organisa�ons understand, manage and communicate the value of their work in a clear and SROI can help organisa�ons understand, manage and communicate the value of their work in a clear and SROI can help organisa�ons understand, manage and communicate the value of their work in a clear and

consistent way to customers, beneficiaries and funders. It can help to manage risks and iden�fy opportu-consistent way to customers, beneficiaries and funders. It can help to manage risks and iden�fy opportu-consistent way to customers, beneficiaries and funders. It can help to manage risks and iden�fy opportu-

ni�es and raise finance. It will throw up poten�al improvements to services, informa�on systems and the ni�es and raise finance. It will throw up poten�al improvements to services, informa�on systems and the ni�es and raise finance. It will throw up poten�al improvements to services, informa�on systems and the

way a businesses governs itself. way a businesses governs itself. way a businesses governs itself.

Because SROI is built on principles, it is very flexible. Different organisa�ons create value in many differ-Because SROI is built on principles, it is very flexible. Different organisa�ons create value in many differ-Because SROI is built on principles, it is very flexible. Different organisa�ons create value in many differ-

ent ways. A consistent approach to understanding value means that you can communicate clearly in a ent ways. A consistent approach to understanding value means that you can communicate clearly in a ent ways. A consistent approach to understanding value means that you can communicate clearly in a

credible way where and how you create it.credible way where and how you create it.credible way where and how you create it.

"SROI is a framework for measuring and accoun�ng for this much broader

concept of value; it seeks to reduce inequality and environmental degrada-

�on and improve wellbeing by incorpora�ng social, environmental and eco-

nomic costs and benefits.” SROI Guide, 2009

SROI Principles:SROI Principles:SROI Principles:

♦♦♦ Involve stakeholdersInvolve stakeholdersInvolve stakeholders

♦♦♦ Understand what Understand what Understand what

changeschangeschanges

♦♦♦ Value the things that Value the things that Value the things that

ma+erma+erma+er

♦♦♦ Only include what is Only include what is Only include what is

♦♦♦ materialmaterialmaterial

♦♦♦ DON’T over claimDON’T over claimDON’T over claim

♦♦♦ Be transparentBe transparentBe transparent

♦♦♦ Verify the resultVerify the resultVerify the result

Key StagesKey StagesKey Stages

♦♦♦ Establish the scope and the stakeholders, Establish the scope and the stakeholders, Establish the scope and the stakeholders,

and and and

♦♦♦ To map the outcomes that have resulted To map the outcomes that have resulted To map the outcomes that have resulted

from the ac�vityfrom the ac�vityfrom the ac�vity

Outcomes are evidenced and give a value Outcomes are evidenced and give a value Outcomes are evidenced and give a value

through the development of a financial proxy through the development of a financial proxy through the development of a financial proxy –––

this is the most difficult part. this is the most difficult part. this is the most difficult part. The impact of the The impact of the The impact of the

ac�vity is then established ac�vity is then established ac�vity is then established --- how much would how much would how much would

have happened without the ac�vity?have happened without the ac�vity?have happened without the ac�vity?

The SROI is then calculated and applied The SROI is then calculated and applied The SROI is then calculated and applied –––

it can also be accredited as a means of cross checking the result. it can also be accredited as a means of cross checking the result. it can also be accredited as a means of cross checking the result.

SROI Map Stage 1 & 2SROI Map Stage 1 & 2SROI Map Stage 1 & 2

SROI Map Stage 2 & 3

Top �ps Top �ps Top �ps

♦♦♦ Keep it simple Keep it simple Keep it simple ––– one small ac�vity to startone small ac�vity to startone small ac�vity to start

♦♦♦ Resource properlyResource properlyResource properly

♦♦♦ Don’t get bogged down by all the other interconnected Don’t get bogged down by all the other interconnected Don’t get bogged down by all the other interconnected

ac�vi�esac�vi�esac�vi�es

♦♦♦ Don’t oversell your impactDon’t oversell your impactDon’t oversell your impact

♦♦♦ Support the researcherSupport the researcherSupport the researcher

♦♦♦ Get it accredited Get it accredited Get it accredited

Issues to consider when calcula�ng the SROIIssues to consider when calcula�ng the SROIIssues to consider when calcula�ng the SROI

Deadweight? Deadweight? Deadweight? ––– how much would have occurred without your ac�vity?how much would have occurred without your ac�vity?how much would have occurred without your ac�vity?

Displacement? Displacement? Displacement? ––– How much of your ac�vity displaced other programmes/ac�vi�es?How much of your ac�vity displaced other programmes/ac�vi�es?How much of your ac�vity displaced other programmes/ac�vi�es?

A+ribu�on? A+ribu�on? A+ribu�on? ––– how much of the outcome was caused by other people’s contribu�ons?how much of the outcome was caused by other people’s contribu�ons?how much of the outcome was caused by other people’s contribu�ons?

Drop off? Drop off? Drop off? ––– don’t keep dining out on your ac�vity forever don’t keep dining out on your ac�vity forever don’t keep dining out on your ac�vity forever

Impact Impact Impact ––– (quan�ty x financial proxy (quan�ty x financial proxy (quan�ty x financial proxy ––– deadweight, displacement and a"ribu�on = SROI)deadweight, displacement and a"ribu�on = SROI)deadweight, displacement and a"ribu�on = SROI)

Value Wales Community Benefits ToolValue Wales Community Benefits Tool

““Designed to be used by contract / project Designed to be used by contract / project

managers and primary contractors to measure managers and primary contractors to measure

benefits of Welsh public sector contractsbenefits of Welsh public sector contracts””

The Welsh Community benefits tool developed by Value Wales is designed to be used by contract / The Welsh Community benefits tool developed by Value Wales is designed to be used by contract / The Welsh Community benefits tool developed by Value Wales is designed to be used by contract /

project managers and primary contractors to measure community benefits of Welsh public sector project managers and primary contractors to measure community benefits of Welsh public sector project managers and primary contractors to measure community benefits of Welsh public sector

contracts. It has been developed through a series of pilot studies in 3 Pathfinder areas and the publica�on contracts. It has been developed through a series of pilot studies in 3 Pathfinder areas and the publica�on contracts. It has been developed through a series of pilot studies in 3 Pathfinder areas and the publica�on

“Community Benefits“Community Benefits“Community Benefits---delivering maximum value for the Welsh pound” (2010). delivering maximum value for the Welsh pound” (2010). delivering maximum value for the Welsh pound” (2010).

““In many ways the tool can be seen as a prac�cal applica�on of an SROI In many ways the tool can be seen as a prac�cal applica�on of an SROI

approach to procurement in Wales, which assigns monetary values to approach to procurement in Wales, which assigns monetary values to

ac�vi�es using financial proxies and assump�ons tailored to the ac�vi�es using financial proxies and assump�ons tailored to the

Welsh economyWelsh economy””

The tool is an excel spread sheet which captures a standard set of data for each procurement project. The The tool is an excel spread sheet which captures a standard set of data for each procurement project. The The tool is an excel spread sheet which captures a standard set of data for each procurement project. The

tool has been developed primarily to examine the community benefits derived from construc�on and in-tool has been developed primarily to examine the community benefits derived from construc�on and in-tool has been developed primarily to examine the community benefits derived from construc�on and in-

frastructure contracts. For contracts under a year, the tool is intended for comple�on at the end of the frastructure contracts. For contracts under a year, the tool is intended for comple�on at the end of the frastructure contracts. For contracts under a year, the tool is intended for comple�on at the end of the

contract. For contracts longer than one year, the tool is intended for annual comple�on, enabling the contract. For contracts longer than one year, the tool is intended for annual comple�on, enabling the contract. For contracts longer than one year, the tool is intended for annual comple�on, enabling the

iden�fica�on of future opportuni�es. All informa�on collected should be rela�ng to contract iden�fica�on of future opportuni�es. All informa�on collected should be rela�ng to contract iden�fica�on of future opportuni�es. All informa�on collected should be rela�ng to contract ––– related ac-related ac-related ac-

�vity only, rather than overall company opera�ons. It is possible to use the tool for other contract areas, �vity only, rather than overall company opera�ons. It is possible to use the tool for other contract areas, �vity only, rather than overall company opera�ons. It is possible to use the tool for other contract areas,

by merely filling in the enterprise and employment worksheets. by merely filling in the enterprise and employment worksheets. by merely filling in the enterprise and employment worksheets.

Measures and records Measures and records Measures and records factors such as :factors such as :factors such as :

♦♦♦ Training, Training, Training,

♦♦♦ Educa�on, Educa�on, Educa�on,

♦♦♦ Use of Welsh companies in delivering Use of Welsh companies in delivering Use of Welsh companies in delivering

contracts contracts contracts (SMEs, Third Sector (SMEs, Third Sector (SMEs, Third Sector

organisa�ons and Supported Businesses),organisa�ons and Supported Businesses),organisa�ons and Supported Businesses),

♦♦♦ Cost avoidance on Waste to landfill, Cost avoidance on Waste to landfill, Cost avoidance on Waste to landfill,

♦♦♦ Contribu�on to reducing Climate Change gas Contribu�on to reducing Climate Change gas Contribu�on to reducing Climate Change gas

emissions and the value to local emissions and the value to local emissions and the value to local

communi�escommuni�escommuni�es

The tool captures the socioThe tool captures the socioThe tool captures the socio---economic value economic value economic value

of Community Benefits interven�ons by: of Community Benefits interven�ons by: of Community Benefits interven�ons by:

⇒⇒⇒ Using minimal raw data Using minimal raw data Using minimal raw data

⇒⇒⇒ Being easily understood and applied Being easily understood and applied Being easily understood and applied

⇒⇒⇒ Using a common robust methodology Using a common robust methodology Using a common robust methodology

⇒⇒⇒ Having a Welsh focusHaving a Welsh focusHaving a Welsh focus

The tool is easily completed by obtaining figures from the contractor & contract itself. It has 6 worksheets

for data collec�on, with each sec�on of the worksheet clearly explained as to which informa�on should

be entered at that point.

The tool will also provide you with a comple�on figure which demonstrates the local mul�plier effect that

your investment has created.

Example of Populated Spread sheet

The local mul�plier shows the rela�ve impact showing for every £1 spent on this contract, the following

amount of money has been reinvested in the Welsh economy. This figure is based on whether the con-

tract was spent on a contractor based in Wales and then how much that contractor, regardless of loca-

�on, re-spent the contract income. These two figures are added together and divided by the contract val-

ue to create a ra�o showing how much was spent on the contract to create the added income for the

Welsh Economy.

The tool is a rela�vely easy way of calcula�ng the mul�plier effect from raw data which is easily collated.

However at present the tool only measures how much of the contract is spent in Wales. Many organisa-

�ons need to demonstrate economic value more locally than this and may need to adapt the tool further

to provide the results in the format that they require.

Contact:

Lisa Thomas-Lewis

Email: Lisa.thomas-lewis@wales.gsi.gov.uk

Financial InclusionFinancial Inclusion

Case StudyCase StudyCase Study

Bron Afon Community HousingBron Afon Community HousingBron Afon Community Housing

Bron Afon Community Housing is a community based housing associa�on managing and improving over Bron Afon Community Housing is a community based housing associa�on managing and improving over Bron Afon Community Housing is a community based housing associa�on managing and improving over

8000 homes in Torfaen. It has iden�fied financial inclusion as a priority and provides face to face financial 8000 homes in Torfaen. It has iden�fied financial inclusion as a priority and provides face to face financial 8000 homes in Torfaen. It has iden�fied financial inclusion as a priority and provides face to face financial

advice through a dedicated provision and advice worker. It is part of the wider strategy to assist tenants advice through a dedicated provision and advice worker. It is part of the wider strategy to assist tenants advice through a dedicated provision and advice worker. It is part of the wider strategy to assist tenants

in financial difficul�es which includes a team of energy advisers helping tenants with fuel bills. The ac�vity in financial difficul�es which includes a team of energy advisers helping tenants with fuel bills. The ac�vity in financial difficul�es which includes a team of energy advisers helping tenants with fuel bills. The ac�vity

has been running 2 years.has been running 2 years.has been running 2 years.

Measuring these hard outcomes are key, but the so# outcomes are also important. One case resulted in a Measuring these hard outcomes are key, but the so# outcomes are also important. One case resulted in a Measuring these hard outcomes are key, but the so# outcomes are also important. One case resulted in a

saving of £13000 and a debt order being stopped, but the other real impact was the increase in the saving of £13000 and a debt order being stopped, but the other real impact was the increase in the saving of £13000 and a debt order being stopped, but the other real impact was the increase in the

tenant's selftenant's selftenant's self---confidence in dealing with their life. Another tenant had a very large debt wri+en off due to confidence in dealing with their life. Another tenant had a very large debt wri+en off due to confidence in dealing with their life. Another tenant had a very large debt wri+en off due to

an individual bankruptcy, an individual bankruptcy, an individual bankruptcy, but an important change was the fact that that person no longer hid when

there was someone at the door and they felt that they had got their life back’.

Hard facts:Hard facts:Hard facts:

♦♦♦ Nearly 500 Clients visitedNearly 500 Clients visitedNearly 500 Clients visited

♦♦♦ Over £50,000 p.a. in unclaimed Benefits secured.Over £50,000 p.a. in unclaimed Benefits secured.Over £50,000 p.a. in unclaimed Benefits secured.

♦♦♦ 8 Clients saved from imminent evic�on8 Clients saved from imminent evic�on8 Clients saved from imminent evic�on

♦♦♦ Over £80,000 of debt wri�en offOver £80,000 of debt wri�en offOver £80,000 of debt wri�en off

♦♦♦ Over £100,000 of debt to be wri�en off imminentlyOver £100,000 of debt to be wri�en off imminentlyOver £100,000 of debt to be wri�en off imminently

♦♦♦ Over 35 referrals of complex cases to partner Over 35 referrals of complex cases to partner Over 35 referrals of complex cases to partner

agenciesagenciesagencies

♦♦♦ Over 40 serious mul� debt arrangements with Over 40 serious mul� debt arrangements with Over 40 serious mul� debt arrangements with

creditors madecreditors madecreditors made

So� Outcomes:So� Outcomes:So� Outcomes:

♦♦♦ Case studiesCase studiesCase studies

♦♦♦ Recording the difference it makes to people’s lives Recording the difference it makes to people’s lives Recording the difference it makes to people’s lives –––

capturing quotes and more recently videocapturing quotes and more recently videocapturing quotes and more recently video

♦♦♦ Pu"ng a ‘story’ behind the facts and figuresPu"ng a ‘story’ behind the facts and figuresPu"ng a ‘story’ behind the facts and figures

Be+er IT systems are required to be able to track the outcomes that the service is delivering to Be+er IT systems are required to be able to track the outcomes that the service is delivering to Be+er IT systems are required to be able to track the outcomes that the service is delivering to

people, and linking it to the housing management systems. So#er outcomes are recorded by onpeople, and linking it to the housing management systems. So#er outcomes are recorded by onpeople, and linking it to the housing management systems. So#er outcomes are recorded by on---

going contact with clients, and tracking surveys. Recording the experience via video and capturing going contact with clients, and tracking surveys. Recording the experience via video and capturing going contact with clients, and tracking surveys. Recording the experience via video and capturing

quotes was also useful, although in so doing one always had to be mindful about the sensi�vity of quotes was also useful, although in so doing one always had to be mindful about the sensi�vity of quotes was also useful, although in so doing one always had to be mindful about the sensi�vity of

disclosing people's financial situa�ondisclosing people's financial situa�ondisclosing people's financial situa�on

A key ques�on for the future focused on being more proac�ve and flagging up people who are

vulnerable and who will get into debt in the future before they reached that stage. Bron Afon

have started working with people before they take up a tenancy, focusing par�cularly on working

with young people who are taking on a home for the first �me. Other next steps include plans to

train up other front line staff to support tenants around money and benefits advice.

Contact: Contact: Contact:

Cath StensonCath StensonCath Stenson

Email: Email: Email: Cath.Stenson@bronafon.org.uk

Steve NelsonSteve NelsonSteve Nelson

Email: Email: Email: Steve.Nelson@bronafon.org.uk

Health Impact StudyHealth Impact Study

Case StudyCase StudyCase Study

Carmarthenshire County CouncilCarmarthenshire County CouncilCarmarthenshire County Council

Carmarthenshire County Council is undertaking a strategic longCarmarthenshire County Council is undertaking a strategic longCarmarthenshire County Council is undertaking a strategic long---term longitudinal study on the effect term longitudinal study on the effect term longitudinal study on the effect

that the improvements on its housing stock will have on the health of the popula�on who live there. that the improvements on its housing stock will have on the health of the popula�on who live there. that the improvements on its housing stock will have on the health of the popula�on who live there.

A survey was undertaken by a market research companyA survey was undertaken by a market research companyA survey was undertaken by a market research company and a Health ques�onnaire developed along and a Health ques�onnaire developed along and a Health ques�onnaire developed along

with face to face interviews. with face to face interviews. with face to face interviews. The ini�al ques�ons that were asked were based around the types of prob-The ini�al ques�ons that were asked were based around the types of prob-The ini�al ques�ons that were asked were based around the types of prob-

lems people face as a result of poor housing, these were found to mainly be respiratory problems, men-lems people face as a result of poor housing, these were found to mainly be respiratory problems, men-lems people face as a result of poor housing, these were found to mainly be respiratory problems, men-

tal health and well being, food hygiene issues, health and safety, and energy efficiency causing excess tal health and well being, food hygiene issues, health and safety, and energy efficiency causing excess tal health and well being, food hygiene issues, health and safety, and energy efficiency causing excess

winter deaths. winter deaths. winter deaths.

As work progressed the authority decided to find out the different circumstances that people live in As work progressed the authority decided to find out the different circumstances that people live in As work progressed the authority decided to find out the different circumstances that people live in

versus the illnesses they have. From these responses the local authority began to look at the proper�es versus the illnesses they have. From these responses the local authority began to look at the proper�es versus the illnesses they have. From these responses the local authority began to look at the proper�es

which had already been improved to WHQS against those that had not. They found a striking correla�on which had already been improved to WHQS against those that had not. They found a striking correla�on which had already been improved to WHQS against those that had not. They found a striking correla�on

between improvement works and improved mental health. The between improvement works and improved mental health. The between improvement works and improved mental health. The Feeling Fine Healthier HomesFeeling Fine Healthier HomesFeeling Fine Healthier Homes Health Im-Health Im-Health Im-

pact Study showed that:pact Study showed that:pact Study showed that:

How?

The local authority developed a pilot study with Swansea and Cardiff

Universi�es in order to get a base line regarding the health of tenants

comparing tenant health with current property condi�on

♦♦♦ 21% of tenants of unimproved proper�es reported being treated for 21% of tenants of unimproved proper�es reported being treated for 21% of tenants of unimproved proper�es reported being treated for

depression, compared with only 7% of the tenants living in depression, compared with only 7% of the tenants living in depression, compared with only 7% of the tenants living in

completed proper�es.completed proper�es.completed proper�es.

♦♦♦ Improvement in Respiratory Infec�onImprovement in Respiratory Infec�onImprovement in Respiratory Infec�on

♦♦♦ 67% of tenants living in completed proper�es reported they were 67% of tenants living in completed proper�es reported they were 67% of tenants living in completed proper�es reported they were

free from respiratory infec�on like coughs and colds compared with free from respiratory infec�on like coughs and colds compared with free from respiratory infec�on like coughs and colds compared with

52% in unimproved proper�es.52% in unimproved proper�es.52% in unimproved proper�es.

♦♦♦ Less people going to their GPLess people going to their GPLess people going to their GP

♦♦♦ 23% of respondents in unimproved proper�es visited their GP 23% of respondents in unimproved proper�es visited their GP 23% of respondents in unimproved proper�es visited their GP

more than four �mes in a three month period compared with 14% more than four �mes in a three month period compared with 14% more than four �mes in a three month period compared with 14%

in completed proper�es. in completed proper�es. in completed proper�es.

Using this approach an annual survey of tenants health will be carried out over the next four years to Using this approach an annual survey of tenants health will be carried out over the next four years to Using this approach an annual survey of tenants health will be carried out over the next four years to

establish if there were any long term improvements. The first stage of this four year plan will begin in establish if there were any long term improvements. The first stage of this four year plan will begin in establish if there were any long term improvements. The first stage of this four year plan will begin in

February 2011. February 2011. February 2011.

The study has collected baseline data between 2008The study has collected baseline data between 2008The study has collected baseline data between 2008———2009 so that it can con�nue the project over the 2009 so that it can con�nue the project over the 2009 so that it can con�nue the project over the

next 25 years which will be parallel to the WHQS improvement works that are being carried out. next 25 years which will be parallel to the WHQS improvement works that are being carried out. next 25 years which will be parallel to the WHQS improvement works that are being carried out.

Alongside this, an evalua�on of the Suppor�ng People programme in Carmar-Alongside this, an evalua�on of the Suppor�ng People programme in Carmar-Alongside this, an evalua�on of the Suppor�ng People programme in Carmar-

thenshire has been carried out iden�fying that:thenshire has been carried out iden�fying that:thenshire has been carried out iden�fying that:

Suppor�ng People funding totalling £6.5m Suppor�ng People funding totalling £6.5m Suppor�ng People funding totalling £6.5m

This realises over £16m public sector savings This realises over £16m public sector savings This realises over £16m public sector savings

Health (£657k)Health (£657k)Health (£657k)

Social Care (£8.5m)Social Care (£8.5m)Social Care (£8.5m)

Residen�al Care (£11m)Residen�al Care (£11m)Residen�al Care (£11m)

Community Safety (£3.4m)Community Safety (£3.4m)Community Safety (£3.4m)

Housing (£1.4m) Housing (£1.4m) Housing (£1.4m)

For every £1 spent, £2.30 is saved.

The report of the health impact study is available on the Carmarthenshire website.

h�p://www.carmarthenshire.gov.uk/english/housing/pages/healthimpact.aspx

Contact:

Robin Staines

Email: Email: rstaines@carmarthehshire.gov.ukrstaines@carmarthehshire.gov.uk

Tel: 01267 228960Tel: 01267 228960

Housing Website: h"p://www.carmarthenshire.gov.uk/housingHousing Website: h"p://www.carmarthenshire.gov.uk/housing

Next steps:Next steps:Next steps:

♦♦♦ Annual Survey over the next 4 years to track changes to healthAnnual Survey over the next 4 years to track changes to healthAnnual Survey over the next 4 years to track changes to health

♦♦♦ Parallel WorkParallel WorkParallel Work---Accessing actual health dataAccessing actual health dataAccessing actual health data

♦♦♦ Assessing the cost benefits to health services from housing improvementAssessing the cost benefits to health services from housing improvementAssessing the cost benefits to health services from housing improvement

♦♦♦ Understanding the wider benefits of the health impact study which may Understanding the wider benefits of the health impact study which may Understanding the wider benefits of the health impact study which may

include educa�onal a�ainment and economic benefits and also the include educa�onal a�ainment and economic benefits and also the include educa�onal a�ainment and economic benefits and also the

so3er outcomes which could include sense of community and place, well so3er outcomes which could include sense of community and place, well so3er outcomes which could include sense of community and place, well

being benefits, social care benefits and happiness.being benefits, social care benefits and happiness.being benefits, social care benefits and happiness.

Measuring the Wider Value of Measuring the Wider Value of

Housing InvestmentHousing Investment

Case StudyCase StudyCase Study

Cartrefi Conwy & CREST waste collec�onsCartrefi Conwy & CREST waste collec�onsCartrefi Conwy & CREST waste collec�ons

Cartrefi Conwy sees the self assessment process as an important business tool to ensure they are

mee�ng the needs of their tenants, and also as an important way of providing evidence to ensure it is

making a difference. They use an outcome matrix which measures financial viability and management,

service delivery & overall corporate governance which in turn measures effort, the effect of said efforts

and the difference this has made to the business and the stakeholders.

Cartrefi Conwy was an enthusias�c adopter of i2i's Can Do Toolkit approach to procurement meaning

Targeted Recruitment & Training and associated ac�vi�es were adopted very early in the life of the or-

ganisa�on. Their main contractor delivering internal and external improvement programmes have a lo-

cal labour base of 96% in North Wales, with 5 appren�ceships progressing to NVQ level 2. They have

also linked closely with the local college to provide 6 pathways to appren�ceships opportuni�es and the

Future Jobs programme to provide work experience for 4 administra�on staff. Their other contractors

are also delivering high percentages (over 80%) of North Wales workers within the labour forces as well

as sourcing materials from local suppliers.

Targeted Recruitment and Training

Main contractor local labour base - 96% in North Wales

5 appren�ceships progressing to NVQ Level 2

6 Pathways to appren�ceships

4 administra�on staff from the back to work programme

Other contractors also delivering high local labour (over 80%) of North Wales

workers within labour force & sourcing materials from local suppliers

Following the ethos of the Can Do toolkit lead to a par�cularly innova�ve partnership with Crest Co-

opera�ve, a social enterprise based in Llandudno Junc�on. Crest has 3 different enterprise arms for recy-

cling and working with unemployed people - especially those groups facing challenges in entering the

labour market e.g. disabled people and offenders.

This partnership has delivered 270 work experience placements , with 7 of these moving onto full �me

employment with the main contractor- G Purchase Construc�on Ltd. Due to the segrega�on at source,

the project was also delivering impressive outputs in waste management with 98% of waste being recy-

cled or reused between 2009 – 2011.

Contact:

Gwynne Jones—Cartrefi Conwy Rod Williams - CREST

Email: gwynne.jones@cartreficonwy.org Email: rod@crestcoopera�ve.co.uk

Tel: 01492 805500 Tel: 01492 596783

Knowledge transfer partnership programme accessed in order to

measure impact of environmental improvements to:

♦ Develop and establish an assessment system that is consistent,

comprehensive and non-discriminatory for iden�fying poten�al

sites.

♦ Create a tool that Cartrefi Conwy can use to measure the impact of

environmental improvements.

♦ Ensure that tenants play key role in the projects success &

sustainability

This has lead to the crea�on of a ra�ng system which:

♦ Enables comparison between sites.

♦ Gives a maximum ra�ng score that reflects individual criterion

significance.

♦ Each criterion has its own calcula�on to achieve a ra�ng score.

We have benefited by being able to:

♦ Plan efficient, crea�ve & sustainable management of external

environment

♦ Develop an environmental strategy and ‘best prac�ce’

approach to environmental improvements

♦ A�ain the WHQS Environmental Standard

Measuring Social Impact and Measuring Social Impact and

Return on Investment Return on Investment

Case Study Case Study Case Study --- RCT HomesRCT HomesRCT Homes

Background

RCT Homes was established December 2007 and is the largest social landlord with over 10,300 rented

homes, and over 600 leaseholders. RCT Homes has been successful in engaging tenants to become mem-

bers of the first Community Mutual in Wales. To date there are 4,700 members with a further 860

awai�ng membership approval. RCT Homes operate a group structure, incorpora�ng Meadow Prospect

(charity Regenera�on Company), GrEW (Social Enterprise including Young Wales) and Homeforce (gas

servicing).

86 promises were made to tenants in its offer document, and these promises were proac�vely used as

levers for crea�ng added value in its regenera�on ambi�ons. This approach has been vital given the con-

text of depriva�on in which RCT Homes operates.

Measuring Impact

RCT Homes has led and par�cipated in some recent innova�ve ini�a�ves which seek to evaluate the suc-

cess and monitor outcomes. These include; the Value Wales Community Benefits Toolkit, Community Im-

pact Tracking and RCT Homes/Hyder Open Space Audit.

“Value Wales Community Benefit Toolkit shows RCT Homes investment on one project

had delivered a mul�plier effect of £2.36 for every £1 of spend in the local community”

HighlightsHighlightsHighlights

♦♦♦ Pioneer of Targeted Recruitment and Training in WalesPioneer of Targeted Recruitment and Training in WalesPioneer of Targeted Recruitment and Training in Wales

♦♦♦ Over 1100 training opportuni�es across the group created to dateOver 1100 training opportuni�es across the group created to dateOver 1100 training opportuni�es across the group created to date

♦♦♦ 80 of 308 new jobs created were for new entrants to labour market80 of 308 new jobs created were for new entrants to labour market80 of 308 new jobs created were for new entrants to labour market

♦♦♦ 16 supported by JobMatch16 supported by JobMatch16 supported by JobMatch

♦♦♦ 17 trainee posts17 trainee posts17 trainee posts

The Open Spaces audit is based on 3 key areas of considera�on; namely Landscape (physical elements),

Horizon (community) and Atmosphere (the overall result of Horizon and landscape) measured against a

backdrop of stakeholder focussed indicators. This approach takes forward and further develops the

approach and methodology originally set out by Professor Dave Adamson.

RCT Homes sought to understand the impact of its social enterprise subsidiary Grow Enterprise Wales. A

number of different methods were reviewed including PQSSO,SROI, and SIMPLE (Social IMPact on Local

Economies). Whilst all methods had merit, it was the SIMPLE method that offered the most flexible

approach for whole organisa�on assessment.

• Framework to assess what GrEW is doing against its mission

• Help us plan for change

• Help us assess and develop rela�onships with stakeholders

• Support the development of local knowledge

• Provide a basis for other social impact assessment approaches

• Evidence for use in marke�ng materials and funding bids

This approach allowed RCT Homes to build up its evidence base and understand the priori�es,

opportuni�es and constraints of the organisa�on before establishing so# and hard outcome measures

and impact indicators.

RCT Homes chose impact indicators based upon economic, environmental and social factors. Some of

these have been able to be mone�sed, for example the amount of saved to the public purse as a result of

providing in work training and the posi�ve impact on future employability.

The approach developed within the company has held to make the whole organisa�on think differently

about some of these issues because the assessment was happening first before projects were

undertaken. RCT Homes plan to undertake the SIA once more in 2012 and compare against the base lines

and impacts established in 2011. Considera�on is also to be given to undertaking an SROI on individual

products and ac�vi�es.

Contact

Rod Keeble - Email: rodk@rcthomes.co.uk

Lisa Balfe - Email: lisab2@rcthomes.co.uk

Thank you to all of the organisa�ons who presented at the Measuring your Impact

events in September: