29
NHS Scotland Specialist CAMHS Balanced Scorecard Consultation Feb/March 2011

CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

  • Upload
    vuhanh

  • View
    239

  • Download
    1

Embed Size (px)

Citation preview

Page 1: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

 

NHS Scotland 

Specialist CAMHS  

Balanced  Scorecard  

 

Consultation 

Feb/March 2011 

Page 2: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

Contents Executive summary

3

Background

4

The rationale for using a strategic performance measurement approach

5

The challenges of effective performance measurement in CAMHS

6

More about the Balanced Scorecard

7

Methodology

8

The Balanced Scorecard and the Quality Strategy

9

Implementation challenges

10

The Strategy Map

12

The CAMHS Balanced Scorecard

13

Performance indicator templates

14-29

Page 2 of 29  

Page 3: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

Executive summary It has been agreed that a Balanced Scorecard1 is to be adopted for use in monitoring the success of NHS Boards in implementing child and adolescent mental health (CAMH) policy and to support national data benchmarking of CAMH services (CAMHS) across Scotland. This approach to performance measurement has been favoured for two reasons:

1. Firstly it produces information across a range of performance areas in such a way that produces a balanced picture of performance, inclusive of all six dimensions of quality2. In other words in enables information about resources, efficiency and access to be considered alongside issues of effectiveness, patient experience and safety.

volved in making strategic decisions about sustainable service redesign

as a mechanism for ensuring enhanced quality, accountability and transparency.

h of the CAMHS Balanced Scorecard. 10 other indicators are proposed for future inclusion.

dd additional indicators which reflect a unique or innovative service function or orientation.

The Consultation

This consultation paper sets out to provide three things:

• Information about the approach that has been used

and the key performance indicators link together to produce a ‘basket’ of indicators.

                                                             

2. Secondly it produces meaningful data which has a practical use for local CAMHS managers and senior clinicians in

The use of a properly designed Balanced Scorecard will greatly support efforts aimed at closing the gap between stakeholder aspirations and the outputs of specialist CAMH providers across Scotland. When fully operational it will act as a lever, as a barometer of success and

The scorecard itself appears, in diagrammatical shorthand, on page 12. It comprises 16 proposed key performance indicators (KPIs) arranged within 4 perspectives to provide a balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc

The balanced scorecard for CAMHS provides a common core set of KPIs for use across all NHS Boards in Scotland. It is anticipated that the scorecard, once operational, will come under regular review which will lead to revision, refinement and the addition of further indicators over time. In addition to the common core set of KPIs some specialist CAMH services might wish to a

• Explanations to enable the reader to understand how the strategy map, the performance domains

 1 The Balanced Scorecard has been around since 1992 and has its origins in:                                              Kaplan,R.S. and Norton, D.P. (1992) The Balanced Scorecard‐Measures that Drive Performance. Harvard Business Review. Jan‐Feb  

  

2 The Healthcare Quality Strategy for NHS Scotland (2010 Scottish Government) 

Page 3 of 29  

Page 4: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

• A set of key performance indicators which provide an adequate range and balance to

St Andrews House

dinburgh EH1 3DG [email protected]

important than ever that effort is properly

example around waiting times and workforce and

raft scorecard was produced in 2009 following a successful stakeholder event in

or development group was established in order to work towards this final consultation paper. The work of

n to produce indicators which will generate the production of management information and benchmarking data which will prove meaningful

                                                             

enable the scorecard to be launched

The consultation concludes on 31st March 2011. Please send all responses to:

Graham Monteith CAMHS Nurse Advisor Scottish Government

Egr

Background For the past five years there has been unprecedented interest in the activities of NHS specialist CAMH Services in Scotland. Much of this interest centres on the requirement of NHS Boards to lead their planning partners in the implementation, by 2015, of The Mental Health of Children and Young People: A Framework for Promotion, Prevention and Care (2005)3. The policy is bold and ambitious and has already been the inspiration behind a range of new developments. However much remains to be done. To succeed will require unprecedented commitment and effort. The current economic climate has created an additional level of challenge by making it more channelled, that good practice is widely shared and that the performance improvements of specialist CAMH services are clearly articulated.

A decision was taken in 2008 to create a Balanced Scorecard for specialist CAMHS in Scotland using a strategic performance measurement approach. This approach offers an opportunity for tying together the CAMHS ‘benchmarking type’ activities which have been running in parallel with its development (forthe creation of Integrated Care Pathway (ICP) standards but also requires the creation of further key performance indicators (KPIs).

An initial dAugust 2008 and input from the University of Strathclyde Department of Management Science.

Now reporting to the Scottish Government National Mental Health Benchmarking Group the next stage of this work began in January 2010 with an input from ISD4. Following a successful workshop in July 2010 a CAMHS Balanced Scorecard indicat

designing the scorecard indicators has been carried out making explicit reference to The Healthcare Quality Strategy for NHS Scotland (Scottish Government 2010).

The overarching aim of this project has bee

 3 Mental Health of Children and Young People (2005 Scottish Executive) 

4 Information Services Division 

Page 4 of 29  

Page 5: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

and useful to a wide range of stakeholders which includes CAMHS clinicians and maNHS Boards and the Scottish Government.

The rationale for using a strategic performance

nagers,

enge; namely that of holding on to this new sense of

nd objectives will only be possible if

r, patients will be

provement is

                                                             

measurement approach The task of planning, delivering and managing health service provision is highly complex. This is partly because it involves matching the unique needs of large numbers of individuals with the skills and finite capacity of a largely human resource. This complexity is compounded by the demands placed on individual organisations to combine a large number of component actions within a specific framework of values and aims. Our success in being able to design and implement these actions defines our capacity for individual and collective problem solving. However, one consequence of a focus on the actions of service provision is that we can sometimes lose our focus on the patient. One way of countering this is for service providers to take a regular step back and, with the help of a range of stakeholders, re-examine and re-state service aims and objectives. Once this has been achieved service providers are faced with a new challmission and purpose. It is in response to this challenge that strategic performance measurement can prove invaluable.

Within specialist CAMHS in Scotland clinicians have become increasingly familiar with the use of clinical audit and research tools. Clinicians have adopted these tools in order to inform decisions about improving clinical practice through the use of feedback loops. It is important that this trend continues. However, up until now CAMHS managers and clinicians have been less involved in the creation of feedback loops which reflect an evaluation of the strategic performance of the wider organisational systems and sub-systems within which they work. Clear guidance from recent national public policy is available for any specialist CAMH Service looking to restate its local aims and objectives. There is also a broad recognition that the achievement of these aims aspecialist CAMHS are able to both grow their capacity and realign and re-shape their resources in collaboration with a range of partners.

Against this background it is important for those charged with the responsibility of effecting sustainable local service redesign and development to have access to data which reflects the wide range of objectives that they are setting out to achieve. We know from experience that a focus on improvement in one area can sometimes lead to deterioration elsewhere. This is why the idea of balance is so important. To use a general health service analogy we all know that there is no point attempting to improve hospital services at the expense of vital community services as the threshold for admissions will just become lowedischarged later, and the pressure on beds will escalate. We must aim to focus on whole systems and aim for a balanced approach to quality and to improvements

Targets are often used to create an impetus for change. The current CAMHS waiting times HEAT target5 is an example of this. However, the use of single performance targets is inadequate when performance is affected by multiple drivers, and when im

 5 26 weeks referral to treatment by 2013 

Page 5 of 29  

Page 6: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

required in a range of areas. Performance indicators used in isolation create a risk of skewing performance and adversely affecting other parts of service provision.

Good measures of performance provide information with which to make year on year comparisons. For the purposes of benchmarking across NHS Boards and for economies of

ale, it makes sense that strategic performance measurement becomes standardised whilst the same time allowing for differences in local services.

The challenges of effective performance

absence of consensus about what in the initial launch of the

Boards towards their introduction at the earliest possible opportunity.

miscommunication between senior clinicians and general management throughout the to ensure that this

tension is synergetic, creative and productive.

tive and constructive and helpful. It is inevitable that, over time, some ing this purpose than others. The Scottish

hich are not doing their job.

sing sight of what stakeholders

scat

measurement in CAMHS 1. Introducing a culture of measurement for clinical and patient experience

outcomes

Outcome measures are clearly a very important part of a fully functioning balanced scorecard for CAMHS. The routine use of outcomes measures is not the current norm. Reasons for this include the associated costs and theto use. Outcome measures will not therefore be includedscorecard but the Scottish Government will continue to work with NHS

2. Overcoming a fear of the misuse of performance data

Any attempt to quantify (and therefore simplify) a complex activity carried out by specialists carries with it the danger that a non specialist may misinterpret and then misuse performance data. This challenge is not specific to performance measurement or to CAMHS and encapsulates the innate tension and the associated potential for

whole of the health service. It is the task of all parties to endeavour

3. Tolerating disagreement about the choice of proxy measures

Key performance indicators will often be proxy measurements of performance in the areas that are deemed worthy of focus. The use of proxy measures involves the use of assertions and assumptions about relationships of cause, effect and influence which are not always universally agreed. A good indicator should produce data which provokes questions about performance and trends and variance which lead to dialogue which is ultimately producindicators will prove to be better at fulfillGovernment will work with NHS Boards to improve or remove indicators w

4. Making the important measurable not the measureable important

When designing a Balanced Scorecard there it is important to ensure that the pragmatic use of useful existing data sources does lead to us lo

Page 6 of 29  

Page 7: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

have told us is important. Although some existing data sources have been used in the design of the CAMHS Balanced Scorecard it is to be hoped that this is not at the

the perverse effect of devaluing activities which are equally or more important but which are not being measured. This is a challenge which the

ks to therefore is the inclusion of

expense of the integrity of the overall finished product.

5. Ensuring balance

It is of course important to consider the implicit power of the act of measurement We are all aware of the old adage of “what gets measured gets done” That quote, often attributed to the late Peter Drucker6, is used frequently when talking about performance improvement7, ”. In other words the act of measurement carries with it an implication of priority which can have

strategic use of a system of performance indicators in a Balanced Scorecard seeovercome. Implicit to the design of a Balanced Scorecard balancing measures.

More about the Balanced Scorecard Definitions

A Balanced Scorecard (BSC)…. is a coherent, explicitly linked system of key performance indicators. When applied to a specialist health service or system each individual performance indicator provides an insight into the performance of one aspect of that system. The indicators combine to provide a reading of the ‘vital signs’ or ‘health’ of the service as a whole and if carefully constructed design out the perverse effect of measurement A performance indicator or key performance indicator (KPI)…. is a quantification of one aspect of performance. It provides a deliberately simplified indication of that aspect of performance. Used individually it can provide a very simple barometer reading of success or failure This can help to highlight those areas of performance which may require a more in-depth analysis before corrective actions are taken.

The Balanced Scorecard is a widely accepted method for strategic performance measurement and management. Initially developed for the private sector it has been successfully adapted and used across the public sector including within health.

Principles

The main principles behind the design of a Balanced Scorecard include:

Ensuring that the service is focussed on the right areas of performance – the areas

                                                             

that really matter in terms of service delivery. In a complex service like CAMHS there are many different areas of service performance that could be measured and

 6 Peter Ducker (1909 –  2005) was a writer, management consultant, and self‐described “social ecologist.”  

7 Although some would prefer to argue the case for “some of what gets measured gets done”  (The argument being that measurement itself is not the problem but rather the lack of will to use data to continuously improve systems and the lack of a process to interpret and apply data for continuous improvement.) 

 

Page 7 of 29  

Page 8: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

monitored. From a performance management perspective, it is important to measure the areas that really have an impact on overall performance.

ny of the performance indicators are going to be proxy measures.

Ensuring that there is a balance of measures across different aspects of service rmance rather than a focus on one or two headline measures (such as waiting

map effectively enables the service to identify those areas of performance that are strategically important. The map thus

r explanations when performance fails to

Scorecard itself which typically comprises four s or domains, with each perspective providing an insight into a particular aspect ice's performance. The scorecard is made up of the key performance areas

onsible for service delivery and improve that

rence to CAMHS overall performance

it encourages a balanced view of performance requiring a consideration of the tensions and trade-offs between different areas of service performance, for example the trade off between improving response times for patients and staff costs

s of performance we should be focusing on, and

Ensuring that the service is measuring the areas of performance in the right way – that the performance indicators are properly thought through, well-designed and fit-for-purpose. In a service like CAMHS it must be accepted that ma

perfotimes) which might encourage a dysfunctional management of resources.

Features

The BSC approach consists of two connected features. The first is a service -specific strategy map which sets out the service's overall strategic goals and then shows what the service needs to be good at in order to achieve these goals. The

provides a clear focus for performance measurement – the areas that are strategically important need to be well-managed. In order to be well-managed, performance needs to be measured, monitored and acted upon in each of these areas.

The map also acts as a tool to help in the search fomeet a particular target (where targets have been set) or expectation . It is also an attempt to demonstrate the way in which the different parts of service performance act as a unified system, helping the observer to see and therefore understand the systemic effects and impacts of one part of the system on another.

The second feature is the Balancedperspectiveof the serv(identified on the strategy map) and the key performance indicators (KPIs) that will be used to measure and manage performance.

Purpose

The primary overall purpose of the BSC is to provide those respwith the right performance information so that they can measure, managedelivery. A scorecard can also bring other benefits:

it allows for data benchmarking across different services it provides a basis for reporting and accountability to stakeholders it allows different parts of a service to see where they can make a diffe

Methodology At the national CAMH stakeholders day in August 2008 workshop participants were asked to contribute ideas about performance measurement. In particular they were asked to offer suggestions and opinions about the area

Page 8 of 29  

Page 9: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

how this performance could be quantified and measured. The ideas which were elicited at this highly successful event created the raw material from which the balanced scorecard presented in this paper was constructed.

e construction of the Balanced Scorecard from the raw materials which had been produced at the stakeholder event.

e areas of CAMHS performance judged essential for We can do this by ensuring ....). In order to be successful in

developing consensus in broad terms on the outcomes that a CAMH service

which is shown on page 12.

formance areas from the strategy map were grouped into 4 The four proposed perspectives are:

1. Delivering best practice

4. Best use of resources

as.

,

at does not vary in quality because of personal characteristics such as gender, ethnicity, geographic location or socio-economic status

There were two distinct phases in th

The first of these was the construction of an outline strategy map. The outline CAMHS strategy map is shown on page 11.

The map is capable of being read from the top down or from the bottom up.

From top down the top level shows the two key outcomes (This is what we want to deliver…). Below these are fivdelivering the two outcomes (each of the five areas, four key developments were identified (So this is what we need to do….) Finally, a number of key strategic requirements were identified at the bottom level (We can do this if we have ….)

It is important to appreciate that there is no right or wrong strategy map for CAMHS. Rather it is aboutexpects to deliver and the key strategic areas that will contribute to these outcomes.

The second stage was the creation of the Balanced Scorecard itself

In order to do this the 18 key perperformance themes/perspectives.

2. Client/patient focus 3. Internal processes

Key performance indicators (KPIs) have been created for each of the 18 performance are

The Balanced Scorecard and the Quality Strategy NHS Scotland strives to ensure that all NHS Services are:

• Person centred: providing care that is responsive to individual personal preferencesneeds and values and assuring that patient values guide all clinical decisions

• Safe: avoiding injuries to patients from care that is intended to help them Effectiv• e: providing services based on scientific knowledge

• Efficient: avoiding waste, including waste of equipment, supplies, ideas, and energy • Equitable: providing care th

Page 9 of 29  

Page 10: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

• Timely: reducing waits and sometimes harmful delays for both those who receive care and those who give care

Care has been taken, in the construction of the draft scorecard, to ensure that all six mensions of the quality strategy are given adequate weighting and incorporated into the ements of the strategy map. Explicit links to the Quality Strategy dimensions are made in

tors (pages 13 to 28)

holders is essential This is because

olders including local CAMH managers (at all levels of organisation up to and including Board Chief Executives) and senior clinicians.

e implications in relation to joining an outcomes research consortium

specialist

nt centred services.

should also be noted that the proposed Scorecard comprises a core set of KPIs to be used ross all specialist CAMH services. The Scorecard can be readily adapted to include ditional local KPIs relevant to individual CAMH services.

dielthe templates which elaborate on individual indica

Implementation challenges There are a number of implementation challenges.

An active and enthusiastic engagement of relevant stakethe Balanced Scorecard will only be effective if it is supported by a genuine ‘buy-in’ by a range of stakeh

Most specialist CAMH services are starting at a low base when it comes to data collection and analysis.

There are clear resourcor quality improvement network and in the early stages of integrated care pathway development when some clinician time is required during the model building phase with multi-agency partners.

Careful thought will have to be given as to the best ways of minimising costs and maximising collaborative advantages and this can be at least partially informed by a careful analysis of what has worked well within the national adult mental health benchmarking exercise.

No challenge is greater, of course, than that of striving to continue to build theCAMH workforce capacity against the current economic background. The strategy map and Balanced Scorecard make it clear that adequate resourcing is one of the fundamental pre-requisites for success in delivering good outcomes and patie

It acad

Page 10 of 29  

Page 11: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

Page 11 of 29  

The Strategy Map and Balanced Scorecard

In the strategy map each coloured box represents a different performance area.

s have been ‘themed’ to produce four

mes Research Consortium

The KPIs in bold represent the 16 indicators which are outlined in the templates which follow. These indicators are to be included in the launch of the scorecard. The others are suggestions for future inclusion. 

 

Please see the diagrams overleaf.

In the Balanced Scorecard the performance areaperformance domains. For each performance area within each domain there has been an attempt to produce at least one key performance indicator.  

* CORC = CAMHS Outco

Page 12: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

Good Clinical Outcomes Person Centred Services

This is what we want to deliver

We can do this by ensuring

Effective assessments

Effective and evidence based treatments

Fast access to services

Wide access to services

Quality clinical services

So this is what we need to do

Comply with best practice guidance (assessments and treatments

Create integrated care pathways

Provide a comprehensive range of effective CAMH services

Promote and publicise services

We can do this if we haveEffective planning and management

The right people with the right skills

Multi-agency engagement in capacity building

Adequate resourcing

User and carer involvement

The gathering and use of evidence

Value for money services

The Strategy Map

1  2 

5  6 74

10 

11 8  9 

1312 17 

18 14  15  16 

Page 13: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

 

 

 

 

 

The CAMHS Balanced Scorecard 

 

 

 

 

 

 

Client/patient focus Key Performance Area KPI (2) Provide person centred services

2.1 From CORC*

(5) Achieve fast access to services

5.1 Patients waiting (RTT) more than 26 weeks 5.2 % of all referrals waiting ≥ 26 weeks

(6) Achieve wide access to services

6.1 Number of LD patients assessed 6.2 % of 16 and 17 year olds with access to specialist CAMHS 6.3 % assessed who are from most deprived areas

(7) Provide quality clinical services

7.1. % of CAMHS staff who are accredited therapists.

(17) Effective user and carer involvement

17.1. From CORC *

Delivering best practice Key Performance Area KPI (1) Deliver good clinical outcomes 1.1 From CORC*

1.2 % of referrals in the past 12 months which are re-referrals

(4) Provide effective and evidence based treatments

4.1 Number of children benefiting from programmed targeted ‘prevention’ activity

(8) Comply with best practice guidance (assessments and treatments)

8.1 Mental health admission bed days of all under18s 8.2 Mental health admissions numbers of under 18s

(10) Provide a comprehensive range of effective CAMH specialist services

10.1 % of activity dedicated to community CAMHS tier 4 direct patient work

Internal processes Key Performance Area KPI (3) Conduct effective and integrated assessments

3.1 Progress towards implementation of ICP Generic Care Standards

(9) Ensure fully comprehensive integrated care pathways

9.1 Progress towards implementation of ICP Process Standards

(11) Promote and publicise services

11.1 No of referrals/100k pop

(12) The gathering and use of evidence 12.1 no of peer reviewed publications in last 24 months 12.2 CAMH research grant income in last 24 months

(15) Ensure the engagement of multi-agency partners in the CAMH capacity development agenda

15.1 Number of consultations

Best use of resources Key Performance Area KPI (13) Conduct effective planning and management

13.1 Progress towards implementation of ICP Service Improvement Standards*

(14) Ensure the availability of the right people with the right skills

14.1 No of wte specialist clinicians/100k pop 14.2 % sickness absence of dedicated CAMH clinicains

(16) Ensure adequate resourcing

16.1 Community CAMHS wages budget /100k pop

(18) Deliver value for money services

18.1 No of DNAs as % of all appoinments 18.2 total number of clinical appointments completed

Page 14: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

.Key Performance Indicator Templates

CLIENT/ PATIENT FOCUS PERFORMANCE INDICATOR 5.1

Quality Strategy Links

Timely, Safe, Effective

 

Primary Information Performance Domain

Client/Patient focus

Performance Area

Achieve fast access to services

KEY PERFORMANCE INDICATOR

Patients waiting more than 26 weeks (referral to treatment)

Target

0

Actual

Frequency of Measure and Trend

Monthly submission

Key Actions

Supporting Information KPI

Patients waiting more than 26 weeks (referral to treatment)

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD

Significance of Measure

Early intervention relates to better outcomes

Assumptions and syntax

CAMHS Services are compliant with ‘New Ways’8

Contextual Information

HEAT target (no patients waiting longer than 26 weeks by March 2013)

                                                              8 A system of designing and measuring waiting lists in NHS Scotland introduced in 2007   

Page 15: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

CLIENT/ PATIENT FOCUS PERFORMANCE INDICATOR 6.1

Quality Strategy Links

Equitable, Safe, Person centred

Primary Information Performance Domain

Client/patient focus

Performance Area

Achieve wide and local access to services

KEY PERFORMANCE INDICATOR

Number of patients referred in the previous 3 months who are categorised as having a learning disability

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Number of patients referred in the previous 3 months who are categorised as having a learning disability

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD Waiting times submissions (additional category of referral required)

Significance of Measure

Proxy measure of accessibility

Assumptions and syntax

Boards should be offering mental health services to this group who are known to have significant level of need (approx 6 times more likely to require services) Agreed definition required

Contextual Information

Page 15 of 29  

Page 16: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

CLIENT/PATIENT FOCUS PERFORMANCE INDICATOR 7.1

Quality Strategy Links

Effective, Safe, Person centred

Primary Information Performance Domain

Client/Patient focus

Performance Area

Quality clinical services

KEY PERFORMANCE INDICATOR

% of CAMHS workforce who are consultant psychiatrists, clinical psychologists, child psychotherapists plus other clinicians who are accredited therapists (CBT,SP,PT,AT 9 etc)

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

% of CAMHS staff who are consultant psychiatrists, clinical psychologists, child psychotherapists plus other clinicians who are accredited therapists (CBT,SP,PT,AT)

Description Numerator (if applicable)

a) Total number of whole time equivalent clinicians in the above category

Denominator (if applicable)

b) Total CAMHS (wte) workforce

Calculations (if applicable)

a) divided by b)

Data Source (including contacts if applicable) ISD workforce database Significance of Measure

Adequate numbers of senior clinicians and accredited therapists are essential for safe and effective service provision

Assumptions and syntax

See ISD CAMHS workforce database for definitions (work in progress) Agreement required about what therapies to include

Contextual Information

Link to psychological therapies HEAT target

                                                              9 Cognitive Behavioural Therapist, Systemic Practitioner, Play therapist, Art therapist 

Page 16 of 29  

Page 17: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

DELIVERING BEST PRACTICE PERFORMANCE INDICATOR 1.2

Quality Strategy Links

Safe, Efficient, Person Centred

Primary Information Performance Domain

Delivering Best Practice

Performance Area

Good Clinical Outcomes

KEY PERFORMANCE INDICATOR

% of appropriate new referrals of children who were referred previously within the last 12 months.

Target

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

% of appropriate new referrals of children who were referred previously within the last 12 months

Description

Numerator (if applicable)

a) Number of new referrals of patients who were referred previously within the last 12 months

Denominator (if applicable)

b) Total number of referrals

Calculations (if applicable)

a) divided by b)

Data Source (including contacts if applicable)

ISD waiting times data submissions (additional category required)

Significance of Measure

Low proportions of re-referrals suggest good outcomes for those previously referred

Assumptions and syntax

High re-referral rate can be a consequence of premature discharge, disengagement, mismatch of clinician skills with the patient’s needs or sub optimal pre-referral work/signposting

Contextual Information

Page 17 of 29  

Page 18: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

DELIVERING BEST PRACTICE PERFORMANCE INDICATOR 4.1

Quality Strategy Links

Effective, Timely

Primary Information Performance Domain

Delivering Best Practice

Performance Area

Provide Effective and Evidence Based Treatments

KEY PERFORMANCE INDICATOR

Number of children benefiting from programmed targeted ‘prevention’ activity10 in the last 3 months

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

No of children benefiting from targeted programmed ‘prevention’ activity in the last 3 months

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

New submissions from Boards required

Significance of Measure

Proxy of commitment to support evidence based practice

Assumptions and syntax

CAMHS specialists will be supporting programmes with supervision. Definition of ‘programmed prevention activity’ required

Contextual Information

Link to DfMH refresh. Congruent with SG support for early years programmes

                                                              10 Programmes which are selective and which are delivered with fidelity to model and quality assured with specialist supervision. (examples include Family Nurse Partnership, Incredible Years, Triple P) 

Page 18 of 29  

Page 19: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

DELIVERING BEST PRACTICE PERFORMANCE INDICATOR 8.1

Quality Strategy Links

Person Centred, Effective

Primary Information Performance Domain

Delivering Best Practice

Performance Area

Comply with best practice guidance (assessments and treatments)

KEY PERFORMANCE INDICATOR

Mental health admission bed days numbers of all under 18s

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Mental health admission bed days numbers of all under 18s (broken down into i) adolescent unit ii) adult ward total iii) adult ward 15 and under)

Description Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD/ Mental Welfare Commission

Significance of Measure

Proxy of community tier 4 effectiveness. High number in adult wards can also be indicative of capacity issues of the bigger system

Assumptions and syntax

Boards who have not invested adequately in community Tier 4 (best practice) will have more admissions and longer admissions.

Contextual Information

DfMH11 commitment 11. Requirement of 2003 Mental Health Act for age appropriate care

Page 19 of 29  

Page 20: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

DELIVERING BEST PRACTICE PERFORMANCE INDICATOR 8.2

Quality Strategy Links

Safe, Person Centred

Primary Information Performance Domain

Delivering Best Practice

Performance Area

Comply with best practice guidance (assessments and treatments)

KEY PERFORMANCE INDICATOR

Mental health admission numbers of under 18s

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Mental health admission numbers for under 18s (broken down into i) adolescent unit ii) adult ward total iii) adult ward 15 and under)

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD/Mental Welfare Commission

Significance of Measure

Proxy of community tier 4 effectiveness. High number in adult wards can also be indicative of capacity issues of the bigger system

Assumptions and syntax

Boards who have not invested adequately in community Tier 4 (best practice) will have more admissions and longer admissions.

Contextual Information

DfMH commitment 11. Requirement of 2003 Mental Health Act for age appropriate care

Page 20 of 29  

Page 21: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

DELIVERING BEST PRACTICE PERFORMANCE INDICATOR 10.1

Quality Strategy Links

Effective, Safe, Person Centred

Primary Information Performance Domain

Delivering Best Practice

Performance Area

Provide a comprehensive range of effective CAMH specialist services

KEY PERFORMANCE INDICATOR

% of all activity dedicated to community CAMHS tier 4 direct patient work

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

% of all activity dedicated to community CAMHS tier 4 direct patient work

Description

Numerator (if applicable)

Total figure for the above in hours per week

Denominator (if applicable)

Total wte workforce multiplied by 37.5

Calculations (if applicable)

a) divided by b) multiplied by 100

Data Source (including contacts if applicable)

ISD workforce database (requires small modification)

Significance of Measure

Proxy measure of service range (high intensity low volume work is often hardest area to extend into)

Assumptions and syntax

Contextual Information

Page 21 of 29  

Page 22: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

INTERNAL PROCESSES PERFORMANCE INDICATOR 11.1

Quality Strategy Links

Safe, Equitable

Primary Information Performance Domain

Internal Processes

Performance Area

Promote and publicise services

KEY PERFORMANCE INDICATOR

Number of new referrals to specialist CAMHS

Target

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

Number of new referrals to specialist CAMHS

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD Waiting times submissions

Significance of Measure

Proxy for stakeholder perception of availability responsiveness, accessibility and competence (as well as levels of need)

Assumptions and syntax

Contextual Information

Link with HEAT access target ( referral numbers may rise as waiting decreases)

Page 22 of 29  

Page 23: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

INTERNAL PROCESSES PERFORMANCE INDICATOR 12.1

Quality Strategy Links

Effective, Safe, Efficient, Person Centred

Primary Information Performance Domain

Internal Processes

Performance Area

The gathering and use of evidence

KEY PERFORMANCE INDICATOR

Number of peer reviewed publications in last 24 months

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Number of peer reviewed publications in last 24 months

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

Requires new submission form Boards

Significance of Measure

Proxy measure of commitment to innovation, a culture of enquiry and of using evidence in practice

Assumptions and syntax

Contextual Information

Page 23 of 29  

Page 24: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

INTERNAL PROCESSES PERFORMANCE INDICATOR 15.1

Quality Strategy Links

Effective, Efficient, Safe

Primary Information Performance Domain

Internal Processes

Performance Area

Ensure the engagement of multi-agency partners in the CAMH capacity development agenda

KEY PERFORMANCE INDICATOR

Number of consultations completed

Target

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

Number of consultations completed

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD Waiting Times submissions

Significance of Measure

Proxy measure for multi-agency CAMHS strength, capacity and connectedness

Assumptions and syntax

Use agreed definition of consultation

Contextual Information

Page 24 of 29  

Page 25: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

BEST USE OF RESOURCES PERFORMANCE INDICATOR 14.1

Quality Strategy Links

Safe, Effective

Primary Information Performance Domain

Best Use of Resources

Performance Area

Ensure the availability of the right people with the right skills

KEY PERFORMANCE INDICATOR

Number of wte specialist clinicians per 100k population

Target

20-24

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Number of wte specialist clinicians/100k population

Description

See ISD database for definitions

Numerator (if applicable)

a) Total number of whole time equivalent clinicians

Denominator (if applicable)

b) Health Board area population divided by 100,000

Calculations (if applicable)

a) divided by b)

Data Source (including contacts if applicable)

ISD database

Significance of Measure

Adequate numbers of clinicians are essential for safe and effective service provision

Assumptions and syntax

See ISD database for definitions

Contextual Information

Page 25 of 29  

Page 26: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

BEST USE OF RESOURCES PERFORMANCE INDICATOR 14.2

Quality Strategy Links

Effective, Efficient, Safe, Person Centred, Timely

Primary Information Performance Domain

Best Use of Resources

Performance Area

Ensure the availability of the right people with the right skills

KEY PERFORMANCE INDICATOR

Percentage sickness absence of dedicated NHS CAMH clinicians

Target

4%

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

Percentage sickness absence of dedicated NHS CAMH clinicians

Description

Numerator (if applicable)

a) Number of days absence

Denominator (if applicable)

b) Number of CAMH clinicians

Calculations (if applicable)

a) divided by b)

Data Source (including contacts if applicable)

Should be locally available in individual Boards

Significance of Measure

Proxy measure of the ‘health’ of the working environment

Assumptions and syntax

High levels of sickness absence can indicate over-stressed and/or under-supported workers and lead to diminished service delivery capacity.

Contextual Information

Link to national sickness absence target

Page 26 of 29  

Page 27: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

BEST USE OF RESOURCES PERFORMANCE INDICATOR 16.1

Quality Strategy Links

Safe, Effective, Timely

Primary Information Performance Domain

Best Use of Resources

Performance Area

Ensure adequate resourcing

KEY PERFORMANCE INDICATOR

Community CAMHS wages budget per 100k pop

Target

Actual

Frequency of Measure and Trend

Quarterly

Key Actions

Supporting Information KPI

Community CAMHS wages budget per 100k pop

Description

Numerator (if applicable)

a) Total community CAMHS psychiatry wages budget plus total spend on community CAMHS AfCh clinicians’ wages.

Denominator (if applicable)

b) Health Board area population divided by 100,000

Calculations (if applicable)

a) divided by b)

Data Source (including contacts if applicable)

Combination of local information and ISD CAMHS workforce (ISD workforce modelling tool available for AfCh wages)

Significance of Measure

Absolute measure of resourcing. Also provides service ‘profiling’ which shows proportions of high and low cost professionals in the workforce

Assumptions and syntax

Contextual Information

Links with KPI 14.1

Page 27 of 29  

Page 28: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

BEST USE OF RESOURCES PERFORMANCE INDICATOR 18.1

Quality Strategy Links

Person centred, Efficient

Primary Information Performance Domain

Best Use of Resources

Performance Area

Deliver value for money services

KEY PERFORMANCE INDICATOR

Number of DNAs as a percentage of all appointments

Target

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

Number of DNAs as a percentage of all appointments

Description

Numerator (if applicable)

a) Number of DNA appointments

Denominator (if applicable)

b) Total number of all appointments

Calculations (if applicable)

a) divided by b) multiplied by 100

Data Source (including contacts if applicable)

ISD

Significance of Measure

DNAs represent a waste of resource.

Assumptions and syntax

A high percentage could be indicative of poor appointment processes or patient dissatisfaction with previous appointment(s)

Contextual Information

Page 28 of 29  

Page 29: CAMHS Balanced Scorecard - isdscotland.org · balanced view of CAMHS performance. This ‘basket’ of 16 indicators will be included in the 2011 launc. The balanced scorecard for

BEST USE OF RESOURCES PERFORMANCE INDICATOR 18.2

Quality Strategy Links

Efficient, Timely, Equitable

Primary Information Performance Domain

Best Use of Resources

Performance Area

Deliver value for money services

KEY PERFORMANCE INDICATOR

Total number of clinical appointments completed

Target

Actual

Frequency of Measure and Trend

Monthly

Key Actions

Supporting Information KPI

Total number of clinical appointments completed (broken down into first and review)

Description

Numerator (if applicable)

Denominator (if applicable)

Calculations (if applicable)

Data Source (including contacts if applicable)

ISD Waiting times submissions

Significance of Measure

Provides an indicator of current clinical activity outputs

Assumptions and syntax

Contextual Information

Page 29 of 29