SCCI Prioritisation Tool

1

SCCI Prioritisation Tool

Prototype for Presentation to SCCI

Version: 0.3Date: 20th May 2014

2

Overview of the Tool

• Assesses items against shared criteria using consistent scores• Summed scores enable work items to be positioned along

dimensions of Expected Benefit and Ease of Delivery• Result is richer than a one dimensional list since it brings out

the business relevance of relative positions• The tool does not automate decision making, but supports

informed reflection and enables better decisions to be taken

Criteria: Expected Benefits

1. improve the safety of patients and/or service users2. help individuals understand the types of care available3. help individuals compare the quality of different providers4. help individuals avoid illness, or manage their care needs5. help individuals access services relevant to their care needs6. help individuals access their own care records7. improve accuracy, consistency or timeliness of care information8. improve communication across organisational, geographical and system

boundaries9. improve the monitoring of outcomes in the quality of care provided10. help commissioners reconcile service provided with that commissioned11. help commissioners monitor the performance of service providers and identify

potential cost savings or productivity gains12. help regulators monitor the performance of service providers and identify

patterns that indicate the need for further investigation.

3

Criteria: Ease of Delivery

1. firm budget commitment or confirmed that deliverable from existing budget2. generates revenue or savings that cover implementation costs or accepted that

investment need not be recouped3. technical aspects well understood by development organisation4. implementation will be within a context that is familiar and prepared5. implementation requires minimal change to existing IT supplier contracts6. development and implementation has a clear motivation contained within the

NHS Outcomes Framework7. established and receptive market or clear evidence of customer demand8. implementation requires minimal change to existing business processes9. development and implementation will be within an environment of good

relationships10. committed SRO, actively engaged in the relevant governance activities11. committed and experienced development manager is in place

4

Criteria

Criteria can be changed easily to accommodate shifts in strategic or political priorities but all active items will need to be reassessed against changed criteria, so a formal change control process needs to be put in place – does not need to be onerous.

5

6

Scoresheet for criteria relating to Expected Benefits

Criteria Descriptions:• Helping individuals to choose

care types• Helping Individuals to choose

providers…

• Helping care providers to have better information

• Helping regulators to monitor performance

Individual scores

Narrative explanation of scoring

Weighting of criteria could be added but probably not useful

Recording whether Statutory/SoS Requirement

Total Benefits score

Standard or Collection ID

7

Scoresheet for criteria relating to Ease of Delivery

Criteria Descriptions:• Sufficient budget is available• Appropriately skilled staff are

available…

• Significant business change is not required

• Commercial/contractual changes not required

• Technical aspects are familiar

Individual scores

Narrative explanation of scoring

Optional Weighting for criteria that could be added to the tool

Total Ease of Delivery score

Standard or Collection ID

Results of the Assessment

• By summing the individual scores for each standard or collection, we end up with two overall scores, one for benefits and one for ease of delivery.

8

• We also capture whether an item is a SoS or Statutory requirement and (where available) its RAG status

• We use these data to plot the position of the standard or collection on the SCCI Prioritisation Matrix.

Expected Benefits

Ease of Delivery

SoS Requirement?

Statutory Req?RAG Status

SCCI Prioritisation Matrix (Basic)

9

You can see at a glance which items are high benefit & easy to deliver (top right), high benefit but difficult (top left), low benefit but easy (bottom right) and low benefit & difficult (bottom left).

EASE OF DELIVERY

EXPE

CTED

BEN

EFIT

S

R00316

ISB1588

ISB0144

ISB1077ISB0108

ISB1516

R00216R00217R00013

R00067

SCCI2025SCCI2023

SCCI2022

SCCI 2018

SCCI 2019SCCI 2016

SCCI 2007

SCCI 0086

SCCI 2005

SCCI2004

SCCI 2003

SCCI 2002

SCCI Prioritisation Matrix

10

EASE OF DELIVERY

EXPE

CTED

BEN

EFIT

S

R00316

ISB1588

ISB0144

ISB1077ISB0108

ISB1516

R00216R00217R00013

R00067

SCCI2025SCCI2023

SCCI2022

SCCI 2018

SCCI 2019SCCI 2016

SCCI 2007

SCCI 0086

SCCI 2005

SCCI ID Title SCCI ID Title

R00316 Abortion Statistics SCCI2023 Census Ethnicity Codes - DSCN11/2008

ISB1588 Accident and Emergency Clinical Quality Indicators SCCI2022 Pathology Bounded Code List

ISB0144 Adjusted Referral to Treatment (RTT) Dataset SCCI2018 Care Planning

R00067 Adult Cardiac Surgery Audit SCCI2019 ODS GP Data Indicators

R00217 Advisory Committee on Clinical Excellence Awards (ACCEA) - Collection of non-ESR items SCCI2016 Hospital at Home

R00216 Advisory Committee on Clinical Excellence Awards (ACCEA) - Employer Based Awards Reports SCCI2007 Assuring Transformation - Learning Disabilities Survey

ISB1077 AIDC for Patient Identification SCCI0086 Information Governance Toolkit V12

ISB0108 AIDC: Automatic Identification and Data Capture SCCI2005 Consent Management

ISB1516 Ambulance Electronic Patient Report SCCI2004 Audit Log Data Definitions (Patient Privacy Breaches)

R00013 Annual Census of General Medical Practitioners SCCI2003 Medication Syntax

SCCI2025 Unique Device Identifier for Implants SCCI2002 Prescriber Identifier Standard

Ambulance EPR, Learning Disabilities Survey, Care Planning, A&E Quality Indicators, Medication Syntax and Adult Cardiac Surgery Audit all score high on the benefit dimension

Clinical excellence awards, Annual Census of GP and Pathology Bounded Code List were score 0 for benefit

SCCI2004

SCCI 2003

SCCI 2002

This group is identified as being more challenging than the others

SCCI Prioritisation Matrix (including RAG)

11













EASE OF DELIVERY

EXPE

CTED

BEN

EFIT

S

R00316

ISB1588

ISB0144

ISB1077ISB0108

ISB1516

R00216R00217R00013

R00067

SCCI2025SCCI2023

SCCI2022

SCCI 2018

SCCI 2019SCCI 2016

SCCI 2007

SCCI 0086

SCCI 2005

SCCI2004

SCCI 2003

SCCI 2002

12













EASE OF DELIVERY

EXPE

CTED

BEN

EFIT

S

R00316

ISB1588

ISB0144

ISB1077ISB0108

ISB1516

R00216R00217R00013

R00067

SCCI2025SCCI2023

SCCI2022

SCCI 2018

SCCI 2019SCCI 2016

SCCI 2007

SCCI 0086

SCCI 2005

SCCI2004

SCCI 2003

SCCI 2002

SoS Requirements

Statutory Requirement

SCCI Prioritisation Matrix (including RAG + SoS/Statutory)

13

Some Operational Considerations

• The tool needs to be used by people who understand standards and collections, the challenges required to develop and implement them and the business drivers that make them valuable. It cannot be given to administrative staff.

• The tool needs to be used within the context of a dialogue with the proponents and potential developers of the standards and collections. All parties need to understand the rationale behind the score and as far as possible to be in agreement about the score.

• There is no need to carry out a retrospective assessment of the total portfolio. Assessment should only be necessary for standards or collections that are actively consuming resources. Standards and collections will actively consume resources at the following points:– when a new standard or collection is proposed and under consideration– when a new standard or collection is being developed (including consultation and publication)– when a new standard or collection is being implemented– when an existing standard or collection is undergoing maintenance changes– when an existing standard or collection is being reviewed– when an existing standard or collection is being deprecated or retired

14

What assessors said during testing

• The criteria seem relevant and comprehensive and even if the Sponsor/SRO can’t assess all at the start, they are a useful indicator of aspiration.

• The criteria fit in with the people, process, technology expectations that SCCI want to see in requirements and the final specification.

• The tool is liked - allowing for a similar SME approach to the I2N process with a strong empirical emphasis.

• It can be difficult with historical items to ascertain whether criteria are met but that is because we have not asked the questions within the ISB or ROCR processes.

• You need to understand the context when assessing, so dialogue between assessors and business owner/proposer/technical teams is essential.

• The documents don’t always contain the information necessary to carry out an assessment – interpretation is required, so narrative explanations and dialogue are very important

• A reasonably good knowledge of the standard/collection is required to use the tool, which supports the idea that assessors should come from teams such as I2N and Dev Support.

• Assessors should work with the idea submitter to reach agreement on scores or clarify disagreements.

15

Questions for SCCI• Is this sort of tool close to what was expected / required?• If not, what needs to change?• If it is broadly right, are the criteria correct? Any additions or amendments?• Is the scoring scale (-1 to 1 at 0.1 increments) too fine-grained or is it OK?• Is the presentation clear and acceptable?

Next Steps• Make any required amendments• Agree roles (assessors)• Produce simple guide for assessors and to help communicate to all involved in SCCI

process, including submitters of ideas• Connect tool with master schedule and other relevant SCCI tools

16

Plan

Approval date of 4th June assumes that prototype is close to what SCCI needs and that SCCI is happy to approve it (subject to requested changes), i.e. does not require resubmission at June 25th SCCI meeting.

Documents

SCCI Prioritisation Tool