A Tool for Assessing Readiness for New Data Systems€¦ · Example: OHRS, Catalyst 8 Case...

Preview:

Citation preview

A Tool for Assessing Readiness for New Data SystemsAMHO Conference

May 29, 2018

Copyright © 2017, CAMH2

Sera Weafer-SchiarizzaEvaluation Coordinator

Provincial System Support Program (PSSP), CAMH

Sera.weafer-schiarizza@camh.ca

Maja KovatsONHRDB System Administrator

Provincial System Support Program (PSSP), CAMH

Maja.kovats@camh.ca

Copyright © 2017, CAMH3

Why did you choose this session?

Welcome!

Copyright © 2017, CAMH4

Why we’re hosting this session!

Copyright © 2017, CAMH5

Ontario Harm

Reduction

Database

(ONHRDB)

• Project to provide a common data

collection and reporting tool to harm

reduction service providers in Ontario

• Initiated by the MOHLTC

• MOHLTC contracted CAMH to implement

and provide ongoing support for the tool

• Currently exiting the pilot phase

• Full provincial implementation planned to

begin in the Fall

Copyright © 2017, CAMH6

Does your agency distribute harm reduction supplies?

Are you funded by the MOHLTC for “IDU Outreach”?

Are you part of a Hepatitis C team?

By a show of hands…

Copyright © 2017, CAMH

Goals of today’s workshop:

7

Share potential implementation barriers and solutions

Present the value in performing a readiness assessment

Get your feedback on our drafted data system readiness assessment tool

Thanks for your help!

Copyright © 2017, CAMH

Reporting to funders on

program details; also

allows funders to

compare results from

across the jurisdiction.

Example: OHRS, Catalyst

8

Case

management

Planning

Advocacy

Accountability

Keeping track of

information about

individual clients to stay

organized, improve

service, and facilitate the

transferring of cases.

Example: electronic medical

records, OCAN

Tracking data around

service delivery to make

sure internal goals are

met, plan new goals for

the future, and identify

service gaps.

Example: OPOC,

accounting software, project

management software

Using statistics to

demonstrate the success

of a program or initiative

to the public or other

stakeholders with the

goal of fostering public

endorsement, more

funding, or scaling-up.

Example: measuring

program outcomes

Purpose of

data collection

Fidelity

Measuring the extent to

which the delivery of an

intervention adheres to a

particular protocol or

program model.

Copyright © 2017, CAMH9

What is your perspective on data systems?(be honest!)

Copyright © 2017, CAMH

Some definitionsto get on the same page…

10

Copyright © 2017, CAMH11

DATA IS NOT

NUMERICALSTATISTICALINFORMATIVEANALYTICAL(necessarily)

Copyright © 2017, CAMH12

height

addressoccupation

birthdayfavorite TV

show

namecilantro

preference

old

myspace

name

opinion on

BC-Alberta

relations

sunburns

easily

likes dogs

never

makes the

bed

afraid of

fish

current

medications

owns a yoga

ballDATADATA

DATA

DATA

DATA

DATA

DATA DATA DATA

DATADATA

DATADATA

DATA

DATA

DATA

DATADATA DATA

DATA DATADATA

Copyright © 2017, CAMH13

DATA IS

ANYTHING

(basically)

Copyright © 2017, CAMH14

What is a

“data system”?

Copyright © 2017, CAMH15

Data

system =

the data you

want

+the tools and

resources you need

to organize and

analyze it

data set

data collection &

reporting tool(s)

Copyright © 2017, CAMH16

Examples of

data systems

Copyright © 2017, CAMH17

What does it mean to

implement a data system?

Copyright © 2017, CAMH

Implementation: “A specified set of activities designed to put into practice an activity or program of known dimensions” National Implementation Research Network (NIRN)

18

Copyright © 2017, CAMH19

Drivers of Implementation (NIRN)

Competency

Drivers

Coaching

Training

Selection

Organization

Drivers

Systems Intervention

Facilitative

Administration

Decision Support

Data System

Leadership Drivers

Technical

Adaptive

Copyright © 2017, CAMH20

Implementing a Driver

NIRN; Flynn, McDonald, Weafer-Schiarizza (2016)

Copyright © 2017, CAMH21

Benefits of implementinga data system…

Copyright © 2017, CAMH22

Copyright © 2017, CAMH23

Let us know…

What were barriers you faced? What was most helpful in adopting change?

Have you ever been part of implementing something new at your agency?

Copyright © 2017, CAMH24

What if you could identify

potential issues before you

started to implement?

Copyright © 2017, CAMH25

What does it mean to be

“ready to implement”?

Copyright © 2017, CAMH26

Program

Readiness

Project

Readiness

HRSAOrganizational Culture for Change

Copyright © 2017, CAMH27

What is a readiness assessment?

Copyright © 2017, CAMH28

Readiness Assessment: “A systematic analysis of an organization’s ability to undertake a transformational process or change” U.S. Health Resources and Services Administration (HRSA)

Copyright © 2017, CAMH29

1. Split into groups of 5(ish)

What factors need to be in place before a team attempts to implement a new data system?

2. Discuss the question above

3. Write down a list of potential factors

Copyright © 2017, CAMH30

How did we develop our readiness assessment?

Copyright © 2017, CAMH

Key learnings pilot of ONHRDB

Alignment with NIRN implementation framework & other readiness assessments

Review of literature

Refine and revise > Workshop it at AMHO conference

> Pilot with ONHRDB

31

Copyright © 2017, CAMH32

Overview of the

Data System

Implementation

Readiness Assessment

Copyright © 2017, CAMH33

Vision

The purpose of the data system

Vision Organizational

culture for change

Copyright © 2017, CAMH34

Staff perception of valueStaff buy-in to vision

Staff perception of value

Organizational

culture for change

Copyright © 2017, CAMH35

FeedbackFeedbackOrganizational

culture for change

Copyright © 2017, CAMH

36

Staff timeStaff timeResources

Copyright © 2017, CAMH37

Fit between data set and program model

Fit between data set and

program model

Fit

Copyright © 2017, CAMH38

Would you find this readiness tool for data system implementation helpful?

1. Discuss and compare to previously listed factors

2. Is there anything about the tool you would change?

3. Are there any factors missing?

Copyright © 2017, CAMH

Contact:

Maja Kovats

ONHRDB System Administrator

DELTA (Data Evaluation Leadership

Transformative Analyses) (formerly DATIS),

Provincial System Support Program

(PSSP), CAMH

Maja.Kovats@camh.ca

40

Sera Weafer-Schiarizza

Evaluation Coordinator

Provincial System Support Program

(PSSP), CAMH

Sera.weafer-schiarizza@camh.ca

Copyright © 2017, CAMH

Ali, Mohammad, et al. "Organizational aspects and implementation of data systems in large-scale epidemiological studies in less developed countries." BMC Public Health 6.1 (2006): 86.

Cho, Vincent, and Jeffrey C. Wayman. "Districts’ efforts for data use and computer data systems: The role of sensemaking in system use and implementation." Teachers College Record 116.2 (2014): 1-45.

Cho, Vincent, Jo Beth Jimerson, and Jeffrey C. Wayman. "Data system implementation: A leader navigates people problems around technology and data use." Journal of Cases in Educational Leadership 18.2 (2015): 134-143.

Snyder-Halpern, Rita. "Indicators of organizational readiness for clinical information technology/systems innovation: a Delphi study." International journal of medical informatics 63.3 (2001): 179-204.

World Health Organization. "Nine steps for developing a scaling-up strategy." (2010).

41

References

Recommended