A Tool for Assessing Readiness for New Data Systems€¦ · Example: OHRS, Catalyst 8 Case management Planning Advocacy Accountability Keeping track of information about individual

A Tool for Assessing Readiness for New Data SystemsAMHO Conference

May 29, 2018

Copyright © 2017, CAMH2

Sera Weafer-SchiarizzaEvaluation Coordinator

Provincial System Support Program (PSSP), CAMH

[email protected]

Maja KovatsONHRDB System Administrator

Provincial System Support Program (PSSP), CAMH

[email protected]

mailto:[email protected]



Why did you choose this session?

Welcome!


Why we’re hosting this session!


Ontario Harm

Reduction

Database

(ONHRDB)

• Project to provide a common data

collection and reporting tool to harm

reduction service providers in Ontario

• Initiated by the MOHLTC

• MOHLTC contracted CAMH to implement

and provide ongoing support for the tool

• Currently exiting the pilot phase

• Full provincial implementation planned to

begin in the Fall


Does your agency distribute harm reduction supplies?

Are you funded by the MOHLTC for “IDU Outreach”?

Are you part of a Hepatitis C team?

By a show of hands…

Copyright © 2017, CAMH

Goals of today’s workshop:

7

Share potential implementation barriers and solutions

Present the value in performing a readiness assessment

Get your feedback on our drafted data system readiness assessment tool

Thanks for your help!


Reporting to funders on

program details; also

allows funders to

compare results from

across the jurisdiction.

Example: OHRS, Catalyst

8

Case

management

Planning

Advocacy

Accountability

Keeping track of

information about

individual clients to stay

organized, improve

service, and facilitate the

transferring of cases.

Example: electronic medical

records, OCAN

Tracking data around

service delivery to make

sure internal goals are

met, plan new goals for

the future, and identify

service gaps.

Example: OPOC,

accounting software, project

management software

Using statistics to

demonstrate the success

of a program or initiative

to the public or other

stakeholders with the

goal of fostering public

endorsement, more

funding, or scaling-up.

Example: measuring

program outcomes

Purpose of

data collection

Fidelity

Measuring the extent to

which the delivery of an

intervention adheres to a

particular protocol or

program model.


What is your perspective on data systems?(be honest!)


Some definitionsto get on the same page…

10


DATA IS NOT

NUMERICALSTATISTICALINFORMATIVEANALYTICAL(necessarily)


height

addressoccupation

birthdayfavorite TV

show

namecilantro

preference

old

myspace

name

opinion on

BC-Alberta

relations

sunburns

easily

likes dogs

never

makes the

bed

afraid of

fish

current

medications

owns a yoga

ballDATADATA

DATA

DATA

DATA

DATA

DATA DATA DATA

DATADATA

DATADATA

DATA

DATA

DATA

DATADATA DATA

DATA DATADATA


DATA IS

ANYTHING

(basically)


What is a

“data system”?


Data

system =

the data you

want

+the tools and

resources you need

to organize and

analyze it

data set

data collection &

reporting tool(s)


Examples of

data systems


What does it mean to

implement a data system?


Implementation: “A specified set of activities designed to put into practice an activity or program of known dimensions” National Implementation Research Network (NIRN)

18


Drivers of Implementation (NIRN)

Competency

Drivers

Coaching

Training

Selection

Organization

Drivers

Systems Intervention

Facilitative

Administration

Decision Support

Data System

Leadership Drivers

Technical

Adaptive


Implementing a Driver

NIRN; Flynn, McDonald, Weafer-Schiarizza (2016)


Benefits of implementinga data system…



Let us know…

What were barriers you faced? What was most helpful in adopting change?

Have you ever been part of implementing something new at your agency?


What if you could identify

potential issues before you

started to implement?


What does it mean to be

“ready to implement”?


Program

Readiness

Project

Readiness

HRSAOrganizational Culture for Change


What is a readiness assessment?


Readiness Assessment: “A systematic analysis of an organization’s ability to undertake a transformational process or change” U.S. Health Resources and Services Administration (HRSA)


1. Split into groups of 5(ish)

What factors need to be in place before a team attempts to implement a new data system?

2. Discuss the question above

3. Write down a list of potential factors


How did we develop our readiness assessment?


Key learnings pilot of ONHRDB

Alignment with NIRN implementation framework & other readiness assessments

Review of literature

Refine and revise > Workshop it at AMHO conference

> Pilot with ONHRDB

31


Overview of the

Data System

Implementation

Readiness Assessment


Vision

The purpose of the data system

Vision Organizational

culture for change


Staff perception of valueStaff buy-in to vision

Staff perception of value

Organizational

culture for change


FeedbackFeedbackOrganizational

culture for change


36

Staff timeStaff timeResources


Fit between data set and program model

Fit between data set and

program model

Fit


Would you find this readiness tool for data system implementation helpful?

1. Discuss and compare to previously listed factors

2. Is there anything about the tool you would change?

3. Are there any factors missing?


Contact:

Maja Kovats

ONHRDB System Administrator

DELTA (Data Evaluation Leadership

Transformative Analyses) (formerly DATIS),

Provincial System Support Program

(PSSP), CAMH

[email protected]

40

Sera Weafer-Schiarizza

Evaluation Coordinator

Provincial System Support Program

(PSSP), CAMH

[email protected]




Ali, Mohammad, et al. "Organizational aspects and implementation of data systems in large-scale epidemiological studies in less developed countries." BMC Public Health 6.1 (2006): 86.

Cho, Vincent, and Jeffrey C. Wayman. "Districts’ efforts for data use and computer data systems: The role of sensemaking in system use and implementation." Teachers College Record 116.2 (2014): 1-45.

Cho, Vincent, Jo Beth Jimerson, and Jeffrey C. Wayman. "Data system implementation: A leader navigates people problems around technology and data use." Journal of Cases in Educational Leadership 18.2 (2015): 134-143.

Snyder-Halpern, Rita. "Indicators of organizational readiness for clinical information technology/systems innovation: a Delphi study." International journal of medical informatics 63.3 (2001): 179-204.

World Health Organization. "Nine steps for developing a scaling-up strategy." (2010).

41

References

Documents

A Tool for Assessing Readiness for New Data Systems€¦ · Example: OHRS, Catalyst 8 Case management Planning Advocacy Accountability Keeping track of information about individual