OHA NP Conference Feb 19, 2001

VON NP Project Evaluation

OHA NP Conference Feb 19, 2001

VON NP Project Evaluation

VON NP

Evaluation

Framework

Janet Helmer RN(EC)

Director of Standards and

QM

VON NP

Evaluation

Framework

Janet Helmer RN(EC)

Director of Standards and

QM

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

About VON Canada

• Charitable, not-for-profit health care organization

• Offers services in 1,300 communities across Canada

• More than 15,000 volunteers and 8,000 staff• Many programs respond to the needs of

disenfranchised, marginalized populations• Community health programs based on the

community development model

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

VON Nurse PractitionerPilot Projects:

• Grey Bruce - Clinic, Outreach• Porcupine - Clinic, Outreach• Brant County- 4 agency- VON BNF• Sudbury - Clinic, School, Outreach• Eastern Counties - Clinic• North Bay - partner - multi-agency

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

A Quality System

is one that can be

measured

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

DELIVERY SYSTEMOperationalization

- business plan - budget - work plans - best practices

PERFORMANCEMEASUREMENT

SYSTEM

QUALITYIMPROVEMENT

SYSTEMP

A DC

LEADERSHIP SYSTEM Mission Vision Strategic Planning Implementation Evaluation

HUMAN PERFORMANCESYSTEM

succession plan

retention HR planning

reward & recognition recruiting

evaluating hiring

training & educatio n orientation

RESEARCH & INNOVATION - customer input/feedback - academic literature - research activities - external best practices - experts in the field

(A)Performance Measures(indicators) in 3 spheres:structure, process,outcomei) Organizational level (BS)ii) Program level (PLM)iii) Team level (CVC)iv) Individual level (PA)

B) Accreditation

C) Benchmarking

D) Branch Self- Assessment & Peer Review

VONACCOUNTABILITYFRAMEWORK

Accfram2 (150800)

Legend:BS = balanced scorecardPLM = program logic modelCVC = clinical valve compassPA = performance appraisal

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Accountability is where objective information is gathered, analyzed and shared so that all partners can be held

accountable for their actions….and…..

decisions are informed by facts: evidence-based decision making

(EBDM)

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Why strive to develop a common VON Evaluation Framework?

* Create common approaches / tools* Ability to roll-up data* Supportive VON NP network* Address common issues/challenges* Learn form each other

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Key Criteria for VON Evaluation Framework

1. Support/augment provincial NP data collection and reporting requirements

2. IT database to support reporting and analysis

3. User-friendly - NPs 4. Applicable across the breadth of

programs 5. Create IT/IM solution to support

program administrative functions6. Provide data to support individual

Branch pilot evaluations

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Evaluation Components

• Client Encounter data collection tool

• Client Satisfaction tool

• Client Perception of Health - SF 12

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Client Encounter Data Collection Tool

Development• Exploration of existing tools- paper based and software (Purkinje)

• Software solution eliminated -cost prohibitive although there were many potential benefits

• Client Data Collection tool (Mary Bear et al) utilized as basis (adaptation) for VON

tool development •VON tool Web-based application with

database currently being developed and tested

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Strengths of the Client Encounter tool

• Database supports pilot-specific reporting• Breakdown of NP service- preventative care, episodic, management of chronic health problems•Supportive/Counseling Interventions: 3 broad areas of intervention

i) health information (cognitive)

ii) affect support

iii) goal setting

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Client Satisfaction Tool

•Adapted from Mary Bear et al Client Satisfaction tool • Measures client perspective on quality dimensions such as accessibility, responsiveness, system competency, involvement in decision making, health information• limited to one-to-one encounters

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

Client’s Perception of HealthSF-12

- given permission to use tool

- ideally to be used at 2 points along the NPs continuum of care with a client

The VON NP Evaluation FrameworkThe VON NP Evaluation Framework

CHALLENGES with Evaluation of VON NP Projects

• Lack of funding for NP project administrative functions- NPs are required to multi-task

• Timing of program evaluation in connection with the pilot project start-up and data-collection methodology

• Lack of clarity for indicators which will ensure continuance of funding - non-pilot status