R4 – Shared Evaluation

OVERVIEW, IMPORTANCE, AND RESULTS TO DATE

Shared Evaluation – Purpose

NOT R4 Evaluating Members – Tool for your benefit and our mutual growth

Determine the Needs/Importance of Program Attributes - Our Military Family

Determine Demographics – define areas of need/improvement

Unified data system: apples vs. oranges

R4 members – Accountable to Each Other

Development of Collateral

Direct Client Feedback

Development of Individualized Treatment Plans – Continuum of Care

Endless Points to Compare and Contrast

Shared Evaluation – Information Collected

Demographics Gender

Service Member –Gender, Duty Status, Branch, Deployment, Separation Date

Supporter – Gender, Relationship to Service Member

Importance of Program Attributes Facilities/Equipment

Staff/Volunteer

Program Factors

Satisfaction with Services Provided Facilities/Equipment

Staff/Volunteer

Program Factors

Evaluation Preview Link

Where did we come up with these questions?

Had our research committee lead advise on the strategy.

Starting by interviewing a focus group of Our Military Family

We asked 2 questions What are the important factors or characteristics that influence your decision to attend veteran-

focused programs?

What is it about those programs that makes you want to attend?

We drilled those responses down into a list of common factors.

Devised questions following standard IPA procedures.

Determined what demographic factors were important for extrapolating specific objectives of the evaluation

Shared Evaluation – Features

IRB – approved/ Client Consent

Anonymity

Customized Questions (5-8) Specific to Member Programs

Smart Phone, and Tablet Compatible

Recognition of Return Users – Short Form

Reports Generated Upon Request – by Program and/or Aggregated

Shared Evaluation - How It Works

Administer at the End of or Immediately After Program Twice Annually for Community Programs

Templated or Program Email with Link

Tiers of success Best Results – Before They Leave

If Not, Within 24 Hours of Participation

Paper If Absolutely Needed

Qualtrics Collection and Generating Reports

Example Report – Project Sanctuary

Open report in 2015 conference folder

Shared Evaluation – Combined Results

Around Individual Data Sets (Service Members, and Supporters)

Representing 14 R4 Members

R4 Combined Results Link: Open and review combined results to date

Shared Evaluation – Benefit Not Hindrance

Service Provided by R4 Alliance

Taking it off you plate

Rich Source of Feedback and Testimonials

Program Evolution – Immediate Feedback

Importance of Shared Measures United Voice

Shared measurement for donors foundations

Shared Evaluation – Member Barriers

Too Many Forms Required by Too Many Organizations

Ruining the Experience

Lack of Staff Support

Already Using Own Evaluation

Discussion:

What Other Barriers Do You Have?

How Do We Overcome These?

Shared Evaluation - Incentives

Discussion:

What incentives would entice you to participate in using the tool?

Ideas: Participant Satisfaction Widget,

Shared Evaluation

Additional Q&A

For Questions or Additional Information About the Shared Evaluation Contact: info@r4alliance.org