Common Triggers for Progress Reports and

Possible Solutions

Bob DeLorme, EdS, RRT-NPS

Conflict of Interest

I have no real or perceived conflict of interest that relates to this presentation. Any use of brand names is not in any way meant to be an endorsement of a specific product, but to merely illustrate a point of emphasis.

www.coarc.com

Objectives

The presenter will:describe CoARC standardized progress reports,list deficiencies in program outcomes that commonly

require a progress report, describe successful strategies for submitting an

acceptable progress report.

CoARC Standard 3.13Outcome assessment thresholds are established by CoARC and are related to expectations for graduate success. The program must, at a minimum, meet the assessment thresholds established by CoARC for the following program outcomes, regardless of location and instructional methodology used:   a) Graduate performance on the national credentialing examination for entry into practice; b) Programmatic retention/attrition; c) Graduate satisfaction with program; d) Employer satisfaction with program; and e) Job placement (Standard 3.13).

CoARC Standard 3.13a) Graduate performance on the national credentialing examination for entry into practice i.e. credentialing success;

b) Programmatic retention/attrition;

c) Graduate satisfaction with program;

d) Employer satisfaction with program; and

e) Job placement

CoARC Outcomes ThresholdsThis Should Not Be A Battle

Outcome ThresholdsCRT Credentialing Success

Based on Participation AND pass rates

NBRC passing score(set by NBRC)

80% of total number of graduates obtaining NBRC CRT credential

(3-year average)

Outcome ThresholdsRetention\Attrition

40% attrition of the total number of students in the enrollment year

(3-year average).

3 yr. avg. can not exceed 40%

Outcome ThresholdsPositive (Job) Placement

70% positive placement(3-year average)

Outcome ThresholdsPositive (Job) Placement

Defined as a graduate within the three-year reporting period who is:

a. Employed utilizing skills as defined by the scope of practice within the respiratory care profession. (i.e. full- or part-time, or per diem), or 

b. enrolled full- or part-time in another degree program, or 

c. serving in the military.

Outcome ThresholdsGraduate Survey – Overall Satisfaction

At least 80% of EMPLOYED graduate surveys rating overall satisfaction 3 or higher on a 5-point Likert

scale.

Also at least 50% of the EMPLOYED graduates have returned surveys (3-year average)

The calculation is as follows:

# surveys with scores greater than 3

# surveys returned - # surveys (questions) omitted

Outcome ThresholdsEmployer Survey – Overall Satisfaction

At least 80% of returned employer surveys rating overall satisfaction 3 or higher on a 5-

point Likert scale.The calculation is as follows:

 

  # surveys with scores greater than 3

# surveys returned - #  surveys (questions) omitted

Outcome ThresholdsEmployer Survey – Participation

50% of the Employers have returned surveys

(3-year average)

The total number of employers of program graduates who return their employer survey.

(3-year average)

Outcome ThresholdsGraduate and Employer Surveys – Overall

Satisfaction* *The Commission on Accreditation for Respiratory Care (CoARC) began collecting overall graduate satisfaction

(OGS) and overall employer satisfaction (OES) survey data in the 2010 reporting year.  Originally, the CoARC stated

that no accreditation actions on overall graduate and employer satisfaction outcomes would take place until the

2013 reporting year.  However, because the calculations of OGS and OES were reported incorrectly the CoARC will not take accreditation action on graduate and employer satisfaction outcomes until the submission of the 2015

annual report of current status (RCS).

Outcome ThresholdsOn-Time Graduation Rate

Beginning with the Annual Report that was due July 1, 2011 all programs were required to report their on-time graduation rate. On time means within 30 day of expected graduation date with their original cohort.

On-Time Graduation Rate is defined as the Total Number of On-time Graduates divided by the Total Number of Graduates. 

Outcome ThresholdsOn-Time Graduation Rate

70%

This is effective with the submission of the 2015 Annual

Report of Current Status

Outcome Thresholds

Below CRT Threshold – What Happens?

At the Nov. 2013 meeting, CoARC looked at the data from 2010, 2011, and 2012 (i.e., 3 yr. Avg.).

The 2013 RCS reported the data from January 1, 2010 through December 31, 2012.

If first-time below threshold of 80% pass rate, a Standardize Progress Report (SPR) is required using the CoARC Standardized Progress Report.

Report due 9/20/14 for 11/14 CoARC meeting.

At the 11/14 meeting, CoARC will now look at data from 2011, 2012, and 2013 plus review the Standardize Progress Report form;

The program will now be using the data from 2011, 2012, and 2013 in its SPR report (July 2014 RCS);

If still below threshold, a Progress Report Update (PRU) will be issued at the Nov 2014 meeting due 9/2015.

Below CRT Threshold – What Happens?

Please make sure you use the correct forms for the Standardize Progress Report and the Progress Report Update. They are different forms requiring different info.

Forms can be found at the CoARC’s web site.

PR Update Due 9/20/2015 for the November 2015 Commission meeting.

Below CRT Threshold – What Happens?

If You Feel Like This You Are Not Alone!

Below CRT Threshold – What Happens?

The Nov 2015 Commission meeting will review the Progress Report Update along with the RCS from July 2015 (3-yr. avg. from 2012, 2013, and 2014).

If still below threshold, during the November 2015 meeting CoARC will vote to place the program on Probation.

A Probation Letter will be sent to the program and college administration.

Outcome ThresholdsIf Program is Placed on Probation:

Program Required Response (Evidence for Compliance with Standard):Submit the Progress Report Update Form for

achieving the CRT Credentialing Success

threshold (see http://www.coarc.com).Submit an updated NBRC Annual School Summary

Report (available at www.nbrc.org).Submit the Programmatic Teach-Out

Outcome ThresholdsIf Program is Placed on Probation:

If in the Nov. 2016 meeting, the program is still not meeting Threshold for CRT Success, CoARC will vote to withhold or withdraw accreditation.

Timeline would actually be four 3-year averages: 2011-2013, 2012-2014, 2013-2015 and 2014-2016. This is 6 consecutive years of data.

A program may remain on probation for no longer than one year without demonstrable and remarkable extenuating circumstances, in which case probation may be extended for an additional year.

Outcome ThresholdsCRT is a 3 yr. cycle, The following are 4 year cycles:

Programmatic retention/attritionGraduate satisfactionEmployer satisfaction Positive Job placementOn-Time Graduation rates

Outcome Thresholds

With the exception of CRT outcomes, all other thresholds use a 4 reporting-year cycle that would require:1 Standardized Progress Report (1st year)2 Progress Report Updates (2 & 3rd years)1 Probation Period requiring documentation (4th year – may be extended an additional year).

Outcome ThresholdsWhat are the Major Problem Areas?

Credentialing Success, i.e. CRT pass rates and participation

Attrition

Positive Job Placement

Outcome ThresholdsWhat are the Potential Causes?

Is it a resource issue?Is there insufficient personnel, facilities, clinical sites, or

equipment to meet programmatic goals?

Is it a curricular issue?Are graduates adequately prepared to enter the profession?

Is it an admissions issue?Are students really prepared to enter the program?

Is it a retention/persistence issue?What factors are impeding the student’s ability to remain in

the program?

Outcome ThresholdsWhat are the Major Problem Areas?

Credentialing Success i.e. CRT pass rates2011 - 20 programs below 80% threshold2012 – 32 programs below threshold2013 – 41 programs below threshold

Is it a participation problem, pass-rate problem, or both???

Outcome ThresholdsWays to Improve CRT Success?

Add computerized instructional packages for review.Computerized practice exams. Multiple proprietary programs.Proprietary review courses SAEs and Secure examsAddition of a comprehensive exam at the end of the program.

.

Outcome Thresholds Attrition

Attrition Threshold: 2011 – 13 programs exceeded 40% Threshold2012 – 8 programs exceeded 40% Threshold2013 – 14 programs exceeded 40% Threshold

Outcome ThresholdsWays to Improve Attrition

Review acceptance criteria.Prerequisites requirement.GPA requirement Interviews or possibly a shadowing experience

Add tutorials – have designated adjunct faculty who can work with studentsComputerized aided instructional packagesUtilize College wide process for student who are having academic troubles.

Outcome ThresholdsJob Placement?

2011 – 21 programs fell below the 70% threshold.2012 – 24 programs fell below the 70% threshold.2013 – 41 programs fell below the 70% threshold.

Outcome ThresholdsHow to Solve Job Placement?Is low placement due to low credentialing success?When are you surveying? Too soon?Are you counting PRN employees or graduates

who go right into another program or degree?Are you offering placement services?Decrease class size.

Outcome Thresholds

QUESTIONS QUESTIONS AND ANSWERSAND ANSWERS