1 / 36

Common Triggers for Progress Reports and Possible Solutions Bob DeLorme, EdS, RRT-NPS

Common Triggers for Progress Reports and Possible Solutions Bob DeLorme, EdS, RRT-NPS. Conflict of Interest.

roscoe
Download Presentation

Common Triggers for Progress Reports and Possible Solutions Bob DeLorme, EdS, RRT-NPS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Common Triggers for Progress Reports and Possible Solutions Bob DeLorme, EdS, RRT-NPS

  2. Conflict of Interest I have no real or perceived conflict of interest that relates to this presentation. Any use of brand names is not in any way meant to be an endorsement of a specific product, but to merely illustrate a point of emphasis. www.coarc.com

  3. Objectives • The presenter will: • describe CoARC standardized progress reports, • list deficiencies in program outcomes that commonly require a progress report, • describe successful strategies for submitting an acceptable progress report.

  4. CoARC Standard 3.13 Outcome assessment thresholds are established by CoARC and are related to expectations for graduate success. The program must, at a minimum, meet the assessment thresholds established by CoARC for the following program outcomes, regardless of location and instructional methodology used:   a) Graduate performance on the national credentialing examination for entry into practice; b) Programmatic retention/attrition; c) Graduate satisfaction with program; d) Employer satisfaction with program; and e) Job placement (Standard3.13).

  5. CoARC Standard 3.13 a) Graduate performance on the national credentialing examination for entry into practice i.e. credentialing success; b) Programmatic retention/attrition; c) Graduate satisfaction with program; d) Employer satisfaction with program; and e) Job placement

  6. CoARC Outcomes ThresholdsThis Should Not Be A Battle

  7. Outcome ThresholdsCRT Credentialing Success Based on Participation AND pass rates NBRC passing score(set by NBRC) 80% of total number of graduates obtaining NBRC CRT credential(3-year average)

  8. Outcome ThresholdsRetention\Attrition 40% attrition of the total number of students in the enrollment year(3-year average). 3 yr. avg. can not exceed 40%

  9. Outcome ThresholdsPositive (Job) Placement 70% positive placement(3-year average)

  10. Outcome ThresholdsPositive (Job) Placement Defined as a graduate within the three-year reporting period who is: a. Employed utilizing skills as defined by the scope of practice within the respiratory care profession. (i.e. full- or part-time, or per diem), or  b. enrolled full- or part-time in another degree program, or  c. serving in the military.

  11. Outcome ThresholdsGraduate Survey – Overall Satisfaction At least 80% of EMPLOYED graduate surveys rating overall satisfaction 3 or higher on a 5-point Likert scale. Also at least 50% of the EMPLOYED graduates have returned surveys (3-year average) The calculation is as follows: # surveys with scores greater than 3 # surveys returned - # surveys (questions) omitted

  12. Outcome ThresholdsEmployer Survey – Overall Satisfaction At least 80% of returned employer surveys rating overall satisfaction 3 or higher on a 5-point Likert scale. The calculation is as follows: # surveys with scores greater than 3 # surveys returned - #  surveys (questions) omitted

  13. Outcome ThresholdsEmployer Survey – Participation 50% of the Employers have returned surveys(3-year average) The total number of employers of program graduates who return their employer survey. (3-year average)

  14. Outcome ThresholdsGraduate and Employer Surveys – Overall Satisfaction*  *The Commission on Accreditation for Respiratory Care (CoARC) began collecting overall graduate satisfaction (OGS) and overall employer satisfaction (OES) survey data in the 2010 reporting year.  Originally, the CoARC stated that no accreditation actions on overall graduate and employer satisfaction outcomes would take place until the 2013 reporting year.  However, because the calculations of OGS and OES were reported incorrectly the CoARC will not take accreditation action on graduate and employer satisfaction outcomes until the submission of the 2015 annual report of current status (RCS).

  15. Outcome ThresholdsOn-Time Graduation Rate • Beginning with the Annual Report that was due July 1, 2011 all programs were required to report their on-time graduation rate. On time means within 30 day of expected graduation date with their original cohort. • On-Time Graduation Rate is defined as the Total Number of On-time Graduates divided by the Total Number of Graduates. 

  16. Outcome ThresholdsOn-Time Graduation Rate 70% This is effective with the submission of the 2015 Annual Report of Current Status

  17. Outcome Thresholds

  18. Below CRT Threshold – What Happens? • At the Nov. 2013 meeting, CoARC looked at the data from 2010, 2011, and 2012 (i.e., 3 yr. Avg.). • The 2013 RCS reported the data from January 1, 2010 through December 31, 2012. • If first-time below threshold of 80% pass rate, a Standardize Progress Report (SPR) is required using the CoARC Standardized Progress Report. • Report due 9/20/14 for 11/14 CoARC meeting.

  19. Below CRT Threshold – What Happens? • At the 11/14 meeting, CoARC will now look at data from 2011, 2012, and 2013 plus review the Standardize Progress Report form; • The program will now be using the data from 2011, 2012, and 2013 in its SPR report (July 2014 RCS); • If still below threshold, a Progress Report Update (PRU) will be issued at the Nov 2014 meeting due 9/2015.

  20. Below CRT Threshold – What Happens? • Please make sure you use the correct forms for the Standardize Progress Reportand the Progress Report Update. They are different forms requiring different info. • Forms can be found at the CoARC’s web site. • PR Update Due 9/20/2015 for the November 2015 Commission meeting.

  21. If You Feel Like This You Are Not Alone!

  22. Below CRT Threshold – What Happens? • The Nov 2015 Commission meeting will review the Progress Report Update along with the RCS from July 2015 (3-yr. avg. from 2012, 2013, and 2014). • If still below threshold, during the November 2015 meeting CoARC will vote to place the program on Probation. • A Probation Letter will be sent to the program and college administration.

  23. Outcome ThresholdsIf Program is Placed on Probation: • Program Required Response (Evidence for Compliance with Standard): • Submit the Progress Report Update Form for achieving the CRT Credentialing Success threshold (see http://www.coarc.com). • Submit an updated NBRC Annual School Summary Report (available at www.nbrc.org). • Submit the Programmatic Teach-Out

  24. Outcome ThresholdsIf Program is Placed on Probation: • If in the Nov. 2016 meeting, the program is still not meeting Threshold for CRT Success, CoARC will vote to withhold or withdraw accreditation. • Timeline would actually be four 3-year averages: 2011-2013, 2012-2014, 2013-2015 and 2014-2016. This is 6 consecutive years of data. • A program may remain on probation for no longer than one year without demonstrable and remarkable extenuating circumstances, in which case probation may be extended for an additional year.

  25. Outcome Thresholds • CRT is a 3 yr. cycle, • The following are 4 year cycles: • Programmatic retention/attrition • Graduate satisfaction • Employer satisfaction • Positive Job placement • On-Time Graduation rates

  26. Outcome Thresholds With the exception of CRT outcomes, all other thresholds use a 4 reporting-year cycle that would require: • 1 Standardized Progress Report (1st year) • 2 Progress Report Updates (2 & 3rd years) • 1 Probation Period requiring documentation (4th year – may be extended an additional year).

  27. Outcome ThresholdsWhat are the Major Problem Areas? • Credentialing Success, i.e. CRT pass rates and participation • Attrition • Positive Job Placement

  28. Outcome ThresholdsWhat are the Potential Causes? • Is it a resource issue? • Is there insufficient personnel, facilities, clinical sites, or equipment to meet programmatic goals? • Is it a curricular issue? • Are graduates adequately prepared to enter the profession? • Is it an admissions issue? • Are students really prepared to enter the program? • Is it a retention/persistence issue? • What factors are impeding the student’s ability to remain in the program?

  29. Outcome ThresholdsWhat are the Major Problem Areas? • Credentialing Success i.e. CRT pass rates • 2011 - 20 programs below 80% threshold • 2012 – 32 programs below threshold • 2013 – 41 programs below threshold • Is it a participation problem, pass-rate problem, or both???

  30. Outcome ThresholdsWays to Improve CRT Success? • Add computerized instructional packages for review. • Computerized practice exams. Multiple proprietary programs. • Proprietary review courses • SAEs and Secure exams • Addition of a comprehensive exam at the end of the program. • .

  31. Outcome Thresholds Attrition Attrition Threshold: • 2011 – 13 programs exceeded 40% Threshold • 2012 – 8 programs exceeded 40% Threshold • 2013 – 14 programs exceeded 40% Threshold

  32. Outcome ThresholdsWays to Improve Attrition • Review acceptance criteria. • Prerequisites requirement. • GPA requirement • Interviews or possibly a shadowing experience • Add tutorials – have designated adjunct faculty who can work with students • Computerized aided instructional packages • Utilize College wide process for student who are having academic troubles.

  33. Outcome ThresholdsJob Placement? • 2011 – 21 programs fell below the 70% threshold. • 2012 – 24 programs fell below the 70% threshold. • 2013 – 41 programs fell below the 70% threshold.

  34. Outcome ThresholdsHow to Solve Job Placement? • Is low placement due to low credentialing success? • When are you surveying? Too soon? • Are you counting PRN employees or graduates who go right into another program or degree? • Are you offering placement services? • Decrease class size.

  35. Outcome Thresholds

  36. QUESTIONS AND ANSWERS

More Related