1
By Suri Raut ([email protected]), Andrew S. Hahn ([email protected]), Permon D. Mitchell ([email protected]), Jodi Duke, Ph.D. ([email protected]) and Heidi J. Graff, Ph.D. ([email protected]) With the establishment of many recognized postsecondary programs, it is essential that the evaluation process address the necessary competencies that enable individuals to be successful. With a comparison of the Standards, Quality Indicators and Benchmarks developed by Think College, a comparison was conducted using the following research protocol: Expert panel of Director, Coordinators and SPED Faculty Evidence discussed Rating scale assigned-See Below Group reliability of each entry Data Analysis Results Standard 1 Standard 1 Standard 3 Standard 5 Rating Scale: A No knowledge 0 No evidence 1 One piece of evidence 2 Two pieces of evidence 3 Three or more pieces of evidence STANDARD 2 CAREER DEVELOPMENT: To facilitate career development leading to competitive employment for students with intellectual disabilities, the comprehensive postsecondary education program should: Quality Indicator 2.1 Provide students with the supports and experiences necessary to seek and sustain competitive employment, including: Benchmarks Implementation Scale 3 2 1 0 NOTES 2.1A: The provision of person-centered planning to identify career goals. x All student, section dedicated to employment, requirements first and four and recommended 2 and 3 2.1B: Access to job coaches and developers who receive ongoing training and supervision. x Employment class, internship, on campus and off campus employment, 1-1 support until employer and support staff and student feel comfortable with independence 2.1C: Participation in time-limited internships or work-based training in settings with people without disabilities. x Employment class, internship, on campus and off campus employment, 1-1 support until employer and support staff and student feel comfortable with independence 2.1D: Opportunity to participate in academically focused service learning experiences. x Catalog course work that coordinates with employments; community access for travel training 2.1E: Participation in paid work experiences related to personal choice and career goals, such as paid internships, work-study, service learning or other paid work on or off campus. x Hill, special education department; Sodexo reserved for upper classman 2.1F: Connection with community rehabilitation x Voc rehab pilot; Best Buddies jobs; ARC of NoVA; Didlake STANDARD 6: COORDINATION AND COLLABORATION: To facilitate collaboration and coordination, the comprehensive postsecondary education program should: Quality Indicator 6.1: Establish connections and relationships with key college/university departments, as evidenced by: Benchmarks Implementation Scale 3 2 1 0 NOTES 6.1A: Students with ID effectively using campus resources, such as disability services, financial aid services, course registration, academic advising, health services and career services. x Career services, gym facilities; health services, financial aide office, student account 6.1B: Program staff effectively using college infrastructure such as IT support, maintenance, etc. x AT Lab, ATI, AIM VA 6.1C: Program staff being aware of the governance and administrative structures of the college or university that may impact the program. x SPED division meetings, CEHD meetings, 6.1.D: Program staff participating in faculty/staff governance, or committees as part of their contribution to the college. x All coordinators participation in CEHD open session, Director participation at the Division level meetings; university International Association of Administrative Professionals (IAAP) Quality Indicator 6.2: Have a designated person to coordinate program-specific services of the comprehensive postsecondary education program, including: Benchmarks Implementation Scale 3 2 1 0 NOTES 6.2A: Scheduling and implementing interagency team meetings. x Different employers, HSC, LEAP, Exploration with different divisions; Capitol Hill 6.2B: Conducting person-centered planning and assuring that the results of those meetings are infused into the students' daily activities. x PCP meetings, Academic, residential, employment activities 6.2C: Assuring that data collection and program evaluation activities occur. x SIB-R, IRI, ongoing assessments/probes, writing samples 6.2D: Providing outreach to families. x PCP, Listserves, family weekend, parents survey, exhibition, end of the year events, information sessions 6.2E: Providing training and supervision for educational coaches, job coaches and job developers. x Staff meetings, weekly instructor meetings, training sessions before each semester, employment training STANDARD 7: SUSTAINABILITY: To facilitate sustainability, the com prehensive postsecondary education program should: Q uality Indicator7.1: Utilize diverse sourcesoffunding, including: Benchm arks Im plem entation Scale 3 2 1 0 NOTES 7.1A:M aintaining a relationship to the cam pus financial aid office. X G IBills, 529 college saving plans, Pell grant 7.1B:Ensuring thateligible students and fam ilies apply forfinancial aid X PC P m eetingsdiscussoptions, em ail rem inders, linkson w ebsite 7.1C :Providing inform ation to students on sources offunds fortuition and othercosts,such as N ational Service grants,w ork-study,use of M edicaid w aiverfunds,vocational rehabilitation,etc. X M edicaid,Vocational Rehab, SPED w ork study, C apitol H ill w ork study 7.1D :U sing state funds,ID EA funds,developm ental services agency funds,fam ily funds,private and federal grantfunds to provide core funding forthe program . X Ala H um bra, Porto C harities, H SC , Federal grants; TaftFoundation Q uality Indicator7.2:Have a planning and advisory team w hich: Benchm arks Im plem entation Scale 3 2 1 0 NOTES 7.2A:Includes representatives from the college including adm inistrators (deans,provosts,departm entchair),disability services,faculty,as w ell as disability specific agencies,relevant com m unity agencies,local business leaders,w orkforce developm entproviders,fam ilies,and students. X D r. Behrm ann, Ellen Rodgers, D ean G insburg,M artin Ford 7.2B:Supports collaboration both betw een the college and the program and w ith outside entities. X Special O lym pics, BestBuddies, P.I.K.E. C lub 7.2C :Addresses program policies and practices (costs,access, partnerships)and studentoutcom es (data review )to ensure sustainability. X Alum ni survey, Parentsurvey, Em ploym ent survey 7.2D :C om m unicates regularly. X O ngoing com m unication w ith M ike, M artin, D ean, unit/division m eetings STANDARD 8: ONGOING EVALUATION: To facilitate quality postsecondary education services for students with intellectual disabilities, the comprehensive postsecondary program should: Quality Indicator 8.1: Conduct evaluation on services and outcomes on a regular basis, including: Benchmarks Implementation Scale 3 2 1 0 NOTES 8.1A: Collection of data from key stakeholders, such as students with and without disabilities, parents, faculty, disability services and other college staff. X Student outcome data, SIB-R data, grades, assessments, feedback from professors for audit classes, Special Olympics feedback 8.1B: Collection of student satisfaction data. X PCP meetings, Alumni survey, unit meetings for residential- purposed course evaluation 8.1C: Collection of student exit data. X exit PCP meeting, Alumni survey, SIS, SIB-R; QRI 8.1D: Collection of student follow-up data. X Alumni survey; invitation to selected events; participation in special Olympics 8.1E: Review of all data compiled by the advisory team and other stakeholders. X Division review; Associate Dean input with course content; Signatures for Exploration; Senior Associate Dean for Employment; Director review all data; Executive summary report every two years; through capital campaign review of all data 8.1F: Implementation of program changes as a result of data review. X SIB-R review; application interview tool revised; parent readiness scale added; review of academic performance; review employment; concentration have to revised programming and support for exploration; doctoral programmatic review STANDARD 3: CAM PUS M EM BERSHIP: To facilitate cam pusm em bership forstudentsw ith intellectual disabilities, the com prehensive postsecondary education program should: Q uality Indicators 3.1:Provide access to and support for participation in existing social organizations,facilities and technology,including: Benchm arks Im plem entation Scale 3 2 1 0 NO TES 3.1A :Cam pusprogram s, such asclubsand organizations, com m unity service, religiouslife,studentgovernm ent, G reek system , co-curricularexperiences, service learning, study abroad, studentsportsand entertainm entevents, recreationalfacilitiesand program s, etc. x P articipation in studentgovernm ent, book club,team m anagem ent, intram ural sports 3.1B:Residence life facilitiesand activities, including, w hen desired, the offcam pushousing office. x O ffcam pus and on cam pus housing, access to all university program m ing, w eekend participation in student outings 3.1C :Technology forsocial com m unication,including,em ail, texting,cell phone,Facebook,Tw itter,Skype. x Accessto universitycom puters, university e-m ail accounts; encouraged use oftexting otherstudentand staff 3.1D :Social activities facilitated by students w ithoutdisabilities w ho serve as natural supports. x PIK E, Tae K w on D o, Lego Club, Best B uddies, Book Club, SM ART STANDARD 4: SELF DETERMINATION: To facilitate the development of self-determination in students with intellectual disabilities, the comprehensive postsecondary education program should: Quality Indicator 4.1: Ensure student involvement in and control of the establishment of personal goals that: Benchmarks Implementation Scale 3 2 1 0 NOTES 4.1A: Reflect student interests and desires as indicated by person centered planning. x Student lead PCP; student decided exploration; student decided employment work site; prioritize based upon schedule 4.1B: Are reviewed regularly and modified as needed to reflect changes in student interests and preferences. x Individual student schedule, PCP recommended years-required twice; assessment each semester 4.1C: Address accommodation and technology needs. x ATI Office; AT Lab, Smart Board; programs, Read and Write gold 10 4.1D: Lead to outcomes desired by the student. x Program completer, more independent living skills, meaningful employment; increasingly socially aware; lifelong patriot 4.1E: Reflect family input when desired by the student. x SPED managers, PCP; e-mails and calls to coordinators and director; intake forms; application Quality Indicator 4.2: Ensure the development and promotion of self-determination skills for students with intellectual disabilities as evidenced by students: Benchmarks Implementation Scale 3 2 1 0 NOTES 4.2A: Monitoring their own progress toward their personal goals. x 1 st year class University orientation, 4 th year class personal growth and future goals, weekly employment self-evaluation checklist, PCP meeting 4.2B: Directing their choice of courses, activities, and employment experiences. x PCP meeting; employment; exploration; clubs; groups; university activities 4.2C: Involvement in course registration, accommodation requests, and payment of tuition. x PCP meeting; view their transcript; discuss issue with coordinator and SPED managers 4.2D: Being involved in all areas of employment, such as creating a resume, setting up job interviews, follow up phone calls, negotiating job changes, etc. x Resume, letter of resignation; interest survey, visit work sites, notification of time off; interview practice; career services for 4 th year student 4.2E: Interacting directly with faculty and employers including the articulation of needed accommodations. x Work under faculty members; teach being a self-advocate; modeled by support staff; encouraged by coordinator 4.2F: Managing personal schedules that include courses, employment, and social activities. x PCP meeting; individual schedule; student determines what clubs they want to participate in; student lead by choices Quality Indicator 4.3: Have a stated process for family involvement that reflects: Benchmarks Implementation Scale 3 2 1 0 NOTES 4.3A: Clearly defined roles and responsibilities for parents and students. x Handbook, scope and sequence; PCP meeting, policy tab, Parent readiness to provide extra support for flagged families 4.3B: A process for the provision of information to parents on resources, effective advocacy and transition planning. x Website, readiness scale; listserv; handbook, police tab; link for community partners; transition fairs 4.3C: Student control over how parents are involved in their experience. x PCP meeting; Coordinator student support; Director student support; SPED managers and overnight support staff: readiness scale 4.3D: Adherence to the guidelines set forth by the Family Educational Rights and Privacy Act (FERPA) x Confidentiality rules related files, electronic documentation: group e-mails; and staff training; parent right to review transcript; student accounts give permission Standard 2 Standard 2 Standard 4

By Suri Raut ([email protected]), Andrew S. Hahn ([email protected]), Permon D. Mitchell ([email protected]), Jodi Duke, Ph.D. ([email protected]) and Heidi J. Graff,

Embed Size (px)

Citation preview

Page 1: By Suri Raut (sraut@gmu.edu), Andrew S. Hahn (ahahn@gmu.edu), Permon D. Mitchell (pmitche7@gmu.edu), Jodi Duke, Ph.D. (jduke4@gmu.edu) and Heidi J. Graff,

By Suri Raut ([email protected]), Andrew S. Hahn ([email protected]), Permon D. Mitchell ([email protected]), Jodi Duke, Ph.D. ([email protected]) and Heidi J. Graff, Ph.D. ([email protected])

With the establishment of many recognized postsecondary programs, it is essential that the evaluation process address the necessary competencies that enable individuals to be successful.With a comparison of the Standards, Quality Indicators and Benchmarks developed by Think College, a comparison was conducted using the following research protocol:

Expert panel of Director, Coordinators and SPED Faculty

Evidence discussed Rating scale assigned-See BelowGroup reliability of each entryData AnalysisResults

Standard 1 Standard 1

Standard 3

Standard 5

 

 

Rating Scale:A No knowledge0 No evidence1 One piece of evidence2 Two pieces of evidence3 Three or more pieces of evidence

STANDARD 2 CAREER DEVELOPMENT: To facilitate career development leading to competitive employment for students with intellectual disabilities, the comprehensive postsecondary education program should:

Quality Indicator 2.1 Provide students with the supports and experiences necessary to seek and sustain competitive employment, including: 

BenchmarksImplementation

Scale

3 2 1 0 NOTES

2.1A: The provision of person-centered planning to identify career goals.

x       All student, section dedicated to employment, requirements first and four and recommended 2 and 3

2.1B: Access to job coaches and developers who receive ongoing training and supervision.

x       Employment class, internship, on campus and off campus employment, 1-1 support until employer and support staff and student feel comfortable with independence

2.1C: Participation in time-limited internships or work-based training in settings with people without disabilities.

x       Employment class, internship, on campus and off campus employment, 1-1 support until employer and support staff and student feel comfortable with independence

2.1D: Opportunity to participate in academically focused service learning experiences.

  x     Catalog course work that coordinates with employments; community access for travel training

2.1E: Participation in paid work experiences related to personal choice and career goals, such as paid internships, work-study, service learning or other paid work on or off campus.

x       Hill, special education department; Sodexo reserved for upper classman

2.1F: Connection with community rehabilitation and other adult service providers to sustain employment.

x       Voc rehab pilot; Best Buddies jobs; ARC of NoVA; Didlake provider

2.1G: The collection of objective evaluation data on studentemployment.

x       Evaluations by employer; task list; work sample; rating of support for the task list; work journals

STANDARD 6: COORDINATION AND COLLABORATION: To facilitate collaboration and coordination,the comprehensive postsecondary education program should:Quality Indicator 6.1: Establish connections and relationships with key college/university departments, asevidenced by:

Benchmarks Implementation Scale3 2 1 0 NOTES

6.1A: Students with ID effectively using campus resources, such asdisability services, financial aid services, course registration, academicadvising, health services and career services.

x       Career services, gym facilities; health services, financial aide office, student account

6.1B: Program staff effectively using college infrastructure such as ITsupport, maintenance, etc.

x       AT Lab, ATI, AIM VA

6.1C: Program staff being aware of the governance and administrativestructures of the college or university that may impact the program.

x       SPED division meetings, CEHD meetings,

6.1.D: Program staff participating in faculty/staff governance, orcommittees as part of their contribution to the college.

  x     All coordinators participation in CEHD open session, Director participation at the Division level meetings; university International Association of Administrative Professionals (IAAP)

 Quality Indicator 6.2: Have a designated person to coordinate program-specific services of thecomprehensive postsecondary education program, including:

Benchmarks Implementation Scale3 2 1 0 NOTES

6.2A: Scheduling and implementing interagency team meetings. x       Different employers, HSC, LEAP, Exploration with different divisions; Capitol Hill6.2B: Conducting person-centered planning and assuring that the resultsof those meetings are infused into the students' daily activities.

x       PCP meetings, Academic, residential, employment activities

6.2C: Assuring that data collection and program evaluation activitiesoccur.

x       SIB-R, IRI, ongoing assessments/probes, writing samples

6.2D: Providing outreach to families. x       PCP, Listserves, family weekend, parents survey, exhibition, end of the year events, information sessions

6.2E: Providing training and supervision for educational coaches, jobcoaches and job developers.

x       Staff meetings, weekly instructor meetings, training sessions before each semester, employment training

STANDARD 7: SUSTAINABILITY: To facilitate sustainability, the comprehensive postsecondary education program should: Quality Indicator 7.1: Utilize diverse sources of funding, including:

Benchmarks

Implementation Scale

3 2 1 0 NOTES 7.1A: Maintaining a relationship to the campus financial aid office. X GI Bills, 529 college saving plans, Pell grant

7.1B: Ensuring that eligible students and families apply for financial aid

X PCP meetings discuss options, email reminders, links on website

7.1C: Providing information to students on sources of funds for tuition and other costs, such as National Service grants, work-study, use of Medicaid waiver funds, vocational rehabilitation, etc.

X Medicaid, Vocational Rehab, SPED work study, Capitol Hill work study

7.1D: Using state funds, IDEA funds, developmental services agency funds, family funds, private and federal grant funds to provide core funding for the program.

X Ala Humbra, Porto Charities, HSC, Federal grants; Taft Foundation

Quality Indicator 7.2: Have a planning and advisory team which:

Benchmarks Implementation Scale 3 2 1 0 NOTES

7.2A: Includes representatives from the college including administrators (deans, provosts, department chair), disability services, faculty, as well as disability specific agencies, relevant community agencies, local business leaders, workforce development providers, families, and students.

X Dr. Behrmann, Ellen Rodgers, Dean Ginsburg, Martin Ford

7.2B: Supports collaboration both between the college and the program and with outside entities.

X Special Olympics, Best Buddies, P.I.K.E. Club

7.2C: Addresses program policies and practices (costs, access, partnerships) and student outcomes (data review) to ensure sustainability.

X Alumni survey, Parent survey, Employment survey

7.2D: Communicates regularly. X Ongoing communication with Mike, Martin, Dean, unit/division meetings

STANDARD 8: ONGOING EVALUATION: To facilitate quality postsecondary education services for students with intellectual disabilities, the comprehensive postsecondary program should:  Quality Indicator 8.1: Conduct evaluation on services and outcomes on a regular basis, including:

 Benchmarks

ImplementationScale

3 2 1 0 NOTES

8.1A: Collection of data from key stakeholders, such as students with and without disabilities, parents, faculty, disability services and other college staff.  

X       Student outcome data, SIB-R data, grades, assessments, feedback from professors for audit classes, Special Olympics feedback

8.1B: Collection of student satisfaction data. X       PCP meetings, Alumni survey, unit meetings for residential- purposed course evaluation

8.1C: Collection of student exit data. X       exit PCP meeting, Alumni survey, SIS, SIB-R; QRI

8.1D: Collection of student follow-up data.  

  X     Alumni survey; invitation to selected events; participation in special Olympics

8.1E: Review of all data compiled by the advisory team and other stakeholders.  

  X     Division review; Associate Dean input with course content; Signatures for Exploration; Senior Associate Dean for Employment; Director review all data; Executive summary report every two years; through capital campaign review of all data

8.1F: Implementation of program changes as a result of data review.  

X       SIB-R review; application interview tool revised; parent readiness scale added; review of academic performance; review employment; concentration have to revised programming and support for exploration; doctoral programmatic review

STANDARD 3: CAMPUS MEMBERSHIP: To facilitate campus membership for students with intellectual disabilities, the comprehensive postsecondary education program should: Quality Indicators 3.1: Provide access to and support for participation in existing social organizations, facilities and technology, including:

Benchmarks

Implementation Scale

3 2 1 0 NOTES 3.1A: Campus programs, such as clubs and organizations, community service, religious life, student government, Greek system, co-curricular experiences, service learning, study abroad, student sports and entertainment events, recreational facilities and programs, etc.

x Participation in student government, book club, team management, intramural sports

3.1B: Residence life facilities and activities, including, when desired, the off campus housing office.

x Off campus and on campus housing, access to all university programming, weekend participation in student outings

3.1C: Technology for social communication, including, email, texting, cell phone, Facebook, Twitter, Skype.

x Access to university computers, university e-mail accounts; encouraged use of texting other student and staff

3.1D: Social activities facilitated by students without disabilities who serve as natural supports.

x PIKE, Tae Kwon Do, Lego Club, Best Buddies, Book Club, SMART

STANDARD 4: SELF DETERMINATION: To facilitate the development of self-determination in students with intellectual disabilities, the comprehensive postsecondary education program should: Quality Indicator 4.1: Ensure student involvement in and control of the establishment of personal goals that:

 Benchmarks

ImplementationScale

3 2 1 0 NOTES

4.1A: Reflect student interests and desires as indicated by person centered planning.

x       Student lead PCP; student decided exploration; student decided employment work site; prioritize based upon schedule

4.1B: Are reviewed regularly and modified as needed to reflect changes in student interests and preferences.

x       Individual student schedule, PCP recommended years-required twice; assessment each semester

4.1C: Address accommodation and technology needs. x       ATI Office; AT Lab, Smart Board; programs, Read and Write gold 10

4.1D: Lead to outcomes desired by the student. x       Program completer, more independent living skills, meaningful employment; increasingly socially aware; lifelong patriot

4.1E: Reflect family input when desired by the student. x       SPED managers, PCP; e-mails and calls to coordinators and director; intake forms; application

Quality Indicator 4.2: Ensure the development and promotion of self-determination skills for students with intellectual disabilities as evidenced by students:  

Benchmarks Implementation Scale3 2 1 0 NOTES

4.2A: Monitoring their own progress toward their personal goals. x       1st year class University orientation, 4th year class personal growth and future goals, weekly employment self-evaluation checklist, PCP meeting

4.2B: Directing their choice of courses, activities, and employment experiences.

x       PCP meeting; employment; exploration; clubs; groups; university activities

4.2C: Involvement in course registration, accommodation requests, and payment of tuition.

  x     PCP meeting; view their transcript; discuss issue with coordinator and SPED managers

4.2D: Being involved in all areas of employment, such as creating a resume, setting up job interviews, follow up phone calls, negotiating job changes, etc.

x       Resume, letter of resignation; interest survey, visit work sites, notification of time off; interview practice; career services for 4th year student

4.2E: Interacting directly with faculty and employers including the articulation of needed accommodations.

x       Work under faculty members; teach being a self-advocate; modeled by support staff; encouraged by coordinator

4.2F: Managing personal schedules that include courses, employment, and social activities.

x       PCP meeting; individual schedule; student determines what clubs they want to participate in; student lead by choices

Quality Indicator 4.3: Have a stated process for family involvement that reflects:  

Benchmarks Implementation Scale3 2 1 0 NOTES

4.3A: Clearly defined roles and responsibilities for parents and students.

x       Handbook, scope and sequence; PCP meeting, policy tab, Parent readiness to provide extra support for flagged families

4.3B: A process for the provision of information to parents on resources, effective advocacy and transition planning.

x       Website, readiness scale; listserv; handbook, police tab; link for community partners; transition fairs

4.3C: Student control over how parents are involved in their experience.

x       PCP meeting; Coordinator student support; Director student support; SPED managers and overnight support staff: readiness scale

4.3D: Adherence to the guidelines set forth by the Family Educational Rights and Privacy Act (FERPA)

x       Confidentiality rules related files, electronic documentation: group e-mails; and staff training; parent right to review transcript; student accounts give permission

Standard 2 Standard 2

Standard 4