22
Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information Technology Services (ITS)

Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Embed Size (px)

Citation preview

Page 1: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs

Archie GeorgeJane Baillargeon

Jason Mayer*University of Idaho

*now with Information Technology Services (ITS)

Page 2: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Background• Fiscal problems

• External financial reviews

• Institutional accreditation self-study

• New president, interim provost

•University Vision & Resource Task Force

• Recommendations: selective program cuts

Page 3: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

President’s Plan for RenewalPresident’s Plan for Renewal

Page 4: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Plan for Renewal

• Feb. 11 – Strategic Directions speech

• Phase I – Budget Reductions (February)

• Phase II – Prioritization Metrics (March & April)

• Phase III – Reinvestment (Fall 2005)

Page 5: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Phase I – Budget Reductions

• Base budget reduction, reallocation

• Positions eliminated or “zeroed out”

• No program cuts

• Deans & department heads submitted program definitions for Exhibit II

Page 6: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Exhibit 2: Academic Programs DefinedExhibit 2: Academic Programs Defined

Page 7: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Phase II – Prioritization Metrics

Seven Step Process for Transforming the U of Idaho

1. Program Mapping and Assessment

2. Compilation of Data for Prioritization Process

3. Quantification of Prioritization Tool Metrics

4. Relative Ranking of Programs

5. College Program Analysis

6. Faculty Governance Review and Advice

7. Executive Decision and Implementation

Page 8: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product I: Workshops with each college

• Program Name & Descriptions

• Roles of Graduates

•Roles as Global Citizen

• Roles in the Profession

• Global Statement: Program and it’s Purposes

• Key Program Themes

Page 9: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product II: Workshops with each college

• Program Outcome Guide

• Entry Requirements

• Program Knowledge Base

• Skills Learned and Demonstrated

• Key Assessment Tasks

• Intended Outcomes

Page 10: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product III: Human Resources Assigned to the Program

• Input on-line after workshop

Name, Employee Classification,

FTE: Teaching, Advising,

Research/Scholarship, Service (internal & external), Administration

Page 11: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Product IV: Program MapsProduct IV: Program Maps

Page 12: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product V: Course Activity Matrix

• by Subject & Course

• “In” the Program or “Out” ?

• Introductory ?

• Part of Sequence ?

• Integrating Experience ?

• Capstone ?

• Part of a Theme ? (specify)

Page 13: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product VI: Linkages with Other Student Services

• Academic Assistance Program

• Library

• Counseling & Testing Center

• Writing Center

• University Residences

• etc….

Page 14: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool I

Product VII: Future Positioning

• Step 1: Answer three questions:

• How could we increase alignment with other programs?

• Who within & without organization could assist in enhancing program reputation?

• What organizations outside could we partner with to reposition

program?

Page 15: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool II

Program Metrics – Identifying Program Strengths and Weaknesses

Two dimensions: Quality & Economic Value

• Quality

• Publications per faculty FTE ( 50% )

• Composite student quality ( 20% )

• Two electives ( 15% each )

Page 16: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Composite student quality indexComposite student quality index

Page 17: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool II

Program Metrics: Economic Value

• External grant dollars per FTE ( 20% )

• Degrees awarded per program ( 15% )

• Degrees awarded / teaching FTE (20%)

• Human resources costs ( 15% )

• Percent of small classes ( 10% )

• Two electives ( 10% each )

Page 18: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool II

Identifying Opportunities for Program

• Qualitative assessment related to president’s five strategic themes

• Qualitative assessment related to centrality to university mission

Page 19: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Program Mapping and Assessment: Tool II

Rank order programs on two dimensions

Quality

Economic Value

Page 20: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

Undergraduate Programs RankedUndergraduate Programs Ranked

Page 21: Sharing the Pain: Tools & Maps to Measure & Rank Academic Programs Archie George Jane Baillargeon Jason Mayer* University of Idaho *now with Information

ReferencesReferences

Mapping: Stiehl, R. and Lewchuk, L. The Mapping Primer: Tools for

Reconstructing the College Curriculum. The Learning Organization, Corvallis, OR, 2005.

Stiehl, R. and Lewchuk, L. The Outcomes Primer: Reconstructing the College Curriculum, 2nd edition. The Learning Organization, Corvallis, OR, 2002.

Prioritizating: Dickeson, Robert. Prioritizing Academic Programs and

Services. Jossey-Bass, San Francisco, CA, 1999.

Mapping: Stiehl, R. and Lewchuk, L. The Mapping Primer: Tools for

Reconstructing the College Curriculum. The Learning Organization, Corvallis, OR, 2005.

Stiehl, R. and Lewchuk, L. The Outcomes Primer: Reconstructing the College Curriculum, 2nd edition. The Learning Organization, Corvallis, OR, 2002.

Prioritizating: Dickeson, Robert. Prioritizing Academic Programs and

Services. Jossey-Bass, San Francisco, CA, 1999.