Upload
vuongcong
View
216
Download
0
Embed Size (px)
Citation preview
College of Nursing
EVALUATION PLAN FOR UNDERGRADUATE BSN, MASTERS IN NURSING SCIENCE AND DOCTORAL PROGRAMS
Elements – CIPP Model (Stufflebeam’s Educational Decision Model, 1983)
CONTEXT
INPUT
PROCESS
PRODUCT
Mission and goals Resources Implementation Learner Outcomes
Setting Support systems Course Evaluation Satisfaction
Internal and External Forces
Learners Teaching-Learning Transaction Discipline-Specific Aggregate Data (BSN only)
Philosophy Program Plan Assessing Student Learning
Community Curriculum organization
Support Courses and Liberal Education Foundation
Context Evaluation – Elements of context evaluation are designed to assess the operational context of the school of nursing. The intended ends of the organization are evaluated. The purpose of this phase is to define the context where change is needed, identify unmet needs, identify problems underlying those needs, and identify opportunities for change. Needs, problems, and opportunities are evaluated on an ongoing basis. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Input Evaluation – This element addresses the intended means and primarily focuses on the resources available to meet the intended ends. Input elements include evaluation of resources, support systems, learners, program plan, curriculum organization, and support courses related to the curriculum.
Process Evaluation – Involves an evaluation of the delivery. It monitors actual means to assess progress and to intervene if the evidence suggests that there is a lack of congruence between intended and actual means. Process evaluation includes the elements of implementation, course evaluation, teaching/learning transaction, and assessing student learning. Product Evaluation – provides the information that informs decisions about the congruence of intended ends and actual ends. The purpose is to determine the fit of product outcome and program goals. This determines the program effectiveness in attaining the program objectives. Elements that are evaluated are learner outcomes, satisfaction (which includes students, alumni, and employers), and discipline-specific aggregate data.
2
College of Nursing Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
Context Evaluation – Elements of context evaluation are designed to assess the operational context of the school of nursing. The intended ends of the organization are evaluated. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Elements of context evaluation Mission and goals Setting Internal and External Forces Philosophy Community
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE
STANDARDS
DATA SOURCES
INDICATORS
MEASURES
PERSONS RESPONSIBLE
REPORT GOES TO
-Annual review to determine whether activities are on target and to identify problems. -Extensive collegiate review every five years.
Mission, Goals, and Philosophy Congruence of College of Nursing and University of Iowa goals and strategic plans
-Mission statements -Philosophy -Strategic plan with indicators -Academic program goals
Mission, goals, & philosophy for the school reflect the collective wisdom of administration and faculty about the obligation and capacity of the college to meet advanced knowledge needs of society for health. -Futuristic trends of the discipline are reflected.
-Structure of the organization to determine its fit to mission, goals, and philosophy. -Roles and responsibilities attached to each position in the structure. -Role clarification -lines of authority and lines of collaboration.
-Dean -Associate Dean for Academic Affairs -Area Chairs -Directors -Academic Council
-CCNE -Faculty -IBN
-Annual review to determine whether activities are on target and to identify problems. -Extensive review every five years. -Academic program goals updated yearly.
Setting in which learning will occur supports the mission, and, goals and strategic plans.
-Mission statements -Strategic plan with indicators -Academic program goals -Clinic settings
Academic and clinical settings
Collect data via survey or focus group.
-Dean -Associate Dean for Academic Affairs -Area Chairs -Faculty Council -Directors of BSN & RN-BSN, MSN, and PhD Programs
-CCNE -Faculty -Updated Program and Reports with goals sent to State Board of Nursing
3
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
Context Evaluation – Elements of context evaluation are designed to assess the operational context of the school of nursing. The intended ends of the organization are evaluated. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Elements of context evaluation Mission and goals Setting Internal and External Forces Philosophy Community
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every five years One year after graduation
Product of curriculum (graduates) currently in demand
Review of health care setting and employment opportunities using surveys and focus groups
Employment of graduates
Self-report of graduates Self-report of employers Survey of graduates Literature review Comprehensive review of health care settings
-Dean -Associate Dean for Academic Affairs -Area Chairs -Faculty
-CCNE -Faculty -IBN -Board of Regents -Provost’s Office
4
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
Context Evaluation – Elements of context evaluation are designed to assess the operational context of the College of nursing. The intended ends of the organization are evaluated. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Elements of context evaluation Mission and goals Setting Internal and External Forces Philosophy Community
CONTEXT & PRODUCT
PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every ten years with interim reports as needed State Board report every six years and interim reports as needed
Internal and External Forces - Forces which influence or govern the curriculum - Accreditation standards
-Media coverage -Peer group rankings -Alumni feedback -Feedback from IBN and AACN
Schools bylaws Congruence of schools bylaws with the constitution and bylaws of the larger institution and the structures included to facilitate faculty governance in relation to academic authority Standing committees –address major issues related to faculty affairs, student affairs, curriculum, budget, and major thrusts of the mission Extent to which stakeholders are included in the committee structures delineated in the bylaws—student representation, voting privileges Minutes of standing committees – reflect membership agenda items, salient discussions, decisions made and actions taken. Representation – intended (who is supposed to come, vs actual participation) Education commissions and governmental regulations, accrediting bodies. State board. National accreditation Specialty accreditation from relevant organization and regulating bodies
-Extent to which the curriculum provides content related to professional nursing organization guidelines/standards -Ratings in US News and World Report -Comparison to essentials of Baccalaureate Education of Professional Nursing Practice by AACN -Number of media reports -Other peer group rankings -Forum to evaluate the congruence with bylaws
-Dean -Associate Dean for Academic Affairs -Area Chairs -Directors of BSN & RN-BSN, MSN, and PhD Programs -Faculty -Academic Council -Marketing Director ?
- CCNE -Board of Regents - Iowa State Board of Nursing
5
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
Context Evaluation – Elements of context evaluation are designed to assess the operational context of the College of nursing. The intended ends of the organization are evaluated. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Elements of context evaluation Mission and goals Setting Internal and External Forces Philosophy Community
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every five years Yearly
Philosophy - Mission and philosophy congruent internally (College of Nursing) and externally (The University of Iowa)
Mission statements (CON and UI) Philosophy (CON and UI) Strategic Plan ?
Congruence between UI and CON Mission and Philosophy Strategic Plan ?
Appropriate Organizational Structure Evaluation of documents to establish congruence
-Dean -Associate Dean for Academic Affairs -Area Chairs -Faculty -Academic Council -Directors
-CCNE -Faculty -Provost’s Office and Board of Regents
6
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs Context Evaluation – Elements of context evaluation are designed to assess the operational context of the school of nursing. The intended ends of the organization are evaluated. The structure of the organization is reviewed to determine whether it is appropriate to the mission and goals, environment, internal and external forces, philosophy, and community. Elements of context evaluation Mission and goals Setting Internal and External Forces Philosophy Community
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every five years
Community Engagement of alumni and donors in University advancement
Faculty and student report Alumni and donor report
-Externally funded centers, major projects, certificate programs or publications involving faculty from different departments -Programs that provide service to the international, national, state and local constituencies -Research that provides knowledge to the international, national, state and local constituencies -New scholarships, donations
-Number of externally funded centers, externally funded research grants, major projects, certificate programs or publications involving faculty from different departments -Number of programs that provide service to the international, national, state and local constituencies -Number of new scholarships, donations -Data from faculty reported at administration review
-Dean -Associate Dean for Academic Affairs -Director of External Relations -Director of Student Services -Area Chairs -Marketing Director ?
Fiscal report on external funding -Provost’s Office -Board of Regents -Faculty
Continuing -Help meet the graduate nursing education needs for State of Iowa: -Hospitals -Agencies -Community and Technical Colleges -Attract BSN nurses interested in pursuing graduate education -Help meet the need of Iowa constituents for ARNPS -Develop recognition as a leader in providing graduate educated nurses for rural settings - Develop recognition as a leader in providing research training and knowledge for nurses
-Employer surveys -Graduate surveys -Legislative initiatives -Graduates employed in HPSA or MUSA locales in US -Peers from CIC Universities
-Availability of Programs -Legislative/ State directives -Number of applicants -Employer need/demand -Inclusion of Iowa emphasis and rural practice issues -Number of graduates working in areas designated as HPSA or MUSA
-State Funding -Employer satisfaction -Graduate satisfaction New funding initiatives from Governments/ employers/ agencies designed to support their own needs
-Dean -Graduate Faculty -Course Directors ? -Program Directors -Individuals involved with student recruitment and publicity -Area Chairs -Marketing -Academic Affairs
-State & Federal Government -Public -Citizens of Iowa Marketing Issues: The Public outside of Iowa already thinks ―rural‖ when they think of Iowa. They also associate ―good, country and/or pastoral‖ It is our strength and we need to build on it to compete with other schools. Marketing efforts should make the following links ―University of Iowa CON: -meeting the nursing needs of rural America‖ or -―meeting the educational needs for rural nursing ― or -―serving the citizens in the heartland‖
7
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs Input Evaluation – Primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION Resources Support systems Learners Program Plan Curriculum organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every Semester
Resources Faculty Resources used efficiently and effectively
-Demographic profile of faculty and faculty expertise
-Faculty profile with number and type of adjunct faculty, clinical preceptors, and clinical sites -faculty/staff elected to American Academy of Nursing -faculty receiving regional, national, international awards -faculty elected or appointed to major professional and service organizations -faculty/staff participation in mandatory annual performance assessments -faculty available with specific expertise -Mix of faculty needed to meet the mission and goals. The nature of programs delivered by the school and the faculty mix expectations of the parent institution and accrediting bodies -Analyze the faculty profile against the goals -Goals related to scholarship and service -Faculty credentials are one criterion of assessment. -The source of the credentials -Representation of a wide variety of educational institutions in the faculty profile differences -Faculty education and experience relevant to their areas of assignment -Mix of full-time and part time faculty to help meet broad goals of teaching scholarship and service.
-Salary structure -Profile of clinical preceptors, Preceptor affiliations -number of faculty/staff elected to American Academy of Nursing -number of faculty receiving regional, national, international awards -number of faculty elected or appointed to major professional and service organizations -number of faculty/staff participation in mandatory annual performance assessments -number of faculty available with specific expertise
- Dean -Associate Dean for Academic Affairs -Area Chairs -Faculty
-Data Base Management - CCNE Self-Study NOT EVERY SEMESTER -Provost Office yearly -Board of Regents yearly
Every semester
Library with adequate holdings
Extent of nursing-related library holdings
-Characteristics of Library holdings -Amount and variety of Library holdings
-Associate Dean for Academic Affairs -Area Chairs -Faculty
- CCNE (NOT EVERY SEMESTER) -IBN
8
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every semester
Physical Space adequate for teaching
Classrooms, offices, research, lounge, meeting space.
-Classroom characteristics available to faculty
-Number and variety of classrooms
-Associate Dean for Academic Affairs -Area Chairs -Faculty
- CCNE
Internal fiscal resources to meet teaching needs
Overall CON budget
-Funds and their allocation -Amount of money received -Travel and related expenses support-Budget for curriculum development, maintenance, evaluation, and revision expenses-Office supply budget for faculty and students
-Dean -Director of Operations and Finance
-Faculty What about staff ?
External fiscal resources to support the College mission
Amount of external funding received by faculty and staff
-Funds from NIH, private foundations -Amount of money received -Fiscal resources – percentage related to curriculum and instruction, teaching-related grant amounts
-Dean -Director of Operations and Finance -Associate Dean for Research
-Faculty -Provost -Board of Regents
Clinical facilities to support the College mission
Profile of clinical units
-Clinical facilities data to include: -Clinical facilities -Clinical site, Availability -Profile of clinical units -Population
-Number and variety of clinical sites
-Director of Academic Outreach -Associate Dean for Academic Affairs -Directors of BSN & RN-BSN, MSN, and PhD Programs -Faculty
-Faculty
Haven’t inserted the Board of Visitors anywhere. Might need to insert this group also.
9
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
Input Evaluation – Primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION
Resources Support systems Learners Program Plan Curriculum organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Yearly
Support systems Support staff to support the College mission
-Demographic profile of faculty and faculty expertise – Diversity (gender and ethnic) statistics and trends (faculty, students, staff)
Support systems needed -continuity -innovation Diversity program: Diversity director or officer Support staff Quality of faculty and staff
Faculty evaluation Administrative evaluation Staff evaluation Evaluation plan for technology
-Dean -Associate Dean for Academic Affairs -Area Chairs -Faculty -Director of Student Services -OICT Director
-Undergraduate Assembly -CCNE -Graduate Assembly -Faculty Organization
Yearly Student services to support the College mission
Student services data -Diversity program -Remediation programs -Tutors -Enrollment support, -Services to support second degree, part-time, commuter students, distance education -Retention activities -Recruitment activities -Advanced placement options and programs
-# of diversity programs -# of remediation programs -# of tutors -# of enrollment support, -# of services to support second degree, part-time, commuter students, distance education -# of retention activities -# of recruitment activities -# of advanced placement options and programs
-Associate Dean for Academic Affairs -Area chairs -Director of Student Services -Directors of BSN & RN-BSN, MSM, and PhD Programs
-Undergrad Assembly -CCNE Self-Study
-Graduate Assembly -Faculty Organization
Yearly Information and Instructional Technology to support the College mission
Student services data -Specialized laboratory or simulation equipment -Teaching related supplies, software, and instructional design -Updated technological infrastructures for educational and support programs -Staff available with expertise to help with hardware and software
-# of specialized laboratory or simulation equipment -# of teaching related supplies, software, and instructional design -# of updated technological infrastructures for educational and support programs -# of staff available with expertise to help with hardware and software
-OICT Director -Technology Committee (faculty, staff, student representatives) -Academic Council
-Undergrad Assembly -Academic Council -CCNE -Graduate Assembly -Faculty Organization
Yearly Faculty support to support the College mission
Student services data -Release time for course development -Time and FTE for secretarial, clerical, and student services support per student and FTE faculty
-amount of release time for course development -amount of time and FTE for secretarial, clerical, and student services support per student and FTE faculty
-Dean, -Associate Dean for Academic Affairs -Area chairs -Faculty
-Undergrad Assembly - CCNE -Graduate Assembly -Faculty Organization
Student services data to include Student services : -Enrollment support, advising, scheduling, parking, library support , tutors
10
Evaluation Plan for Undergraduate BSN, Masters in Nursing Science and Doctoral Programs
INPUT EVALUATION – Addresses the intended means and primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION Resources Support systems Learners Program Plan Curriculum organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Each cohort of learners
Learners High quality learners are admitted, progress through the program in a timely fashion, and graduate successfully
- Admission profile - Demographic data - Commitments beyond school - Plans of study
Demographic data: BSN and RN/BSN, MSN, and PhD -Number of students in the program -% Part-time and full- time enrollments -Graduation rates -Acceptance rates -Racial and cultural characteristics -Gender Admission profile: ACT/SAT/GRE -High school rank -GPA -Motivation of students – essay -TOFFEL minimum -Prior completion of programs started (second degree) -Prior learning (courses and programs) by students -Prior grades -Supporting courses -Previous nursing education -Licensure -Practice history
Admission Data
-Associate Dean for Academic Affairs -Directors of BSN & RN-BSN, MSN, and PhD Programs -Director of Student Services -Program Associates
-Faculty -Academic Council -CCNE -Undergraduate Assembly -Graduate Assembly -Faculty Organization
11
GRADUATE CURRICULUM EVALUATION PLAN SPECIFIC TO THE DOCTORAL PROGRAM
Input Evaluation – Primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION Resources Support Systems Learners Program Plan
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Every two years for curricular evaluation. Yearly
Resources Faculty Diverse intellectual perspectives are valued; represented by the faculty
Students, Faculty, Alumni
Respect for academic freedom is apparent. Faculty represent diverse intellectual perspectives
DPE, Faculty item #2 DPE, Faculty item #1
Director, PhD Program Area Program Associates maintain administrative database.
Presented to faculty, administration, & students.
Yearly Faculty conceptualize & implement research that attract & engage students
Students, Faculty, Alumni, Applicants
Faculty are regionally, nationally, and internationally known for their research and scholarly work.
DPE, Facullty item #4 University Indicator: National Ranking
Faculty include in annual Administrative Review materials and for Administrative Data Base
Area Chairs, Office of Research
Faculty are recognized leaders in nursing.
Number of Faculty in AAN (Annual Review) Number of faculty elected or appointed to major professional and service organizations- (Annual Review)
Area Chairs, Office of Research Area Chairs, Office of Research University Indicator: Report to Office of the Provost
Faculty encourage graduate students to participate in their research. Faculty work with students on student research
Number of Manuscripts, presentations developed by faculty and students. Administrative data base Graduate student data base Student report. During Annual Review. Faculty report in Administrative review documents and their vitas.
Faculty and students Area Chairs, Office of Research
Faculty encourage students to present or co-present papers at research conferences
Number of Faculty and student presentations Administrative data base Graduate student data base
Faculty and students Director of PhD Program
12
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Yearly Faculty conceptualize & implement research that attract & engage students
Students, Faculty, Alumni, Applicants
Faculty are funded or are seeking funding and have appointments on research review committees and/or editorial review boards.
Number of externally funded awards per capita. Number of Faculty on research review committees and editorial review boards Administrative Review Research Office
Research Office Director of PhD Program Dean
Twice A Year
Faculty create environment in which mentoring, socialization of students, & a community of scholars is evident
Students, Faculty, Alumni, Applicants
Faculty promote the welfare and professional development of students. Faculty host social events for students
Items on Section I for Faculty on the Doctoral Program Evaluation Questionnaire DPE- faculty items 10,11,12 GPSA item 22 Student report at annual review. Opportunities are available to report to faculty advisors, AGNS, and Director of PhD Program.
PhD Director Faculty
Dean
Survey using Doctoral Program Evaluation Questionnaire every 2 years.
Faculty assist students to understand the value of programs of research and scholarship that continue over time and build upon previous work.
Student report Alumni report
Faculty doctoral student relationships are positive Faculty devote a significant proportion of time to dissertation advisement; generally each faculty member serve as major advisor/chair for no more than 3-5 students during the dissertation phase. Faculty members are accessible to doctoral students Faculty are enthusiastic as teachers and stimulate students to learn Master teachers capable of preparing graduates for faculty roles Faculty discuss issues related to the substance of nursing science with students. Faculty discuss issues related to research methodologies with students.
Items on Section I for Faculty on the Doctoral Program Evaluation DPE faculty item12 Student report at annual review. Opportunities are available to report to faculty advisors, AGNS, and Director of PhD Program. Faculty receive collegiate teaching awards Student evaluations
PhD Director Faculty
Dean
Yearly Faculty identify, generate, and use resources within the University and broader community
Students, faculty, alumni, administration
Faculty foster interaction between the College of Nursing PhD Program and other related disciplines or programs on the campus
Items on Section I for Faculty on the Doctoral Program Evaluation Questionnaire.- DPE faculty item 18 # of comprehensive exam and dissertation co-chairs and committee members from other disciplines (not including statisticians). # of multidisciplinary grants, manuscripts, and presentations reported by students and faculty.
Faculty Area Chairs
Faculty provide data for administrative review on number of grants, manuscripts /presentations that are multidisciplinary. University Indicator: Report to Office of the Provost Data stored on Administrative Database
13
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES
INDICATORS MEASURES PERSONS RESPONSIBLE
REPORT GOES TO
Yearly Faculty identify, generate, and use resources within the University and broader community
Students, faculty, alumni, administration
Faculty participate in multidisciplinary scientific pursuits Faculty collaborate in clinical research or administrative endeavors with members of the nursing community outside the College Faculty research findings are disseminated to the practice community and the public at local, state, national, and international levels. Most faculty are members of several professional organizations and organizations that are interdisciplinary Faculty hold leadership positions in professional nursing organizations Endowed professorships in College of Nursing
Number of students enrolled in courses from other disciplines Administrative review Items on Section on Faculty in Doctoral Program Evaluation Questionnaire DPE faculty 20 Student, administration, and faculty report Number of reports at local, state, national, and international levels Items on Section I for Faculty on the Doctoral Program Evaluation Questionnaire Number of Professional Organizations reflected on faculty vita Number of leadership positions held by Faculty AACN survey Administrative data base
Faculty Area Chairs
University Indicator: Report to Office of the Provost Data stored administrative database.
Faculty Research
Research is an explicit component of the mission of The University of Iowa and the College of Nursing
Faculty, students, alumni. University and College mission statements & strategic plans.
Faculty are well-trained and experienced researchers Faculty influence nursing science
Items on Section II for Research on the Doctoral Program Evaluation Questionnaire DPE research 2 Amount in dollars of faculty funding and number of published articles.
PhD Director Office of Assoc. Dean for Research.
Faculty provide data for administrative review. Data stored administrative Database.
Ongoing The University and the College of Nursing value, support, and reward faculty and student research and scholarship
Faculty, students, alumni Faculty workload assignments
Faculty & students participate in the discussion at the nursing research colloquia Faculty publish in refereed journals (an average of two per year) Faculty participate in NIH study sections & other grant review activities
Items on Section II for Research on the Doctoral Program Evaluation Questionnaire DPE RESEARCH 4 Number of people attending as shown on the sign-in sheet at colloquia Number of articles published with faculty as authors Number of faculty participating in NIH Study Sections
Associate Dean for Research Faculty PhD Director Area Chairs
Faculty submit data with administrative review materials Data stored administrative data base University Indicator: Report to Office of Provost
14
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
Continuation page
Annually Faculty Programs of research that are developed over time and build upon previous exist and are congruent with research priorities within nursing and its constituent communities
Faculty, students, alumni Funding record
A variety of mechanisms (e.g. peer review, mentoring, consultation) exist that foster high quality research Number of externally funded grants involving interdisciplinary/ interdepartmental/cross-collegiate PIs Funded Centers of Excellence exist related to faculty programs of research Sufficient research exists to support the curricular goals Faculty obtain and maintain research funding over extended periods of time.
Items on Section II for Research on the Doctoral Program Evaluation Questionnaire DPE research 7 Number and variety of research topics for faculty Number of funded grant proposals per capita at University and NINR ranking DPE RESEARCH 8 DPE research9
Faculty, Area Chairs, Assoc Dean for Research
University Indicator: Report to Office of Provost PhD Director
15
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program Input Evaluation – Primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION Resources Support Systems Learners Program Plan Curriculum Organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Yearly Support Systems Sufficient human, financial, & institutional resources are available to accomplish the goals of the unit for doctoral education & faculty research
Students Faculty advisors
Technical support exists for: Cutting edge education and research. DPE RESOURCES 1 Peer review of proposals & manuscripts in process Data management & analysis support Hardware & software availability Expertise in advanced technological support exists for data repository and knowledge building to be used for education, research, and practice. Grant proposal development & management Technical support for research design expertise Space is sufficient for: -Faculty research needs -Doctoral student study, meeting & -socializing -Seminars -Small group work
Student & faculty self-report Curricular evaluation questionnaire OICT data DPE resource items, 8,12,13,14,15,16 Office for Research Research Colloquia Doctoral symposia
College Administration Office of OITC Faculty advisors
PhD Director
Faculty advisors Centers of research excellence
Number of centers
College Administration Office of OITC Faculty advisors
PhD Director
State of the art technical & support services are available & accessible to faculty, students, & staff for state of the science information acquisition, communication, & management
Students Faculty advisors
Computer accessibility Computer consultation & support are accessible
Student & faculty self-report DPE resources item 9
College Administration Office of OITC Faculty advisors
PhD Director
16
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Library & data base resources are sufficient to support the scholarly endeavors of faculty & students.
Library acquisitions Faculty, Students, Alumni report
Nursing journals & journals from other disciplines are available to support research
Student & faculty self-report DPE resources item 7 List of journals available Curricular Evaluation Questionnaire
University support Faculty Students
PhD Director
Every two years normally; ongoing informally
Support systems exist to promote learning
Faculty, Students, Alumni, Administration
An Office of Research administration is in place A Record of NIH funding exists Postdoctoral programs are in place Internal research funds exist Mechanisms are in place that value, support, & reward faculty & student research & scholarship Mechanisms for financial support for fulltime study
Annual report of research office DPE resources items 2,3 NIH funding record from office of nursing research Section IV for Resources on Doctoral Evaluation Questionnaire Informal feedback from students CON alumni assist in recruitment of faculty, students, and contribute funds for endowed chair positions NRSA awards Research Assistantships
Associate Dean for Research Assoc. Dean for Academic Affairs PhD Director Faculty Advisors
Assoc. Dean for research PhD. Director
Yearly Administration Support Systems Resources needed are adequate
Budget report Report of faculty and students
Faculty and other resources are available
Section IV on Resources from Doctoral Evaluation Questionnaire Faculty and student requests
College Dean Director of Operations and Finance
PhD Director
On-going Consultant Resources are available for research
Faculty, students Funding proposals are competitive. Consultation for diverse research is available.
Section IV on Resources from Doctoral Evaluation Questionnaire. Faculty and student reports PDE Resource item 2
Associate Dean for Research PhD Director
On-going Students are matched with faculty doing the same research
Students, Faculty Students choose dissertation topics related to faculty research
Section I on Faculty from Doctoral Evaluation Questionnaire NRSA awards
Area Chairs PhD Director
On-going Strategic Planning is developed and used to monitor the doctoral program
Students, Faculty Strategic Plan is used for benchmarking and formative evaluation Comparison of program processes and outcomes to standards of parent institution and selected peer groups
Section IV on Resources from Doctoral Evaluation Questionnaire. Faculty and student reports Yearly report to Provost
PhD Director College Dean annually
On-going Resources are allocated in an equitable, fiscally responsible fashion and are aligned strategically
Budget report, Students, Faculty
Focal areas in PhD program receive equitable resources. Resources decisions are made by faculty consensus when possible.
Section IV on Resources from Doctoral Evaluation Questionnaire. Faculty and student reports DPE resources item21
PhD Director Director of Operations and Finance
Yearly Program Evaluation occurs in a regular, systematic fashion
Evaluation Reports Evaluation Report is given to faculty every two years
Doctoral Evaluation Questionnaire IBN, AACN, CIC, Board of Regents, Statement of Trends reports
PhD Director Faculty and Associate Dean for Academic Programs
17
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
On-going Facilities are managed to provide support to faculty and students
Students and faculty
Students and faculty report that they have adequate facilities for their work
Section IV on Resources from Doctoral Evaluation Questionnaire. Faculty and student reports DPE student item 6
PhD Director Director of Operations and Finance
Yearly Exceptional Students are accepted
Student Applicant pool
Students accepted to the program are moving forward successfully
Section V on Doctoral Program Evaluation Questionnaire GPSA item 20
PhD Director and Faculty To Associate Dean for Academic Affairs
Yearly Faculty Advisors are oriented
Faculty report Students report that Faculty Advisors are knowledgeable.
Section I on Doctoral Program Evaluation Questionnaire GPSA items II2, 15
PhD Director To Associate Dean for Academic Affairs
Annually Program Director and Program Staff are Evaluated Annually
Evaluation summaries
Students and faculty provide evaluation data for the report. Recognized caliber of: Program Faculty Students
Section I on faculty and Section IV on resources from Doctoral Program Evaluation Questionnaire Administrative Review
Associate Dean for Academic Affairs and PhD Director
To Associate Dean for Academic Affairs
18
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
Input Evaluation – Addresses the intended means and primarily focuses on the resources available to meet the intended ends.
INPUT EVALUATION Resources Support Systems Learners Program Plan Curriculum organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
STUDENTS
Annual Review
Learners Students are exceptional
Applicant records Students are selected from a pool of highly qualified & motivated applicants who represent diverse populations. Students’ research goals & objectives are congruent with faculty research expertise & scholarship & institutional resources
Applicant profiles
PhD Student Services Office PhD Director
Student vitas & self-report Faculty advisors
Students are successful in obtaining financial support through competitive intramural & extramural academic & research awards.
Research office report. Number of funded pre-doctoral proposals.
Faculty Advisors & Associate Dean for research
University Indicator: Report to Office of the Provost
Yearly Students represent diversity in gender, ethnicity, and races.
Student Applications
Number of students representing diversity DPE student item 6
Students commit a significant portion of their time to the program & complete the program in a timely fashion
Student plans of study Time for completion of PhD program, Graduation rates Plan of study
Faculty Advisors
Students establish a pattern of productive scholarship, collaborating with researchers in nursing & other disciplines in scientific endeavors that result in the presentation & publication of scholarly work that continues after graduation.
Plans of study Faculty report Publication records Administrative office Doctoral reviews
Alumni surveys
Faculty Advisors
19
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
Input Evaluation – Addresses the intended means and primarily focuses on the resources available to meet the intended ends. INPUT EVALUATION Resources Support Systems Learners Program Plan Curriculum organization Support Courses and Liberal Education Foundation
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Formal evaluation every two years normally; ongoing informally
Program Plan Core & related course content distribution are Consistent with Goals of the program & student’s area of focus
Faculty, students, alumni
Requirements (program of study) and their sequence for progression are clear and available to students in writing. Content: History & philosophy of science and their relation to the development of nursing knowledge #2 PROGRAM CLEAR, AVAILABLE Existing and evolving Substantive nursing knowledge Methods & processes of theory/knowledge Development in nursing and other disciplines Research methods & scholarship are appropriate to inquiry
Graduate student handbook Items on Section III for Program of Study from Doctoral Program Evaluation Questionnaire DPE program item 1 Ongoing faculty report. DPE program item 2 Ongoing student report\ DPE program item 3 DPE program item 4
PhD Director Faculty Doctoral Advisory Committee
PhD Director University Indicator. Report to Office of the Provost
Elements for Formal & informal teaching & learning prepare students to be nurse scientists & nursing leaders
Faculty, students, alumni, Employers of graduates
Analytical & leadership strategies for dealing with social, ethical, cultural, economic, & political issues related to nursing, health care, & research Faculty practice provides opportunities for learning translational research Progressive & guided student scholarship research experiences, including exposure to faculty’s interdisciplinary research programs
Items on Section III for Program of Study from Doctoral Program Evaluation Questionnaire DPE program item 4 Faculty practice data
Faculty PhD Director University Indicator. Report to Office of the Provost
Elements for Formal & informal teaching & learning prepare students to be nurse scientists & nursing leaders &/or educators
Faculty, students, alumni, Employers of graduates
Immersion experiences that foster the student’s development as a nursing leader and/or nurse scientist Agencies provide opportunities for the conduct of research and leadership experience Socialization opportunities for scholarly development in roles that complement students’ career goals
Number and variety of experiences for research and leadership training Research residency, Research Seminars, Research Colloquia, Research Assistantships Student report at annual review Administrative data base Number and variety Residency experiences GPSA items I16, II,2
Faculty PhD Director
20
Graduate Curriculum Evaluation Plan Specific to the Doctoral Program
Product Evaluation – provides the information that informs decisions about the congruence of intended ends and actual ends. The purpose is to determine the fit of product outcome and program goals.
PRODUCT EVALUATION Learner Outcomes Satisfaction Discipline Specific Aggregate Data (BSN only)
CONTEXT & PRODUCT PROCESS/METHODS ACCOUNTABILITY
TIME-LINE STANDARDS DATA SOURCES INDICATORS MEASURES PERSONS RESPONSIBLE REPORT GOES TO
Ongoing 3-5 years post-graduation 3-5 years post-graduation
Learner outcomes Graduates’ scholarship & leadership are recognized
Alumni, employers of graduates Faculty
Advancement to candidacy requires faculty’s satisfactory evaluation Dissertations represent original contributions to the scholarship of the field Systematic evaluation of graduate outcomes is conducted at regular intervals Graduates have designed & secured funding Employers report satisfaction with leadership & scholarship Graduates’ scholarship & leadership are recognized through awards, honors, and/or external funding.
Student records Dissertation Abstracts Student plan of study Survey of graduates
PhD Student Services PhD Director
References: *American Association of Colleges of Nursing (2000). Task Force to Revise Quality Indicators for Doctoral Education Report. Doctoral Faculty, University of Iowa (1999). Doctoral Program Evaluation Questionnaire University of Iowa Strategic Plan Indicators (2001). Stufflebeam, D.L. (1983). The CIPP model for program evaluation. In G.F. Madaus, M.S. Scriven and D.L. Stufflebeam (Eds.) Evaluation models: Viewpoints on educational and human services evaluation (pp. 117-141). Boston: Kluwer-Nijhoff. GPSA. (1987). Graduate Program Self-Assessment. Doctoral Programs Faculty Questionnaire. Educational Testing Service. DPE.(2000. Doctoral Program Evaluation. College of Nursing, The University of Iowa. American Association of Colleges of Nursing. (November 2001). Indicators of quality in research-focused doctoral programs in nursing. http://www.aacn.nche.edu/Publications/positions/qualityindicators.htm. Retrieved March 1, 2002. N:caffairs\eval\EvaluationPlan2001 4/9/02