Phases of Curriculum Design:Evaluation

Stufflebeam’s CIPP Model

Dr. Katherine KorkidisApril 19, 2009

In this presentation:

1. Steps in the implementation phase for schools is reviewed.

2.Overview of developing a evaluation plan using the CIPP model.

• Context – decision to adopt a curriculum

• Overview of developing a teaching schedule.

• Elements to include in staff professional development.

• Input – goals for restructuring curriculum

• Addressing specifics needs or concerns.

• Product- goals achieved or not

• Potential problem areas on first implementation.

• Process- monitoring during implementation

• Outputs of the implementation phase.

KK Evaluation Criteria of Curriculum

.

Content/Alignment with Standards NJCCCS

Program OrganizationScope and sequence Incorporation of 21st skills Curriculum design

AssessmentStandardized testing

Universal accessNCLB

Instructional planning and supportTeaching schedule and resources

Curriculum Evaluated

Andover Schools – Technology Education in the MSGrades 6-8

East Haddam Schools – Physical Science in the MSGrades 7,8

Both schools are in the implementation phase .

In the implementation phase, the schools conduct the course and

carry out a plan to evaluate how well your methods and materials work

in practice.

It may be necessary to go back and modify the output from the

development phase, based on the results of the evaluation study.

Analysis

Design

Development

Implementation

Evaluation / Maintenance

IMPLEMENTATION

Evaluation Plan

Expectation Reality

In the evaluation plan, the schools specify how they will determine whether or not the course and its components worked.

The evaluation plan addresses both the course as a whole and the individual lessons and units within the course.

The point of the evaluation study is to compare the expectations for the course and the reality from teaching it.

Expectation RealityThe CIPP plan addresses:

• Class achievement.

• Validity and reliability of evaluation instruments.

• Student feedback.

• Instructor feedback.

For each of these the plans:

1. Define expectations: What will be acceptable? Unacceptable?

2. Specify data collection methods; develop collection instruments.

3. Specify data analysis methods.

4. Specify actions for unacceptable elements.

CIPP Evaluation Plan for Both Schools

CLASS ACHIEVEMENT

For each unit in the course, the schools considered the following questions:

How well has the class done?

Did a majority of the students successfully complete each part of the unit?

Did parts of the unit pose particular problems for the class or a group of students within the class?

Did students who did not perform well on the unit have common traits or backgrounds?

Expectation Reality

STUDENT FEEDBACKWhen implementing a course, students are your immediate customers. It makes sense to findout what they think of the course. This will betrue every time the course is presented, but student feedback is even more important forthe first iteration of a course.

Questionnaires for student feedback focus on the students’ perception of the content and conduct of the course:

• Were the learning objectives clear?• Was there sufficient time to meet the learning objectives?• Did the students understand the purpose of the lesson/unit/module? • Were study aids sufficient? Useful?• Was the material too hard? Too easy?• Were audiovisual materials useful?• Were the instructors knowledgeable? Helpful? Clear?

Expectation Reality

OTHER CONSIDERATIONS

The implementation plan should also include a time line or POA&M

(Plan of Action and Milestones) for getting ready for the first

class of students.

It should allow enough lead time for ordering supplies and

equipment, printing or duplicating materials for students, conducting

the instructor orientation, and completing personalization of the

lesson topic guides.

OUTPUTS FROM THE IMPLEMENTATION PHASE

Outputs from this phase included:

Validation Report• Summary of student achievement.• Summary of student input.• Summary of instructor input.• Reliability data, summary analysis for test instruments and items.• Summary of adjustments made during implementation.

List of recommended changes from validation process.

SUMMARY

Although the slides in this presentation address the implementation phase for a new curriculum, most of the steps are also needed for implementing subsequent iterations of the curriculum.

The evaluation plan can be modified and used to monitor the effectiveness of instruction.

The school district may not need as much detail, but should continue to watch student and instructor reactions to the materials and methods, reliability and validity of testing instruments, and general class achievement (or its negative side: attrition rate).

The staff professional development plan becomes a plan for orientation of new instructors.

The teaching schedule becomes the model for later schedules.