Students Evaluation and Examination Methods

Ahmed-Refat-FOM-ZU-2009

نظم االمتحانات وتقويم الطالب

Student EvaluationAnd Examination Techniques

Dr. Ahmed-Refat El-Kashmery

FOM-ZU


Basic Terms & Concepts

• Teaching• Learning• Examination• Assessment• Evaluation• Mission>>Vision>>• Goal>>Objectives ….. S.M.A.R.T• Outcomes• K.A.P


Definitions of Teaching

•To present information, insights.

•To reveal knowledge or skill .

•To help students learn.–NOTE: All of the above can be accomplished

either deliberately or incidentally.–That is, you can teach by means of explicit

instruction, ongoing guidance, deliberate modeling, or accidental example.


First Principle for Assessing Student Learning

Assessment of student learning must be directly

connected to the learning objectives of your course. You should make these connections clear to students in your syllabus.


Measures of Learning

• Any measurement of learning can be used either for assessment or for evaluation purposes.


Employ an assessment-informed model of teaching

– Define learning outcomes (desired by teachers and/or learners) well in advance.

– Assess progress toward outcomes, by and for both teacher and learner, continually during learning.

– Evaluate attainment of outcomes rigorously as each learning opportunity concludes.

• Moment-by-moment, meeting-by-meeting, course-by-course, semester-by-semester.


ILO

• Indented Learning Outcomes- Objectives

• Vision,

• Mission,

• Goal

• Objectives


Mission ,

• A mission clarifies an organization’s purpose, or why it should be doing what it does.

• The program’s mission statement should provide an overview of the program’s philosophy, goals and objectives. Basically, it should embody the program’s purpose and faculty priorities for the program.


Vision statement

• A vision vision clarifies what the organization should look like and how it should behave as it fulfills its mission


Goal

• A goal is an end result written in broad terms.

• Goals state what you, your colleagues, or you institution aim to achieve.”

• Program learning goals describe broad learning outcomes and concepts that you, as faculty, want students to achieve. These learning goals are expressed in general terms


Objectives

• An objective is the intended effect of a service or intervention, but is much more specific than goals.

• It is facilitator centered.


Outcome

• An outcomeAn outcome is the desired effect of a service or intervention, but is much more specific than goals.

• what students should be able to demonstrate after their participation.

• also defined as learning or outcomes.

• It is participant focused


Strategy

• A strategystrategy is means to achieving outcomes or goals.

• Developing a strategy will define “who is going to do what, when they will do it, and how they will use the information that is generated.”

•


The word ‘assess’

Comes from the Latin verb ‘assidere’

meaning ‘to sit with’. In assessment

one is supposed to sit with the learner.

This implies it is something we do with

and for students and not to students


Assessment

• AssessmentAssessment is “the gathering of information concerning the functioning of students, staff, and institutions of higher education”


Assessment

• “AssessmentAssessment refers to gathering evidence: gathering data, transforming data so that they can be interpreted, applying analytical techniques, and analyzing data in terms of alternative hypotheses and explanations


• AssessmentAssessment is “collecting evidence of

• (1) student performance on specified measures of development,

• (2) program strengths and weaknesses, and

• (3) institutional effectiveness”

Assessment


• defineddefined as a continuous process used by the University (a) for evaluating the degree to which all University programs and services contribute to the fulfillment of the University’s primary mission; and (b) for documenting and improving the University’s effectiveness.”

Assessment


•“…thethe systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development.”

Assessment


PURPOSES OF ASSESSMENT:

Primary Purpose: To• improve the quality of student

learningSecondary Purposes:• Program Improvement• Connection to Institutional Mission


Definitions of Teaching

• To present information, insights.

• To reveal knowledge or skill.

• To help students learn.– That is, you can teach by means of explicit

instruction, ongoing guidance, deliberate modeling, or accidental example.


Learning

•LEARNING IS DESCRIBED ASLEARNING IS DESCRIBED AS: •Learning not only involves the acquisition of basic academic skills and the broad-based knowledge of a liberal education but goes beyond these to include inspiringinspiring and enabling students to become autonomousautonomous learners, criticalcritical

thinkersthinkers, creativecreative problemproblem-solverssolvers, and

thoughtfulthoughtful, reflective citizens with a passion for life-long learning.


Evaluation

• “EvaluationEvaluation is any effort to use assessment evidence to improve institutional, departmental, divisional, or agency effectiveness”

• Evaluation is the utilization of information for institutional and individual improvement. Evaluation…has to do with motivation and the rendering of value judgments


Frames of Reference for Interpreting Test Scores

• There are four frames of references for interpreting test scores are explained:

1.1. Ability,Ability,

2.2. Growth,Growth,

3.3. norm, norm,

4.4. Criterion Referenced interpretations.Criterion Referenced interpretations.




Norm-Referenced Assessment

• An assessment where student performances are compared to a larger groupcompared to a larger group. Usually the larger group or "norm group" is a national sample representing a wide and diverse cross-section of students. Students, schools, districts, are compared or rank-ordered in relation to the norm group.

• The purpose of a norm-referenced assessment is usually to sort students and not to measure achievement towards some criterion of performance


Criterion Referenced Tests

• A test in which the results can be used to determine a student's progress toward mastery of a content area.

• Performance is compared to an expectedexpected levellevel ofof masterymastery in a content area rather than to other students' scores.


Criterion Referenced Tests

• The "criterioncriterion" is the standardstandard of performance established as the passing score for the test. Scores have meaning in terms of what the student knows or can do, rather than how the test-taker compares to a reference or norm group.


Formative Assessment

• The gathering of information about student learning-during the progression of a course or program and usually repeatedly-toto improveimprove thethe learninglearning of those students.


• Often referred to as assessmentassessment forfor learninglearning,



• ...refers to all those activities undertaken by teachersteachers, and by the studentsstudents in assessing themselves, which provide information to be used as feedbackfeedback to modifymodify the teaching and learning activities in which they are engaged. Such assessments become formative when the evidence is actually used to adaptadapt the teaching to meetmeet the needsneeds.



Summative Assessment

• The gathering of information at theat the conclusionconclusion of a course, program, or undergraduate career to improve learning or to meet accountabilityaccountability demands. When used for improvement, impactsimpacts the next cohort of students taking the course or program.


Frame of assessment


Screening Assessment

• Screening assessment helps classify students as at risk or not at risk for failure and is used to identify students who may need extra or alternative forms of instruction. Used as predictive of future growth and development. The assessment is conducted at the beginning of the school year.


Diagnostic Assessment

• Diagnostic assessment helps teachers plan instruction and determine possible intervention strategies related to the special needs of the student. These assessments are conducted at any time during the school year when more in-depth analysis of a student’s strengths and weaknesses are needed to guide instruction. In other words, diagnostic assessments are administered only to students who are struggling. Teachers can use the information derived from these assessments to improve planning and achievement.


Progress Monitoring

• Progress monitoring ensures that students are making adequate progress throughout the year. It is also referred to as “formative evaluation". Progress monitoring is conducted three times a year, at minimum, or on a routine basis (i.e., weekly, monthly, or quarterly), using comparable and multiple test forms


Outcome Assessment

• Outcome assessment helps formulate judgments about the quality of the program. It helps classify students in terms of whether they improved or achieved grade-level performance. Outcome assessment also provides a bottom-line evaluation of the effectiveness of a program/instruction.


Teaching-Improvement Loop

• : Teaching, learning, outcomes assessment, and improvement may be defined as elements of a feedback loop in which

teaching influences learning, and the

assessment of learning outcomes

is used to improve teaching and learning.


Process of Faculty Driven Assessment

• Process of GoalGoal SelectionSelection: Faculty members lead the assessment process by meeting on a regular basis to set goals and criteria. All of our goals flow from the mission statement of the university.


• Faculty members from each program specify objectivesobjectives that apply the mission statement to their area.



• Selection of Assessment MeasuresMeasures: Faculty members from each program

• develop measures to directlydirectly and indirectlyindirectly assess how well the objectives were achieved.



• Performance Criteria: Faculty members from each program set standardsstandards which students are expected to achieve in order to demonstrate that the objectives are being fulfilled.



Collect data

• CollectionCollection and Analysis of Data: Assessment measures are applied and the results are compared to the performance criteria.


compare

ComparisonComparison Study: Assessment results are compared with other colleges and other

programs within U. Longitudinal studies assess progress within the division.


Change

• ChangesChanges: Based on assessment data, program improvements are made. These changes are then assessed using the same process.


Principles of Assessment of Student Learning

•The primary purpose of assessment is improving student learningimproving student learning. •Assessment of student learning is based on goalsgoals reflectedreflected in the University’s missionmission. •Assessment of student learning must have course and program significancecourse and program significance.


• Assessment of student learning depends on clearclear and explicit learning goalsgoals.

• Assessment involves a multi-method multi-method approach. approach.

• Assessment results will be used for decisiondecision makingmaking in planningplanning and improvement processes.



•The results of assessment activities will notnot be be

used for the evaluation of individualused for the evaluation of individual facultyfaculty.

•Assessment data will not be used to make comparison acrossacross programsprograms, departments, or colleges.

•Successful assessment requires UniversityUniversity supportsupport.




IDENTIFY ASSESSMENT METHODS

• DIRECT VS. INDIRECT

ASSESSMENT


DIRECT ASSESSMENT

•– “Directly evaluates student work. Examples of direct measures include exams, papers, projects, computer programs, interactions with a client.”


INDIRECT ASSESSMENT

•– “Student (or others) perceptions of how well students have achieved an objective.”


Some Examples Include: • Focus Groups • Graduating Senior Survey • Alumni Survey • Employer Survey • Exit Interviews • Student Course Evaluation • Graduation Retention Rate

INDIRECT ASSESSMENT


QUALITATIVE VS. QUANTITATIVE MEASURES

•QUALITATIVE ASSESSMENT – “Assessment findings that are verbal descriptions of what was discovered, rather than numerical findings.”


Some Examples Include

•: • Exit Interviews •• Focus Groups •• Writing Samples •• Open-ended questions on surveys and interviews •• Employer interviews


QUANTITATIVE ASSESSMENT

•– “Assessment findings are summarized with a number that indicates the extent of learning.”


Some Examples Include

•: • Written and Oral Exams

•• Research Papers

•• Senior Projects

•• Exam Scores

•• Course Grades


USE THE ASSESSMENT RESULTS

To evaluate • Evaluate learning goals: Are there too many, do they need clarification, are they appropriate?

•Evaluate curriculum: Does it address all of the learning goals? How can courses be modified to do so?


•Evaluate teaching methods: Can any improvement be made in this area toward empowering students to achieve learning goals? •Evaluate the assessment methods used: Were they appropriate?

USE THE ASSESSMENT RESULTS

To evaluate


Learning

• Learning is the desireddesired outcomeoutcome of instruction and is indicated by a change in performance.


ILO

•LearningLearning objectivesobjectives, also called student learninglearning goalsgoals or studentstudent learninglearning outcomesoutcomes (SLOS), basically flesh out the program learning goals by outlining observableobservable behaviorsbehaviors that can be measuredmeasured by the faculty to gauge whether students are mastering goals. These objectives include the specificspecific and measurablemeasurable skills, aptitudes and values that students should exhibit and will allow faculty to evaluate student achievement of the broader program goals.


•“The student learning goals are specific statements derived from your program learning goals. These student learning goals should focus on what the focus on what the student will learn and master student will learn and master rather than what will be taughtrather than what will be taught; they should explain how students will demonstrate this mastery and should identify the depth of processing that faculty expect.”

ILO


• A student learning outcome is “A statementstatement of what students will be able to of what students will be able to do outside the classroom (in context) with do outside the classroom (in context) with what they have learnedwhat they have learned. The statement should be clear enough to be understood by the stakeholders and significant enough to drive the curriculum.”

ILO


• Learning outcomes have three distinguishing characteristics: the specified actionaction by the learner must be observableobservable, measurablemeasurable, and donedone by the learner.

ILO



Thank You

Any ?

Education

Students Evaluation and Examination Methods