70
1 1 Linking Learning Outcomes to Linking Learning Outcomes to Teaching and Learning Teaching and Learning Activities and to Assessment Activities and to Assessment 2 – 3 June 2014 2 – 3 June 2014 University of University of Maribor, Maribor, Slovenia. Slovenia. Dr Declan Kennedy, Dr Declan Kennedy, Department of Education, Department of Education, University College Cork University College Cork Ireland Ireland

Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

  • Upload
    elma

  • View
    100

  • Download
    0

Embed Size (px)

DESCRIPTION

Linking Learning Outcomes to Teaching and Learning Activities and to Assessment. 2 – 3 June 2014 University of Maribor, Slovenia. Dr Declan Kennedy, Department of Education, University College Cork Ireland. 1. - PowerPoint PPT Presentation

Citation preview

Page 1: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1111

Linking Learning Outcomes to Linking Learning Outcomes to Teaching and Learning Activities and Teaching and Learning Activities and

to Assessmentto Assessment

2 – 3 June 20142 – 3 June 2014University of Maribor,University of Maribor,Slovenia.Slovenia.

Dr Declan Kennedy, Dr Declan Kennedy, Department of Education, Department of Education, University College CorkUniversity College CorkIrelandIreland

Page 2: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

22

“The adoption of a learning outcomes approach represents more than simply expressing learning in terms of outcomes. It entails much more due to their significant implications for all aspects of curriculum design, delivery, expression, assessement and standards”.

Adam S, 2004

Page 3: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

33

Assessment of Learning OutcomesHaving designed modules and programmes in terms of learning outcomes, we must now find out if our students have achieved these intended learning outcomes.How will I know if my students have achieved the desired learning outcomes? How will I measure the extent to which they have achieved these learning outcomes?Therefore, we must consider how to match the method of assessment to the different kinds of learning outcomes e.g. a Learning Outcome such as “Demonstrate good presentation skills” could be assessed by the requirement that each student makes a presentation to their peers. When writing learning outcomes the verb is often a good clue to the assessment technique. How can we design our examination system so that it tests if learning outcomes have been achieved?

Page 4: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

44

Misconceptions about Assessment “A view of teaching as the transmission of authoritative knowledge has little space to accommodate the idea that different methods of assessment may be appropriate for the evaluation of different parts of the subject matter or that assessment techniques themselves should be the subject of serious study and reflection. In such a conception, lecturers see teaching, learning and assessment as tenuously related in a simple linear sequence”.“Assessment is something that follows learning, so there is no need to consider its function as a means of helping students to learn through diagnosing their errors and misconceptions and reinforcing their correct understanding”.“Assessment, like teaching, is something done to students ….Assessment classifies the students on the criterion of how well they have absorbed the data thus transmitted. What could be simpler?”

(Ramsden, 2005)

Page 5: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

55

Formative AssessmentFormative Assessment Assessment Assessment FORFOR learning – gives learning – gives

feedback to students and teachers feedback to students and teachers to help modify teaching and to help modify teaching and learning activities, i.e. helps inform learning activities, i.e. helps inform teachers and students on progress teachers and students on progress being made.being made.

Assessment is integrated into the Assessment is integrated into the teaching and learning process. teaching and learning process.

Clear and rich feedback helps Clear and rich feedback helps improve performance of students improve performance of students (Black and Williams, 1998).(Black and Williams, 1998).

Usually carried out at beginning or Usually carried out at beginning or during a programme, e.g. during a programme, e.g. coursework which gives feedback coursework which gives feedback to students. to students.

Can be used as part of continuous Can be used as part of continuous assessment, but some argue that it assessment, but some argue that it should not be part of grading should not be part of grading process (Donnelly and Fitzmaurice, process (Donnelly and Fitzmaurice, 2005)2005)

55

Page 6: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

66

Summative AssessmentSummative Assessment

Assessment that Assessment that summarises student learning summarises student learning at end of module or at end of module or programme – Assessment programme – Assessment OF Learning. OF Learning. Sums up achievement – no Sums up achievement – no other use. other use. Generates a grade or mark.Generates a grade or mark.Usually involves assessment Usually involves assessment using the traditional using the traditional examination. examination. Only a sample of the Only a sample of the Learning Outcomes are Learning Outcomes are assessed – cannot assess assessed – cannot assess all the Learning Outcomes. all the Learning Outcomes.

66

Page 7: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

77

Continuous AssessmentContinuous Assessment

A combination of A combination of summative and summative and formative assessment. formative assessment. Usually involves Usually involves repeated summative repeated summative assessments. assessments. Marks recorded.Marks recorded.Little or no feedback Little or no feedback given.given.

77

Page 8: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

88

Assessment“Assessment is the process of gathering and discussing information from multiple and diverse sources in order to develop a deep understanding of what students know, understand and can do with their knowledge as a result of their educational experiences” (Huba and Freed, 2000)Assessment is "a set of processes designed to improve, demonstrate, and inquire about student learning" (Mentkowski, M. qtd. in Palomba, C. A., and Banta, T. W. (1999). Assessment essentials: Planning, implementing, and improving assessment in higher education. San Francisco, CA: Jossey-Bass,).

“A way of finding out what our students know and can do”

Page 9: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

99

EvaluationEvaluation:"the systematic process of determining the merit, value, and worth of someone (the evaluee, such as a teacher, student, or employee) or something (the evaluand, such as a product, program, policy, procedure, or process)." (Evaluation Glossary (n.d.). Retrieved December 18, 2007, from Western Michigan University, The Evaluation Center Web site, emphasis added). Assessment and evaluation not only differ in their purposes but also in their use of collected information. While it is possible to use the same tools for the two approaches, the use of the data collected differs. For example, an instructor can use the results of a midterm exam for both assessment and evaluation purposes. The results can be used to review with the students course material related to common mistakes on the exam (i.e. to improve student learning as in assessment) or to decide what letter grade to give each student (i.e. to judge student achievement in the course as in evaluation).

http://www.purdue.edu/cie/teaching/assessment-evaluation.html

Page 10: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1010

Assessment and Evaluation of Teaching

Assessment of teaching means taking a measure of its effectiveness

Evaluation involves measurement as part of a judgement, i.e. determining its “value,” e.g. Evaluation of teaching means passing judgment on it as part of a process such as quality assurance.

Evaluation involves a judgement of quality.

Page 11: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1111

Some questions re AssessmentWhy is assessment such a big issue in higher education at the moment?How best can we balance assessment FOR learning with assessment OF learning (formative and summative purposes)How do we make sure our method of assessment is doing the job we want it to do?What assessment techniques can we use to measure different types of learning outcomes? How can we improve exams so that they test higher order skills?Why have we been so traditional in assessment and not willing to make imaginative moves in area of assessment?Are we afraid to move into new areas of assessment in case we are accused of “dumming down” the standards?

Page 12: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1212

Trends in assessment

Traditional

Examinations

Lecturer-led

Product assessment

Vague criteria

Content

Individual

Changing approaches

Course work

Student-led

Explicit criteria

Skills

Group

Page 13: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1313

Assessing learning outcomes: points to consider

• Learning outcomes: “statements of what a student will know, understand, and/or be able to do at the end of a learning experience”.

• Having described your courses in terms of learning outcomes, you now want to find out whether students have achieved them

• Specify the types of student performance that will provide evidence of learning

Page 14: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1414

“Techniques” of assessment

Written: tests, examinations, assignmentsPractical: skills testing; lab/workshop practiceOral: interviews, various formatsAural: listening testsProject work: individual/group; research/designField work: data collection and reportingPortfolio : combination of techniques

Page 15: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1515

Common assessment techniques in Higher Education

Paper/thesis

Project

Product development

Performance

Exhibition

Case study.

Clinical evaluation

Oral exam

Interview

Research assignment

Portfolio

Others??

Page 16: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1616

Interrogating our assessment

1. Have we included a good balance of learning outcomes in our modules? (e.g. Bloom’s Taxonomy)

2. How do we know if students have achieved the intended learning outcomes: is there a good match between learning outcomes and assessment?

3. How can we improve assessment so that it tests the intended learning outcomes?

Page 17: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1717

Implications of Multiple Intelligences Theory for Innovative Forms of Teaching, Learning and

Assessment“If we truly accept and value the theory of MI, then

we are obliged as teachers to be far more inventive in our teaching. We must search for and develop methodologies that will allow all intelligences to shine in the learning experience. ……we must grasp the notion of constructivism with both hands and give the students the freedom to explore and construct knowledge and understanding, beginning with their own strengths”. (Hyland (ed.) Final Report MI Project, 2000, p. 126)

Page 18: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1818

One of the big challenges is to move away from assessment based solely on terminal exams – not intelligence fair, forcing all kinds of learning to fit into the paper and pencil test straight jacket. Purposes of Assessment: feedback, diagnosis, motivation, guidance, learning support, selection, grading, certification, progression, professional recognition, gate-keeping…..

Page 19: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

1919

Example of Matching the Assessment to the Learning

Outcome Learning outcomes1. Demonstrate good

presentation skills.2. Formulate food

product3. Identify an area for

research4. Identify signs and

symptoms of MS in a patient

Assessment?a) Multiple choice

questions b) Prepare a 1000-

word research proposal

c) Lab-based projectd) Make a presentation

to peers

Page 20: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2020

Giving feedback to studentsMake it quick, clear and focussedRelate it to the assessment criteria and learning outcomes.Learning Outcomes are usually written at threshold level. “Learning outcomes should be treated as threshold statements. They should not describe the performance of the average or typical student as so many people in workshops seemed to assume” (Moon 2002 p. 8).Use rubrics or formal marking schemes to show how well the requirements are met.Steps in feedback: – Affirm what is done well– Clarify: ask questions about specific aspects – Make suggestions for improvement– Give guidance about what the student needs to do next

I cannot tell you what a first class honours is but I will know it when it

see it!

Page 21: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2121

Assessing your assessment – is it doing the job you want it to do? Is it comprehensive?

Assessment Task 1

e.g. Written Exam

Assessment Task 2

e.g. Project

Assessment Task 3

e.g. Presentation

Assessment Task 4

e.g. Lab work

Learning Outcome 1

Describe…

Learning Outcome 2

Investigate..

Learning Outcome 3

Demonstrate..

Page 22: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2222

To what extent has each Learning Outcome been achieved?

Not a question of “yes” or “no” to achievement of Learning Outcomes.

Rubric: A grading tool used to describe the criteria which are used in grading the performance of students.

Rubric provides a clear guide as to how students’ work will be assessed.

A rubric consists of a set of criteria and marks or grade associated with these criteria.

Page 23: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

23

Linking learning outcomes and assessment criteria.

Learning outcome

Assessment criteria

Grade 1 Grade 2 : 1

Grade 2 :2

Pass Fail

On successful completion of this module, students should be able to:

Summarise evidence from the science education literature to support development of a line of argument.

Outstanding use of literature showing excellent ability to synthesise evidence in analytical way to formulate clear conclusions.

Very good use of literature showing high ability to synthesise evidence in analytical way to formulate clear conclusions.

Good use of literature showing good ability to synthesise evidence in analytical way to formulate clear conclusions

Limited use of literature showing fair ability to synthesise evidence to formulate conclusions.

Poor use of literature showing lack of ability to synthesise evidence to formulate conclusions

Page 24: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

242424242424

Important to ensure that there is alignment between teaching methods, Important to ensure that there is alignment between teaching methods, learning outcomes and assessment criteria. learning outcomes and assessment criteria.

Clear expectations on the part of students of what is required of them are Clear expectations on the part of students of what is required of them are a vitally important part of students’ effective learning (Ramsden, 2003) a vitally important part of students’ effective learning (Ramsden, 2003)

This correlation between teaching, learning outcomes and assessment This correlation between teaching, learning outcomes and assessment helps to make the overall learning experience more transparent and helps to make the overall learning experience more transparent and meaningful for students. meaningful for students.

For the good teacher, learning outcomes do not involve a “paradigm shift”. For the good teacher, learning outcomes do not involve a “paradigm shift”.

Teaching forunderstanding

Learning outcomes

There is a dynamic equilibrium between teaching strategies and Learning Outcomes.

Page 25: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

252525252525

Teacher Learning Teaching Perspectives: Objectives Outcomes Activities Assessment

StudentPerspectives: Assessment Learning Activities Outcomes

It is important that the assessment tasks mirror the Learning Outcomes since, as far as the students are concerned, the assessment is the curriculum: “From our students’ point of view, assessment always defined the actual curriculum” (Ramsden, 1992). Biggs (2003) represents this graphically as follows:

“To the teacher, assessment is at the end of the teaching-learning sequence of events, but to the student it is at the beginning. If the curriculum is reflected in the assessment, as indicated by the downward arrow, the teaching activities of the teacher and the learner activities of the learner are both directed towards the same goal. In preparing for the assessment, students will be learning the curriculum” (Biggs 2003)

Page 26: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2626

“Constructive Alignment” (Biggs, 2005)

ConstructiveThe students construct understanding for themselves through learning activities. “Teaching is simply a catalyst for learning” (Biggs, 2003). “If students are to learn desired outcomes in a reasonably effective manner, then the teacher’s fundamental task is to get students to engage in learning activities that are likely to result in their achieving those outcomes…. It is helpful to remember that what the student does is actually more important in determining what is learned than what the teacher does” (Shuell, 1986)

AlignmentAlignment refers to what the teacher does in helping to support the learning activities to achieve the learning outcomes. The teaching methods and the assessment are aligned to the learning activities designed to achieve the learning outcomes.Aligning the assessment with the learning outcomes means that students know how their achievements will be measured.

Page 27: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2727

Constructive alignment is the deliberate linking within curricula of aims, learning outcomes, learning and teaching activities and assessment.Learning Outcomes state what is to be achieved in fulfilment of the aims.Learning activities should be organised so that students will be likely to achieve those outcomes.Assessment must be designed such that students are able to demonstrate that they have met the learning outcomes.Constructive alignment is just a fancy name for “joining up the dots”.

(Morss and Murray, 2005)

Page 28: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2828

Steps involved in linking Learning Outcomes, Teaching Steps involved in linking Learning Outcomes, Teaching and Learning Activities and Assessmentand Learning Activities and Assessment

1.1. Clearly define the learning Clearly define the learning outcomes.outcomes.

2.2. Select teaching and Select teaching and learning methods that are learning methods that are likely to ensure that the likely to ensure that the learning outcomes are learning outcomes are achieved.achieved.

3.3. Choose a technique or Choose a technique or techniques to assess the techniques to assess the achievement of the achievement of the learning outcomes. learning outcomes.

4.4. Assess the learning Assess the learning outcomes and check to outcomes and check to see how well they match see how well they match with what was intended with what was intended

2828

If the learning outcomes are clearly written,

the assessment is quite easy to

plan!

Page 29: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

2929

Linking Learning Outcomes, Teaching and Linking Learning Outcomes, Teaching and Learning Activities and AssessmentLearning Activities and Assessment

Learning Outcomes Teaching and Learning Activities

Assessment

Cognitive(Demonstrate:Knowledge, Comprehension, Application, Analysis,Synthesis, Evaluation)

Affective(Integration of beliefs, ideas and attitudes)

Psychomotor(Acquisition of physical skills)

Lectures

Tutorials

Discussions

Laboratory work

Clinical work

Group work

Seminar

Peer group presentation etc.

•End of module exam.•Multiple choice tests.•Essays.•Reports on lab work and research project.•Interviews/viva.•Practical assessment.•Poster display.•Fieldwork.•Clinical examination.•Presentation.•Portfolio.•Performance.•Project work.•Production of artefact etc. 2929

Page 30: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3030

Learning outcomesModule ED2100

Teaching and Learning Activities

Assessment 10 credit moduleMark = 200

Cognitive•Recognise and apply the basic principles of classroom management and discipline. •Identify the key characteristics of high quality science teaching.•Develop a comprehensive portfolio of lesson plans

Lectures (12) Tutorials (6) Observation of classes (6) of experienced science teacher (mentor)

End of module exam.  Portfolio of lesson plans    (100 marks)

Affective•Display a willingness to co-operate with members of teaching staff in their assigned school.•Participate successfully in Peer Assisted Learning project

Participation in mentoring feedback sessions in school (4) Participation in 3 sessions of UCC Peer Assisted Learning (PAL) Programme.  Peer group presentation

Report from school mentor   End of project report.   (50 marks)

Psychomotor •Demonstrate good classroom presentation skills•Perform laboratory practical work in a safe and efficient manner.

Teaching practice 6 weeks at 2 hours per week. Laboratory work

Supervision of Teaching Practice   Assessment of teaching skills  (50 marks)

3030

Page 31: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3131

Does every learning outcome have to be assessed?

In theory “yes” but in practice “no”.In some cases they have to be assessed, e.g. licence to practice (e.g. medicine) or to perform essential tasks (e.g. aircraft pilot).When assessment is limited purely to an examination paper, it may not be possible to assess all the Learning Outcomes in such a short space of time – sampling of Learning Outcomes.Even if all the Learning Outcomes are assessed on an examination paper, due to choice of questions, a student may not be assessed on all of them.

Page 32: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3232

Learning Outcomes and Level Descriptors on Qualification Frameworks

A Learning outcome on its own does not give us an indication of the level of that learning outcome in a National Qualifications Framework.The level of the programme in which the learning outcome (programme learning outcome or module learning outcome) is written must be indicated in the programme description. The institution in which the programme is being taught must ensure: (a) that the programme learning outcomes map on to the relevant

level in the National Qualifications Framework (b) that the module learning outcomes map on to the programme

learning outcomes. (c) that within each module there is alignment between the Learning

Outcomes, the Teaching and Learning Activities and the Assessment.

Page 33: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3333

What other information, apart from the Learning outcomes is needed to describe a module?

Credit Weighting: Number of ECTS credits. Teaching Period(s): Term 1, Term 2 or both. .No. of Students: Maximum number of students allowed to take the module.Pre-requisite(s): Module(s) that should already have been passed by student. Co-requisite(s): Another module that the student must take with this module. Teaching Methods: Details of number of lectures, tutorials, etc.Module Co-ordinator: Name of person in charge of module. Lecturer(s): Name(s) of person(s) teaching the module. .

Page 34: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3434

Module Description (continued)Module Objective: A sentence stating the objective of the module.Module Content: A list of topics covered in the module. Learning Outcomes: On successful completion of this module, students should be able to:

[List of learning outcomes]. Assessment: Details of total mark for module and details of the breakdown of this total mark, e.g. written paper, continuous assessment, project, etc. Compulsory Elements: Any part of assessment that MUST be passed in order to pass the module, e.g. professional practice component. Penalties (for late submission of Course/Project Work etc.): Details of marks deducted for late submission. Pass Standard and any Special Requirements for Passing Module: The minimum mark that must be obtained in order to pass the module. End of Year Written Examination Profile: Number and duration of examination papers. Requirements for Supplemental Examination: Number and duration and date of repeat examination for those who fail the module.

Page 35: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

35353535

ModularisationA module is a self-contained fraction of a student’s workload for the year with a unique examination and a clear set of learning outcomes and appropriate assessment criteria. The size of a module is indicated by its credit weighting.Under ECTS system, each year of degree programme = 60 credits.Modules are allocated 5, 10, 15 or 20 credits depending on the fraction of the programme workload covered in the module. Each module is given a unique code, e.g. ED2013 ED2013

Education Year 2 Number assigned to this module

Page 36: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3636

60 ECTS credits

15 10 105510 5

Page 37: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3737

Advantages of modularisationGives greater clarity of structure and helps to establish clear relationship between credits and student workload in ECTS system.Reflects more accurately the various elements of students’ workload. Facilitates work abroad, work placement, off-campus study as modules for degree examinations.Gives greater clarity and consistency in assessment.Provides flexibility in the design of degree programmes by incorporating modules from different areas.

Page 38: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

3838

Facilitates credit accumulation, i.e. increases number of pathways to final degree award. Hence, encourages greater diversity of students, e.g. mature and part time students.

Allows third level institutions to participate in schemes like SOCRATES so that students obtain ECTS credits towards their degree.

Facilitates greater ease of student transfer between institutions offering ECTS-based programmes.

Facilitates resource allocation within university.

Page 39: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

39393939

Modules, Marks, Exams in UCC

Module Student Workload

Marks Exam Paper

5 credits* 125 – 150 hours 100 1.5 hours

10 credits 250 – 300 hours 200 3 hours

15 credits 375 – 450 hours 300 3 hours

20 credits 500 – 600 hours 400 2 x 3 hours

Note: Total per year = 60 credits = 1200 marks

Page 40: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

40404040

In University College Cork, a 5-credit module normally consists of 24 hours of lectures plus associated tutorials/essays / readings/practical/coursework OR

The equivalent in student workload such as literature projects, field courses, or indeed set reading assessed by written examination, work for problem sets, studying of legal material and cases outside of lecture hours, etc.

Page 41: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4141

Learning Outcomes in UCCUCC participated in the European Universities Association Network on Quality in Teaching and Learning in 2003 – 2004. ”Implementing a Learning Outcomes Approach to Teaching” – Quality Culture Project IV (EUA).

Network of six EU universities involved.

Headed up by Prof. Aine Hyland, Education Dept. and Dr Norma Ryan Quality Promotion Unit UCC  An 18 month project - the report was published in 2005. The project concentrated on Learning Outcomes rather than Competences

Page 42: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4242

A number of international conferences on Bologna Process were held in University College Cork – how I became involved.  

Page 43: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4343

The Teaching and Learning Centre Ionad Bairre

Set up in October 2006 –Marian McCarthy and Dr Bettie HiggsHas provided a continuous series of lunchtime seminars on Teaching and Learning throughout each academic year. “Taking a Learning Outcomes approach to Teaching and Learning”“Learning Outcomes-how can we be sure they have been achieved?”“Getting to Grips with Assessing Creative and Original Student work - Unpredictable Learning Outcomes” Drop-in workshops on Learning Outcomes.

Page 44: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4444

Page 45: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4545

Postgraduate Certificate, Diploma and MA in Teaching and Learning

in Higher EducationInitiated in October 2004.To date 4 cycles of the Postgraduate Certificate course have been completed involving 170 staff.A total of 90 staff members have completed the Postgraduate Diploma course.The MA in Teaching and Learning at Higher Education has been completed by 20 staff members. Has provided a great resource throughout the university – seminars based in individual Departments.

Page 46: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

464646464646

1. Identify aims and objectives of module

2. Write learning outcomes using standard guidelines

3. Develop a teaching and learning strategy to enable students to

achieve learning outcomes

4. Design assessment to check if learning outcomes have been

achieved

5. Check for Constructive Alignment. If necessary modify module content, Teaching and Learning Strategies and Assessment in

light of findings

“Bottom up” approach for existing modules

Page 47: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

474747474747

1. Identify Programme Learning Outcomes

2. Design modules so that all Programme Learning Outcomes are

reflected in the module Learning Outcomes

3. Assign ECTS credits to each module (1 year = 60 ECTS credits)

4. Design Teaching, Learning and Assesment strategies for each module (module descriptions).

5. Check that Constructive Alignment exists between module LOs, Teaching and Learning Activities and Assessment

“Top Down” Approach for designing new programmes

Page 48: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

484848484848

“Writing Learning Outcomes is a Process not an Event”

Page 49: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

4949

Looking to the Future

Page 50: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5050

“Learning outcomes had fundamentally changed the Scottish sector’s approach to learning since the 1990s and had resulted in enhanced coherence of the learning experience, greater transparency, increased dialogue with stakeholders, more opportunity for students to manage their own learning and better support for transitions into and out of learning programmes at points that suited the needs of the student” - Judith Vincent, Univ of West of Scotland (Seminar 21 – 22 February 2008)

Page 51: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5151

Students’ Perspective on Learning OutcomesLearning outcomes are an important aspect of student-centred learning which focused on student needs. Learning outcomes provided students with – a clear idea of what was expected– helped them to identify their own personal and

professional development– increased their sense of ownership of their

educational experience.– encouraged them to engage more actively in their

learning. – gave a more accurate and meaningful picture of

student achievement than workload. (Jill Little National Union of Students Scotland)

Page 52: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5252

Implications of a Learning Outcomes Approach to Teaching and LearningEngaging the students. The learning outcomes are not just seen as happening at the end, but are built in from the very start in the ongoing feedback and discussion and in the working out of the problem and discussing it with the students along the way – making the learning visible as we go along.

Page 53: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5353

Page 54: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5454

Recommendations from students

Learning outcomes should not be used in a tokenistic way e.g., only referred to in course handbooks.Learning Outcomes should be communicated to students so that they can articulate the knowledge and skills they have acquired. Learning Outcomes should be neither so prescriptive as to impede freedom of learning nor so broad as to become meaningless.

(Jill Little National Union of Students Scotland)

Page 55: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5555

Advantages of Learning Outcomes from students’ perspective

The use of learning outcomes with ECTS would result in: A broader, fairer and more accurate recognition of students’ knowledge and skills. A more transparent learning environment Easier to engage with and to choose programmes. Easier mobility within academic fields, education systems and countries. Enhanced employability in EuropeMore student-centred learning.

(Jill Little National Union of Students Scotland)

Page 56: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5656

Some General Advantages of Learning Outcomes

Aids curriculum design, helps to clarify programme aims and module objectives.Help to highlight the relationship between, Teaching, Learning and Assessment. Students benefit from clear statements of what they will be able to achieve after the specified period of study. Students are provided with clear information about programmes and modules. In terms of Quality Assurance, learning outcomes bring clarity and explicit transparency between qualifications and within individual qualifications. Facilitate mobility of students and graduates seeking employment. Facilitate credit transfer and recognition of qualifications – a common language for describing programmes.

Page 57: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5757

Issues with Introduction of Learning Outcomes

Learning Outcomes are only part of a massive reform package, e.g. Qualification Frameworks, Lifelong Learning, ECTS, Mutual Recognition, Quality Assurance. How best to introduce Learning Outcomes (“top down” or “bottom up”? Best left to local and National autonomy. How best to deal with sceptical attitude of some staff members – “dumbing down”, “restricting academic freedom”? Hence, important to introduce Learning Outcomes in a proper fashion using sources of good practice and advice. Lack of clarity and lack of shared understanding on key terminology, e.g. learning outcomes and competences.

Page 58: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5858

Issues raised when introducing Learning Outcomes

Opposition to Bloom's Taxonomy. This should not present a problem to the writing of Learning Outcomes AS mentioned already, Bloom's Taxonomy is simply a very useful toolkit to assist us in writing learning outcomes. If staff members do not wish to use Bloom’s Taxonomy, they can use other taxonomies or use their own system to write learning outcomes. As long as staff members write learning outcomes that are correctly written, that is all that is important.

Preference to write competences. It is not a problem if people like to describe their courses in terms of competences. However, the Bologna Agreement specifies that modules and programmes must be written in Learning Outcomes. If staff members wish to write competences as well as Learning Outcomes, that is not a problem. Learning outcomes bring clarity to competences.

Page 59: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

5959

Some AdviceIntroducing learning outcomes at institutional level requires a carefully tailored strategy, whose primary goal should be quality enhancement rather than compliance with external directives;Learning outcomes must be capable of assessment and at the module level should be linked to assessment criteria, also expressed in terms of learning outcomes;The best learning outcomes are the product of sincere reflection about realistic and attainable combinations of knowledge and understanding, practical and cognitive skills, levels of autonomy, learning skills etc.Learning Outcomes are challenging but it is impossible to have a meaningful European Higher Education area without their widespread and consistent use

(Stephen Adams, 2008)

Page 60: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6060

Some Recommendations from Porto Conference (19 – 20 June 2008)

Develop and disseminate user-friendly documentation to explain to all stakeholders the benefits of learning outcomes and credits. Implement a holistic approach, developing learning outcomes as an integral part of teaching, learning and assessment methods within an aligned curriculum. Offer incentives to encourage staff to engage in new approaches to teaching, learning and assessment.

Page 61: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6161

Concluding PointsMomentum generated by – European University Association project.– International Bologna conferences. – Setting up of Teaching and Learning Centre (Ionad Bairre). – Postgraduate Cert/Diploma and MA in Teaching and Learning in

Higher Education – Lunchtime seminars for staff.

Keep it simple.Provide support to staff.Staff training is the key.Setting up of expertise within each Department – Postgraduate Cert/Diploma course. The UCC Quality Promotion Unit - the driving force. A team effort.

Page 62: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6262

ReferencesAdam, S. (2004) Using Learning Outcomes: A consideration of the nature, role, application and implications for European education of employing learning outcomes at the local, national and international levels. Report on United Kingdom Bologna Seminar, July 2004, Herriot-Watt University. Allan, J (1996) Learning Outcomes in Higher Education. Studies in Higher Education, 21 (1) 93 - 108Boam, R. and Sparrow, P. (Eds) (1992) Designing and achieving competency, London: McGraw-Hill Boni A and Lozano F (2007) The generic competences: an opportunity for ethical learning in the European convergence in higher education. Higher Education 54: 819 – 831.Baume, D. (1999). Baume, D. (1999). Specifying Aims and Learning OutcomesSpecifying Aims and Learning Outcomes Milton Keynes: Milton Keynes: Open University.Open University. Biggs J, (2003) Aligning Teaching and Assessing to Course Objectives. Biggs J, (2003) Aligning Teaching and Assessing to Course Objectives. Teaching and Learning in Higher Education: New Trends and InnovationsTeaching and Learning in Higher Education: New Trends and Innovations. . University of Aveiro, 13 – 17 April 2003University of Aveiro, 13 – 17 April 2003Biggs, J. (2005) Teaching for Quality Learning at University (2003). Biggs, J. (2005) Teaching for Quality Learning at University (2003). Wiltshire: Open University Press ISBN 0335211682Wiltshire: Open University Press ISBN 0335211682Bingham, J. (1999) Bingham, J. (1999) Guide to Developing Learning OutcomesGuide to Developing Learning Outcomes, The Learning , The Learning and Teaching Institute Sheffield Hallam University, Sheffield.and Teaching Institute Sheffield Hallam University, Sheffield.Black, P and William, D (1998) Inside the Black Box: Raising Standards Black, P and William, D (1998) Inside the Black Box: Raising Standards through Classroom Assessment, London: Kings College. through Classroom Assessment, London: Kings College.

Page 63: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6363

Bloom, B. S., Engelhart, M., D., Furst, E.J, Hill, W. and Krathwohl, D. (1956) Taxonomy of educational objectives. Volume I: The cognitive domain. New York: McKay.Bloom, B.S., Masia, B.B. and Krathwohl, D. R. (1964). Taxonomy of Educational Objectives Volume II : The Affective Domain.. New York: McKay.Brown, R.B. (1993) ‘Meta-competence: a recipe for reframing the competence debate’, Personnel Review, 22(6): 25-36.Brown, R.B. (1994) ‘Reframing the competency debate: management knowledge and meta-competence in graduate education’, Management Learning, 25(2): 289-99.Burgoyne, J. (1988a) Competency Based Approaches to Management Development, Lancaster: Centre for the Study of Management Learning.

Page 64: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6464

Capel, S, Leask, M and Turner, T (1997). Learning to Teach in the Secondary School. London: Routledge. Chambers, D.W. (1994). Competencies: a new view of becoming a dentist. J Dent Education (58) 342-345Cockerill, T. (1989) ‘The kind of competence for rapid change’, Personnel Management, September, 52-56Council of Europe, Seminar on Recognition Issues in the Council of Europe, Seminar on Recognition Issues in the Bologna Process, Lisbon, 2002. Available at: Bologna Process, Lisbon, 2002. Available at: http://www.coe.inthttp://www.coe.intDave, R H (1975) Dave, R H (1975) Developing and Writing Behavioural Developing and Writing Behavioural ObjectivesObjectives (R J Armstrong, ed.) Educational Innovators (R J Armstrong, ed.) Educational Innovators PressPressDonnelly, R and Fitzmaurice, M. (2005). Designing Donnelly, R and Fitzmaurice, M. (2005). Designing Modules for Learning . In: Modules for Learning . In: Emerging Issues in the Emerging Issues in the Practice of University Learning and TeachingPractice of University Learning and Teaching, O’Neill, G , O’Neill, G et al. Dublin : AISHE.et al. Dublin : AISHE.

Page 65: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6565

Dooley, K. E., Lindner, J. R., Dooley, L. M. and Alagaraja, M. (2004). Behaviorally anchored competencies: evaluation tool for training via distance., Human Resource Development International, 7(3): 315-332.Elkin, G. (1990) ‘Competency-based human resource development’, Industrial and Commercial Training, 22(4): 20-25ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at: http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdfECTS Users’ Guide (2009). Available at ec.europa.eu/education/lifelong-learning-policy/doc/ects/guide_en.pdfEuropean Commission (2008) European Qualifications Framework for Lifelong LearningFIN Report (2009). Framework Implementation Network (FIN): University Awards and the National Framework of Qualifications: Issues around the Design of Programmes and the Use and Assessment of Learning Outcomes. Irish Universities Association and National Qualifications Authority of Ireland: Dublin Fry, H., Ketteridge, S., Marshall (2000) Fry, H., Ketteridge, S., Marshall (2000) A Handbook for Teaching and A Handbook for Teaching and Learning in Higher EducationLearning in Higher Education. London: Kogan Page.. London: Kogan Page.Fung M, Lee W and Wong S () A new measure of generic competencies. Gibbs, A, Kennedy D and Vickers A (2012) Learning Outcomes, Degree Profiles, Tuning Project and Competences. Journal of the European Higher Education Area 15 (5) 71 – 87

Page 66: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6666

Hartel, .R.W. and E.A. Foegeding (2004). Learning: Objectives, Competencies, or Outcomes. Journal of Food Science Education, (3) 69 – 70.Hartle, F. (1995) How to re-engineer your Performance Management Process, London: Kogan PageHendry, C., Arthur, M.B. and Jones, A.M. (1995) Strategy through People: Adaptation and Learning in the Small-Medium Enterprise, London: Routledge.HETAC (2006) Explanatory Guidelines on the Direct Application to HETAC for a Named Award. Dublin: Higher Education and Training Awards Council.Huba, M.E. & Freed, J. E. (2000). Learner-centered assessment on college campuses. Shifting the focus from teaching to learning. Needham Heights, MA: Allyn & Bacon.Jarvis, P. (1985) The sociology of adult and continuing education. London: Croom Helm. Jenkins, A. and Unwin, D. Jenkins, A. and Unwin, D. How to write learning outcomesHow to write learning outcomes. See the . See the following URL:following URL:

http://www.ncgia.ucsb.edu/education/curricula/giscc/units/format/http://www.ncgia.ucsb.edu/education/curricula/giscc/units/format/outcomes.htmloutcomes.html

Page 67: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6767

Kendall Phillips L. (1994) The Continuing Education Guide: the CEU and Kendall Phillips L. (1994) The Continuing Education Guide: the CEU and Other Professional Development Criteria. Iowa: Hunt Publishing.Other Professional Development Criteria. Iowa: Hunt Publishing.Kennedy D, Hyland A and Ryan N (2006) Writing and using Learning Kennedy D, Hyland A and Ryan N (2006) Writing and using Learning Outcomes, Bologna Handbook, Implementing Bologna in your Institution, Outcomes, Bologna Handbook, Implementing Bologna in your Institution, C3.4-1, 1 – 30. C3.4-1, 1 – 30. Kennedy, D (2007) Kennedy, D (2007) Writing and Using Learning Outcomes – A Practical Writing and Using Learning Outcomes – A Practical GuideGuide. Quality Promotion Unit, University College Cork. Available from . Quality Promotion Unit, University College Cork. Available from www.NAIRTL.iewww.NAIRTL.ieKennedy D, Hyland A and Ryan N (2009) Learning Outcomes and Kennedy D, Hyland A and Ryan N (2009) Learning Outcomes and Competences, Bologna Handbook, Introducing Bologna Objectives and Competences, Bologna Handbook, Introducing Bologna Objectives and Tools, B2.3-3, 1 – 18. Tools, B2.3-3, 1 – 18. McBeath, G. (1990) Practical Management Development: Strategies for Management Resourcing and Development in the 1990s, Oxford: BlackwellMessick, S. (1975) The standard problem: meaning and values in measurement and evaluation. American Psychologist October 1975 : 955-966Messick, S. (1982) Abilities and Knowledge in Educational Achievement Testing: The Assessment of Dynamic Cognitive Structures. Princeton: New Jersey: Education Testing Service. Miller, C, Hoggan, J., Pringle, S. and West, C. (1988) Credit Where Credit’s Due. Report of the Accreditation of Work-based Learning Project. Glasgow. SCOTVEC. Mitriani, A., Dalziel, M and Fitt, D. (1992) Competency Based Human Resource Management, London: Kogan Page.

Page 68: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6868

Moon, J. (2002). The module and Programme Development Handbook. Kogan Page: London.Morss, K and Murray R (2005) Teaching at University. London: Sage Publications ISBN 1412902975Neary, M. (2002). Curriculum studies in post-compulsory and adult education. Cheltenham: Nelson Thornes.Oliver et al (2008). Curriculum structure: principles and strategy. European Journal of Dental Education. (12) 74 – 84. Ramsden, P (2005) Ramsden, P (2005) Learning to teach in Higher EducationLearning to teach in Higher Education, London: , London: Routledge.Routledge.Shuell, T. J. (1986) Cognitive conceptions of learning. Review of Shuell, T. J. (1986) Cognitive conceptions of learning. Review of Educational Research, 56, 411 – 436.Educational Research, 56, 411 – 436.Smith, B. (1993) ‘Building managers from the inside out: competency based action learning’, Journal of Management Development, 12, 1: 43-8Tate, W. (1995) Developing Managerial Competence: A Critical Guide to Methods and Materials, London: Gower.Training Agency (1989) Development of Accessible Standards for National Certification Guidance: Note No. 1 Sheffield Employment Department/Training Agency.

Page 69: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

6969

Van der Klink, M and Boon, J. (2002) Competencies: The triumph of a fuzzy concept. International Journal Human Resources Development and Management, 3(2), 125 – 137.Winterton J, Delamare-Le Deist F and Stringfellow E (2005) Typology of knowledge, skills and competences: clarification of the concept and prototype. CEDEFORP: Tolouse. Available at: http://www.ecotec.com/europeaninventory/publications/method/CEDEFOP_typology.pdfWolf, A. (1989) Can competence and knowledge mix? In J. W Burke (ed). Competency-based Education and Training. Lewes: Falmer Press. Woodruffle, C. (1991). Competent by any other name., Personnel Management, September, 30-31.

Page 70: Linking Learning Outcomes to Teaching and Learning Activities and to Assessment

707070707070

References – Web SitesReferences – Web SitesBologna Working Group on Qualifications Frameworks (2004). Report on “A Framework for Qualifications of the European Higher Education Area”. Bologna Working Group on Qualifications Frameworks (2004). Report on “A Framework for Qualifications of the European Higher Education Area”.

Bologna Process Stocktaking London 2007. Available at:Bologna Process Stocktaking London 2007. Available at:www.ond.vlaanderen.be/hogeronderwijs/www.ond.vlaanderen.be/hogeronderwijs/bolognabologna/documents/WGR/documents/WGR20072007//StocktakingStocktaking_report_report20072007.pdf.pdf

DeSeCo projet : http://www.deseco.admin.ch/DeSeCo projet : http://www.deseco.admin.ch/ ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at: ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at:

http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdfhttp://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdf

ECTS Key Features: http://www.bologna.msmt.cz/files/ECTSKeyFeatures.pdfECTS Key Features: http://www.bologna.msmt.cz/files/ECTSKeyFeatures.pdfNational Qualifications Frameworks Development and Certification – Report from Bologna Working Group on Qualifications Frameworks. May 2007National Qualifications Frameworks Development and Certification – Report from Bologna Working Group on Qualifications Frameworks. May 2007http://www.ond.vlaanderen.be/hogeronderwijs/bologna/documents/Working_group_reports_2007.htmhttp://www.ond.vlaanderen.be/hogeronderwijs/bologna/documents/Working_group_reports_2007.htm

Framework website: www.nfq.ie

National Qualifications Authority of Ireland: www.nqai.ie

OECD; http://www.oecd.org/dataoecd/47/61/35070367.pdf

Tuning Educational Structures in Europe: http://tuning.unideusto.org/tuningeu/Tuning Educational Structures in Europe: http://tuning.unideusto.org/tuningeu/

Verification of Compatibility of Irish National Framework of Qualifications with the Framework for Qualifications of the European Higher Education Area - Summary of Final Report – November 2006

http://www.nqai.ie/en/International/VerificationofCompatibilityofIrishNationalFrameworkofQualifications/File,1797,en.doc

www.bologna.ie