Learning Outcomes & Learner Achievements Management in Higher Ed

Jad NajjarInstitut for Information Systems and New

Media

2010-12-14Tallinn, Estonia

Outcome-based education

• Bologna Process: focus on learning outcomes (student centered view)

• Learning outcomes state what a learner

• knows, understands (knowledge), and

• is able to do (skills, competences)

after completing a learning process.

Learning outcomes

Teaching methods

Workload (ECTS)

Assessment techniques

Focus•Define and manage Learning

Outcome Definitions - ICOPER LOD specification

•Describe and share Personal Achieved Learning Outcomes - ICOPER PALO specification

Learning outcomes: Examples

Students are able to …

… explain the greenhouse effect

… enumerate the most influential politicians of the 20th century

… design an interactive website that complies with Web Accessibility Guidelines

… filter out relevant literature for a given research problem.

… guide their team mates in improving the architectural model of a system.

… moderate a virtual task-force meeting

Knowledge

Skills

Competence

Example: nursing competencies

Competency No. Capability Subject Matter Content Attitude C00 Use Ethical principles Values C10 Apply Ethical issues Actively C11 Demonstrate Client confidentiality Respectfully C12 Identify Ethical Issues Sensitively C20 Use Professional regulation Actively C21 Evaluate Professional regulation Considerately C22 Identify Limitation in own practice Values C23 Recognize Need for referral Willingly C24 Recall Professional regulations Willingly

From Sitthisak, Gilbert, & Davis (2007)

Pilot applications

Learning outcomes

Teaching methods & Learning designs

Assessment

Learning opportunite

sLearning content

OpenGLM

author42Learn@WU

LernXact

dotLRN

Facebook

IMC Clix

MoodleELGG

Repo

sitory

(OIC

S)

Domain Analysis

Learning Opportunities

Required profile (LODs)

Learning Content Assessment Resource

Needs Analysis &goal setting

Gap Analysis

Start

Learn

er

Planning Learning

Studiescompleted

Learning Activities

Assessment Activities

PD

Goal setting

Goal setAnalyze profile

Diagnostic Assessment

Gap Analysis

Learning needsestablished

Get Result

PALO

Start

Professional Development Scenario Example of a Learner Driven Scenario

Exter

nal A

ctors

Profile and Personal

Data Management

Edu

catio

nal

Inst

itutio

n A

dmin

istra

tion

Planning And

ManagementEvaluationStrategic

Analysis Administration

Strategy and Goal Setting

Stakeholder Analysis

Gap Analysis

Time and Budget

Planning

Rights Management

LOD / PALO Managment

Planning

Learning Outcome Definition

Data ad-ministration

Course Administration

Learner data management

Context Analysis

Evaluation planning

Learning Needs

Analysis

HE Institutional View - Learning Needs

Learning Outcome Definitions (LOD) Schema

• An application profile of IEEE Reusable Competency Definitions (IEEE RCD)

• Describes the characteristics of a learning outcomes

• Enable storage, referencing, sharing Learning outcomes data• Identifier• Title • Description• Type

• An extension to IEEE RCD• Takes values {skill, knowledge, competence}

“explain the greenhouse effect”

Learning Outcome Definition (LOD)

http://oics-dev.km.co.at/LOD/

Learning Outcome Definition Sources

• Open Learn (OUUK)• All course have defined learning outcomes• Stored in IEEE LOM metadata classification category• IEEE/ACM Computer Science Curricula (Task Force)• All course descriptions have learning outcomes• Pdf file• Used worldwide by many universities• 21st Century Engineer (NSF project)• 36 generic learning outcomes• Engineering domain• .ppt file• European Computer Science Driving License (ECDL)• Full list of learning outcomes per topic• Excel sheets

LODs and Learning Design

Find Outcome-based Learning Design

http://develix.iml.umu.se/moodle/

Personal Achieved Learning Outcomes (PALO) profile

This is just a test XML ATOM example

ATOM binding

http://oics-dev.km.co.at/icoper-user-service/users/2720436/palo.atom

Contributed and part of CEN InLOC proposal

PALO – Instance Example

Exporting achieved LODs and Recommendation

Sharing PALO Data

Learning Opportunities

http://oics-dev.km.co.at/MLO/

• Course Catalogs transformed into MLO• 1000’s instances of MLO• Liked to LODs

Lessons learned• Adopt standards and put them in real practice

• Extend when needed• Make recommendations

• Advise new specification when there is really no specification that fits your purpose

• Make more learning outcomes available• Publish Learning Opportunities• Compare what is in job profiles and what is in

learner achieved learning outcomes profile

Thanks!www.icoper.org

jnajjar@wu.ac.atjad@najjar.be