Transcript
Page 1: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Open Assessments and OERs

as Enablers in Competency-

Based Education

Demo for the X International UNESCO Chair Seminar

Tom Caswell, [email protected]

@tom4cam

Brandon Muramatsu, [email protected]

@bmuramatsu

Page 2: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Safe is risky.

Page 3: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Measuring education by learning, not time.

https://www.youtube.com/watch?v=GJdE7u1ZN60#t=598

Page 4: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

What is Competency-Based Education?

Competency-based education (CBE)

awards academic credit based on mastery

of clearly defined competencies.

EDUCAUSE “7 Things you should know about competency-based education”

Page 5: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

1. Emphasizes mastery and de-emphasizes time

2. Assessments/projects play a central role

3. Individualized support for learners

4. More flexibility and responsibility for learners

• Apply prior knowledge and experience

• Learning can be self-paced

Common Features of CBE

Page 6: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Who Is Doing It?

Page 7: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Learning is the new constant

Time varies.

Every student can succeed!

PA

SS

Page 8: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Types of OER Content

• Videos

• Lectures

• Textbooks

• Webpages

• Assessments

Page 9: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Focus: Formative Assessment

• Check understanding / mastery of

concepts directly in course materials

• Primarily for formative (self-check,

understanding) not summative (exams or

formal assignments)

Page 10: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

The Potential

• Do for assessments what’s been done for

content (courses, lectures, videos)

• Embed anywhere

• Share• Don’t reinvent the wheel for every course

• Evaluate, record and track responses• Scale –> More use of items/assessments for validity

• May lead to evidence of impact?

Page 11: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

openassessments.org

11

Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Page 12: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

What is OpenAssessments.org?

• Embed an assessment in any web content

• Focus on formative assessments

• Start with limited question types

• Multiple-choice/single answer

• Numerical answer

• Short answer

Page 13: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

How do you use it?

• Create a question in a standardized format

• Typically using IMS Question & Test Interoperability

spec

• Likely created in your learning management system

• Put the question on a public web server

• Copy and paste the URL to the question file

• That’s it!

Page 14: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Page 15: Open Assessments and OERs as Enablers in Competency-Based Education

OCW Scholar – 8.03SC

15

Le

win

, W

alte

r, W

it B

usza

, G

eo

rge

Ste

ph

an

s, a

nd

Ma

rtin

Co

nn

ors

. 8

.03

SC

Ph

ysic

s III

: V

ibra

tio

ns a

nd

Wa

ve

s, F

all

20

12

.

(MIT

Op

en

Cou

rseW

are

: M

assa

ch

use

tts In

stitu

te o

f T

ech

no

log

y),

htt

p:/

/ocw

.mit.e

du

/co

urs

es/p

hysic

s/8

-03

sc-p

hysic

s-i

ii-

vib

ratio

ns-a

nd

-wa

ve

s-f

all-

201

2 (

Acce

sse

d 7

Nov,

20

13

). L

ice

nse

: C

rea

tive

Com

mo

ns B

Y-N

C-S

A

Page 16: Open Assessments and OERs as Enablers in Competency-Based Education

OCW Scholar – BCS9.00SC

16

Ga

bri

eli,

Jo

hn

. 9

.00

SC

In

tro

du

ctio

n to

Psych

olo

gy, F

all

20

11

. (M

IT O

pe

nC

ou

rseW

are

: M

assa

ch

use

tts In

stitu

te o

f

Te

ch

no

log

y),

htt

p:/

/ocw

.mit.e

du

/co

urs

es/b

rain

-an

d-c

ogn

itiv

e-s

cie

nce

s/9

-00

sc-i

ntr

odu

ctio

n-t

o-p

sych

olo

gy-f

all-

20

11

(Acce

sse

d 7

Nov,

20

13

). L

ice

nse

: C

rea

tive

Com

mo

ns B

Y-N

C-S

A

Page 17: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

But can we make it reusable?

Page 18: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Embedded in MIT OpenCourseWare

Page 19: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

How it works

We pass a URL for the raw OLX code to the open assessments web application:

http://www.openassessments.com/assessments/load?utf8=✓src_url=http://…/courses/mathematics/18-05-introduction-to-probability-and-statistics-spring-2014/sequential/ps1.xml

And then to embed it in MIT OCW, we use an iframe:

<iframe style="width: 100%; height: 600px;" src="http://www.openassessments.com/assessments/load?utf8=✓&style=ocw&src_url=http://…/courses/mathematics/18-05-introduction-to-probability-and-statistics-spring-2014/sequential/ps1.xml">

Page 20: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Analytics (Mockup)

Page 21: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Related and Future Work

• Increasing use

• Open Item Banks

• Use in Lumen Learning-developed OER course

• Extending to additional MIT OCW courses

• Extending functionality

• Additional question types, especially parameterized/interactive

ones

• How will you use it? openassessments.org

Page 22: Open Assessments and OERs as Enablers in Competency-Based Education

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 International License.

Thank you for listening.

Tom Caswell, [email protected]

@tom4cam

Brandon Muramatsu, [email protected]

@bmuramatsu