Openness and the Future of Assessment

Preview:

Citation preview

Openness and the Future

David WileyInstructional Psychology & Technology

Brigham Young University

Download These Slides

http://slideshare.net/opencontent/

Context

The societal superstructure is changing

Analog Digital

Music, Phones, TV, Newspapers,Movies, Journals, Communications,

Intelligence, Defense

Tethered Mobile

Phones, Internet Access,Employment

Isolated Connected

People, Content, Systems

Generic Personal

Cars, Computers, Mobile Phones

Consuming Creating

Radio / Podcasting, Newspapers / Blogs Movies / Vodcasting

Closed Open

Software (OSs, Applications), Content (Blogs, Wikis)

Then vs NowAnalog Digital

Tethered Mobile

Isolated Connected

Generic Personal

Consumption Creating

Closed Open

Education vs EverydayAnalog Digital

Tethered Mobile

Isolated Connected

Generic Personal

Consumption Creating

Closed Open

Characteristics of E-learning

Analog or Digital

Tethered or Mobile

Isolated or Connected

Generic or Personal

Consuming or Creating

Closed or Open

Decimation

California State University system – 33%University of New Hampshire – 50%

Double digit cuts everywhere

Exploding Demand

From 120M to 250M+ in next 15 years

Nonrivalrous Media

New opportunities

Free Copy, Distribute, Edit

Technology enables us to share and educate as never before

Except We Can’t

© forbids copying, distributing, and editing

© Cancels the Possibilities

Of digital media and the internet

InternetEnables

What to do?

CopyrightForbids

Use copyright to enforce sharing

The 4Rs

Reuse – copy verbatimRedistribute – share with others

Revise – adapt and editRemix – combine with others

2003-05

2003-08

2003-11

2004-02

2004-05

2004-08

2004-11

2005-02

2005-05

2005-08

2005-11

2006-02

2006-05

2006-12

2007-03

2007-06

2007-11

2008-02

2008-05

2008-08

2008-11

2009-02

2009-05

2009-08

2009-11

2010-02

2010-05

2010-08

2010-11

2011-02

2011-05

0

50,000,000

100,000,000

150,000,000

200,000,000

250,000,000

300,000,000

350,000,000

400,000,000

450,000,000

Over 400 Million Items

The “Open” in OER, OCW, &c.

(1) Free (2) 4R permission

InternetEnables

OERAllows

Sharing and educating at unprecedented scale

OER = Content Infrastructure

Platform for education innovation

Informal Learning

Open, standards-based way to issue, manage, and display credentials

for ANY learning

Transcript 2.0

Fixes many problems with current transcripts

OBI = Credential Infrastructure

Platform for education innovation

Open Education Infrastructure

Democratizes innovation opportunities

OER

LearnAnything

Badges

IssueManageDisplay

Credentials

OER

LearnAnything

Badges

IssueManageDisplay

Credentials

Assessment?

Mind the Gap!

HUGE demand over the next 10 yearsEntrepreneurs are on their way

Anywhere, Free

If I can learn anywhere for free,and show my credentials anywhere for free…

Assess Anywhere, Free?

What does this look like?

1. Ubiquitous Assessment

“Assessment as Status Update”(Tweets, product and book reviews, etc.)

Ubiquitous Assessment

What kind of infrastructure does this require?

Ubiquitous Assessment

No one is working on this infrastructure

2. Leveraging Big, Messy Data

10s of 1000s of tiny data points per personspread across a year

User-generated items

Leveraging Big, Messy Data

What kind of psychometrics are needed to deal with this?

3. From Summative to Formative

The majority will be formative

At scale does formative function as summative?

From Summative to Formative

How will the role of high stakes assessments evolve?

4. Scaling Constructed Response

We can’t condemn next-gen assessment to selected response

Scaling Constructed Response

“Gamify grading”

Google’s ESP Game

A symmetric verification game

(Verbosity is an asymmetric example)

For Example, In Education

• Rubrics• Multi-person Review• Inter-rater Reliability Component• Sanity Sampling

Future Assessment?

Analog or Digital

Tethered or Mobile

Isolated or Connected

Generic or Personal

Consuming or Creating

Closed or Open

Key Trends

Ubiquitous assessmentFrom summative to formative

Leveraging big, messy dataScaling constructed response

Expand Our Thinking

Beyond traditional educationBeyond traditional psychometrics

Beyond traditional assessment

Thank You

http://davidwiley.org/

Recommended