63
Openness and the Future David Wiley Instructional Psychology & Technology Brigham Young University

Openness and the Future of Assessment

Embed Size (px)

Citation preview

Page 1: Openness and the Future of Assessment

Openness and the Future

David WileyInstructional Psychology & Technology

Brigham Young University

Page 2: Openness and the Future of Assessment

Download These Slides

http://slideshare.net/opencontent/

Page 3: Openness and the Future of Assessment

Context

The societal superstructure is changing

Page 4: Openness and the Future of Assessment

Analog Digital

Music, Phones, TV, Newspapers,Movies, Journals, Communications,

Intelligence, Defense

Page 5: Openness and the Future of Assessment

Tethered Mobile

Phones, Internet Access,Employment

Page 6: Openness and the Future of Assessment

Isolated Connected

People, Content, Systems

Page 7: Openness and the Future of Assessment

Generic Personal

Cars, Computers, Mobile Phones

Page 8: Openness and the Future of Assessment

Consuming Creating

Radio / Podcasting, Newspapers / Blogs Movies / Vodcasting

Page 9: Openness and the Future of Assessment

Closed Open

Software (OSs, Applications), Content (Blogs, Wikis)

Page 10: Openness and the Future of Assessment

Then vs NowAnalog Digital

Tethered Mobile

Isolated Connected

Generic Personal

Consumption Creating

Closed Open

Page 11: Openness and the Future of Assessment

Education vs EverydayAnalog Digital

Tethered Mobile

Isolated Connected

Generic Personal

Consumption Creating

Closed Open

Page 12: Openness and the Future of Assessment

Characteristics of E-learning

Analog or Digital

Tethered or Mobile

Isolated or Connected

Generic or Personal

Consuming or Creating

Closed or Open

Page 13: Openness and the Future of Assessment

Decimation

California State University system – 33%University of New Hampshire – 50%

Double digit cuts everywhere

Page 14: Openness and the Future of Assessment

Exploding Demand

From 120M to 250M+ in next 15 years

Page 15: Openness and the Future of Assessment
Page 16: Openness and the Future of Assessment
Page 17: Openness and the Future of Assessment

Nonrivalrous Media

New opportunities

Page 18: Openness and the Future of Assessment
Page 19: Openness and the Future of Assessment
Page 20: Openness and the Future of Assessment

Free Copy, Distribute, Edit

Technology enables us to share and educate as never before

Page 21: Openness and the Future of Assessment

Except We Can’t

© forbids copying, distributing, and editing

Page 22: Openness and the Future of Assessment

© Cancels the Possibilities

Of digital media and the internet

Page 23: Openness and the Future of Assessment

InternetEnables

What to do?

CopyrightForbids

Page 24: Openness and the Future of Assessment
Page 25: Openness and the Future of Assessment

Use copyright to enforce sharing

Page 26: Openness and the Future of Assessment
Page 27: Openness and the Future of Assessment

The 4Rs

Reuse – copy verbatimRedistribute – share with others

Revise – adapt and editRemix – combine with others

Page 28: Openness and the Future of Assessment

2003-05

2003-08

2003-11

2004-02

2004-05

2004-08

2004-11

2005-02

2005-05

2005-08

2005-11

2006-02

2006-05

2006-12

2007-03

2007-06

2007-11

2008-02

2008-05

2008-08

2008-11

2009-02

2009-05

2009-08

2009-11

2010-02

2010-05

2010-08

2010-11

2011-02

2011-05

0

50,000,000

100,000,000

150,000,000

200,000,000

250,000,000

300,000,000

350,000,000

400,000,000

450,000,000

Over 400 Million Items

Page 29: Openness and the Future of Assessment
Page 30: Openness and the Future of Assessment

The “Open” in OER, OCW, &c.

(1) Free (2) 4R permission

Page 31: Openness and the Future of Assessment
Page 32: Openness and the Future of Assessment
Page 33: Openness and the Future of Assessment
Page 34: Openness and the Future of Assessment

InternetEnables

OERAllows

Sharing and educating at unprecedented scale

Page 35: Openness and the Future of Assessment

OER = Content Infrastructure

Platform for education innovation

Page 36: Openness and the Future of Assessment
Page 37: Openness and the Future of Assessment

Informal Learning

Open, standards-based way to issue, manage, and display credentials

for ANY learning

Page 38: Openness and the Future of Assessment
Page 39: Openness and the Future of Assessment

Transcript 2.0

Fixes many problems with current transcripts

Page 40: Openness and the Future of Assessment
Page 41: Openness and the Future of Assessment

OBI = Credential Infrastructure

Platform for education innovation

Page 42: Openness and the Future of Assessment

Open Education Infrastructure

Democratizes innovation opportunities

Page 43: Openness and the Future of Assessment

OER

LearnAnything

Badges

IssueManageDisplay

Credentials

Page 44: Openness and the Future of Assessment

OER

LearnAnything

Badges

IssueManageDisplay

Credentials

Assessment?

Page 45: Openness and the Future of Assessment

Mind the Gap!

HUGE demand over the next 10 yearsEntrepreneurs are on their way

Page 46: Openness and the Future of Assessment

Anywhere, Free

If I can learn anywhere for free,and show my credentials anywhere for free…

Page 47: Openness and the Future of Assessment

Assess Anywhere, Free?

What does this look like?

Page 48: Openness and the Future of Assessment

1. Ubiquitous Assessment

“Assessment as Status Update”(Tweets, product and book reviews, etc.)

Page 49: Openness and the Future of Assessment

Ubiquitous Assessment

What kind of infrastructure does this require?

Page 50: Openness and the Future of Assessment

Ubiquitous Assessment

No one is working on this infrastructure

Page 51: Openness and the Future of Assessment

2. Leveraging Big, Messy Data

10s of 1000s of tiny data points per personspread across a year

User-generated items

Page 52: Openness and the Future of Assessment

Leveraging Big, Messy Data

What kind of psychometrics are needed to deal with this?

Page 53: Openness and the Future of Assessment

3. From Summative to Formative

The majority will be formative

At scale does formative function as summative?

Page 54: Openness and the Future of Assessment

From Summative to Formative

How will the role of high stakes assessments evolve?

Page 55: Openness and the Future of Assessment

4. Scaling Constructed Response

We can’t condemn next-gen assessment to selected response

Page 56: Openness and the Future of Assessment

Scaling Constructed Response

“Gamify grading”

Page 57: Openness and the Future of Assessment

Google’s ESP Game

A symmetric verification game

(Verbosity is an asymmetric example)

Page 58: Openness and the Future of Assessment
Page 59: Openness and the Future of Assessment

For Example, In Education

• Rubrics• Multi-person Review• Inter-rater Reliability Component• Sanity Sampling

Page 60: Openness and the Future of Assessment

Future Assessment?

Analog or Digital

Tethered or Mobile

Isolated or Connected

Generic or Personal

Consuming or Creating

Closed or Open

Page 61: Openness and the Future of Assessment

Key Trends

Ubiquitous assessmentFrom summative to formative

Leveraging big, messy dataScaling constructed response

Page 62: Openness and the Future of Assessment

Expand Our Thinking

Beyond traditional educationBeyond traditional psychometrics

Beyond traditional assessment

Page 63: Openness and the Future of Assessment

Thank You

http://davidwiley.org/