Edupub day1 ims spec

© 2014 IMS Global Learning Consor7um, Inc. All Rights Reserved

Colin Smythe (IMS Chief Architect) [email protected]

The IMS Specifica7ons for Learning Content: Common Cartridge, LTI, QTI/APIP, Caliper and EDUPUB

1


Talk Objec7ves

•  To introduce the following IMS Standards and ac7vi7es: –  IMS Learning Tools Interoperability® (LTI®) –  IMS Common Cartridge™ (CC) –  IMS Ques7on & Test Interoperability® (QTI®) –  IMS Accessible Portable Item Protocol™ (APIP) –  IMS Caliper Learning Analy7cs – EDUPUB

2


Timetable

3

Time Topic

14:00-‐14:30 Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability

14:30-‐15:00 Interoperable Assessment: QTI, APIP and EDUPUB QTI

15:00-‐15:30 Break

15:30-‐16:00 Making Educa7on Data Easy: Caliper Analy7cs

16:00-‐16:30 IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community


Biography

•  Joined IMS in May 1999 •  Responsible for the development of many IMS specifica7ons inc. Ques7on & Test Interoperability (QTI), Content Packaging, Accessible Portable Item Protocol (APIP), Learning Informa7on Services (LIS), etc.

•  Currently IMS Chief Architect and responsible for: –  How the specifica7ons fit together –  Overseeing the technical details of the specifica7ons –  Suppor7ng adop7on of the specifica7ons

4


Ques7ons & Comments

5


•  Plug & Play Educa7onal Apps and Content: Common Cartridge and Learning Tools Interoperability

•  Interoperable Assessment: QTI, APIP and EDUPUB QTI

•  Making Educa7on Data Easy: Caliper Analy7cs •  IMS Standards in Ac7on: EDUPUB Demonstra7on & Development Community

6


What is Common Cartridge? •  Common Cartridge (CC) is a specifica7on for packaging and exchanging learning and assessment content

•  The CC package dis7lls the latest and best community prac7ces for sharing digital content among authoring tools and learning plaborms

7


Because learning plaborms and authoring tools are all different, there is a need for a standard interoperable format.

The Problem for CC to Solve

8


What CC Does

9


A Common Cartridge Common Cartridge

Cartridge meta-dataOrganizationResources resource meta-data

imsmanifest.xml

Object bank

Web Content Folder

Resource 1

Resource n

Resource Folder 1

Resource a

Resource n’

Resource Folder n

Resource x

Resource n’’

LTI Resource type for integration with web applications and eBooks.

Extended roles meta-data vocabulary {Instructor, Learner, Mentor}

Multilingual support using alternative resources for web content and assessments

Learning objectives assigned to resources using curriculum standards

Assessment resources now include instructions to guide the learner in completing the assessment

Human readable lesson plans provided to guide the instructor in using the cartridge content

10


Supported Content Formats •  IMS-‐derived

–  QTI Assessments & Object Banks

– Web Links/URLs –  LTI Links –  Discussion Topics –  Interac7ve White Board (IWB) –  Accessible Portable Item Protocol (APIP)

11

•  Other – Web Content (HTML)

– Web Content (non-‐HTML)

–  EPUB3 –  Extension


Thin CC

•  Requirements are: –  Acts as a TOC for externally hosted content –  Support K-‐12 specific metadata –  Allow conformance against Thin CC features only

•  Constraints are: –  A CCv1.3 system should be able to import/export Thin CC without change

•  Only Permijed Content – Web Links/URLs –  LTI Links

12


IMS Validator

13


CC Conformance Program •  Membership in the Common Cartridge Alliance is

the only way to achieve official conformance to the CC.

•  Digital content or learning plaborms must exhibit the marks shown here, signifying achievement of the official conformance process, to be compliant with IMS Common Cartridge.

•  Products without this mark are not considered to be compliant by IMS Global.

14

hjp://www.imsglobal.org/developers/alliance/conformance.cfm


CC Adop7on

•  A wide range of systems suppor7ng CC impor7ng (read), expor7ng (write) and rendering (play) – hjp://www.imsglobal.org/cc/statuschart.cfm

•  ‘Thin CC’ conformance soon •  CCv1.4 under development by APMG

15


Learning Tools Interoperability

•  To enable Remote Tools and Content to be easily integrated into, and accessed from, an LMS (not limited to LMSs)

•  Several versions now available to support evolving requirements

•  Key concepts are the: – Tool Provider (TP) and Tool Consumer (TC)

16


17

Launch++

Tool Consumer Tool Provider

TC Admin

Tool Proxy Run7me

TP Admin

Tool Proxy Run7me

Tool

Secret

Tool Proxy

Secret

TC User

IMS Learning Tools Interoperability (LTI)

Outcomes

Roster

Seongs Profile

Tool

Profile


LTI & Common Cartridge

18

L M S Premium

Learning Content

Common Cartridge

L M S

When LTI is combined with the IMS CC publishers can distribute cartridges containing ac7ve, authen7cated links back to centrally hosted content.


LTI 1.0/1.1 Messaging Tool Provider

Tool Consumer

Admin

1. URL, key, secret

2. Configure

3. Click link

System Administrator

Teacher or Student

Outcomes service (read, update, delete)

19

Out-‐of-‐band connec7on Browser connec7on Server-‐to-‐server connec7on


LTI 1.2 Messaging

Tool Provider

Tool Consumer

Admin

1. URL, key, secret

2. Configure

3. Click link


Teacher or Student

Outcomes service (read, update, delete)

20



Learning Tools Interoperability v2.0

•  LTIv2.0 is LTIv1.0 on steriods! – Now a plaborm for suppor7ng the en7re lifecycle of a tool with:

•  Service discovery •  An extensible service framework (core+custom)

– Uses REST/JSON-‐LD as the binding form

•  An excellent tutorial is available at –  hjp://developers.imsglobal.org/tutorials.html#l72

21


LTI v2.0 Messaging Tool Provider

Tool Consumer

Admin

1. Tool registra7on

4. Enable tool(s)

6. Click link


Teacher or Student

Tool

22



Comparison of LTI Versions

23

Feature LTI 1.0

LTI 1.1

LTI 1.2

LTI 2.0

Comment

Basic Launch X X X X LTI2 reduces op7onal data requirements

Simple Outcomes X X X Return single numeric value.

TC Profile X X Metadata for the TC’s available services.

Tool Proxy X Metadata for the TC/TP interface contract.

Creden7al Mangmt X Automa7c secure exchange of key/secret.

Registra7on Flow X TC ini7ated new tool provisioning.

Model-‐Driven Doc X X Tool generated docs from UML.

REST Services X X LTIv1.2 limits REST to TC only.


LTI Conformance Tes7ng •  The LTI Conformance Test System

–  hjp://www.imsglobal.org/developers/alliance/LTI/cert/index.php

•  Separate tes7ng for the Tool Provider and Tool Consumer

•  Follow the associated test script to drive the predefined set of tests

•  See the Screencasts that describe how to use the LTI Conformance Test Systems –  hjp://www.imsglobal.org/developers/alliance/LTI/cert/demo/

24


LTI Adop7on

•  Extensive range of LTI cer7fied tools now available – hjp://developers.imsglobal.org/catalog.html

•  Working with the community to move towards LTIv2.0 adop7on

25





26


The QTI Specifica7on •  It is a specifica7on to support the exchange of Ques7ons (Items) and Tests (Assessments) and to Report the associated outcomes. The objec7ves are to: –  Be pedagogy independent –  Support common & esoteric ques7on types –  Cover the func7onally ‘low-‐lying fruit’ –  Enable rich feature support in the future –  Support accessible content needs –  Support summa7ve and forma7ve tes7ng

27


Historic Perspec7ve

28

Version Date Descrip>on

QTIv1.0 June 2000 Original QTI release based upon basic research by ETS and the Four Process Cycle.

QTIv1.1 Mar 2001 Inclusion of new ‘flow’ structure to support block-‐based content. Release of QTI-‐Lite.

QTIv1.2 Feb 2002 Addi7on of Results Repor7ng, Selec7on & Ordering of Sec7ons, Outcomes Processing for Tests.

QTIv1.2.1 Mar 2003 Set of correc7ons to the QTIv1.2 release.

QTIv2.0 Jan 2005 New QTI Item model. Based upon XHTML. Reworking of ques7on structures using new set of Interac7ons.

QTIv2.1 Jan 2013 Full QTI reworking to include Tests and Sec7on. New support for QTI Metadata, Results Repor7ng and Usage Data Sta7s7cs.


The Four Cycle Process

29

Summary Feedback Assessment/sec>on

Processing Item Response Processing

Presenta>on Process

Ac>vity Selec>on Process

Item Level Feedback

Task/Evidence Composite Library

Examinee Administrator


30

Assessment, Sec7ons & Items •  Assessment

– The Test, Quiz, etc. •  Testpart

– Subtests •  Sec7on

– Groups of Sec7ons/Items •  Item

– The ques7on


A Deconstructed MC Ques7on

31

•  Extensive range of Interac7on types •  Response Processing •  Various levels of Feedback •  Response Processing Templates •  Outcomes Processing •  Hints plus scoring implica7ons •  Template-‐based Item construc7on •  Alterna7ve accessibility content •  Item-‐level rubric


The set of Interac7ons •  associateInterac7on •  choiceInterac7on •  customInterac7on •  drawingInterac7on •  endAjemptInterac7on •  extendedTextInterac7on •  gapMatchInterac7on •  graphicAssociateInterac7on •  graphicGapMatchInterac7on •  graphicOrderInterac7on

32

•  hotspotInterac7on •  hojextInterac7on •  inlineChoiceInterac7on •  matchInterac7on •  orderInterac7on •  posi7onObjectInterac7on •  selec7onPointInterac7on •  sliderInterac7on •  textEntryIntera7on •  uploadInterac7on


Packaging the QTI -‐ I

33

IMS Content Package

AssessmentItem

AssessmentSec7on

AssessmentTest

*

*

imsmanifest.xml

Folders Folders Folders

•  Audio •  Video •  Images •  Tools •  etc.

Assets


Accessible Portable Item Protocol (APIP)

•  To enable the exchange of accessibility-‐enabled Tests & Ques7ons using a common format

•  To include support for a wide range of physical and cogni7ve accessibility needs

•  Combines IMS QTI with the IMS Access for All Personal Needs & Preferences (AFA PNP) v2.0 specifica7ons plus:-‐ –  Extensive profiling –  Addi7on of new specifica7ons

•  APIPv1.0 released in May 2012 –  hjp://www.imsglobal.org/apip/index.html

34


QTI/APIP APMG & Conformance

•  QTI/APIP APMG responsible for the specifica7ons and conformance

•  Conformance against: –  Profile e.g. APIP (more to be added) –  Baseline Specifica7on

•  Conformance of: – QTI Packages – Authoring Systems, Delivery Systems, Item/Test Banks

35


QTI/APIP Adop7on •  Several authoring systems have been cer7fied •  Race-‐to-‐the-‐Top Assessment

–  An ini7a7ve in the USA to encourage K-‐12 in the States/Districts to adopt standards-‐based online assessment ($400millions)

–  Adop7ng the IMS QTI/APIP Standard for accessible assessment interoperability

•  Netherlands Department of Educa7on –  Deploying a country-‐wide schools-‐level online assessment system for

assessment authoring, delivery and results repor7ng –  Working with IMS to develop the Dutch DoE Assessment systems

conformance cer7fica7on process based on QTIv2.2

36


EDUPUB IMS Work Summary Ini7al best prac7ces doc and code base (using Readium) published: hjp://www.imsglobal.org/edupub/index.html •  LTI enablement •  Caliper analy7cs enablement •  QTI enablement

37


IMS EDUPUB Technology Context

Student Information

System (SIS)

Learning Management

System (SIS)

Learning Management

System (SIS)

Learning Management

System (LMS)

ePub Reader

eBook

Analytics System

Assessment System

Enrollments Outcomes

Gradebooks Timetables Assessment

Outcomes Scores

Tracking

Tracking Scores Outcomes …

Outcomes Gradebook Tracking Scores

3rd Party Tools/Apps

38


LTI-‐Enabled QTI Approach

39


EPUB3-‐Embedded QTI Approach

40


Proposed Workflow

•  Forma7ve Assessment (Quiz) supplied in QTI-‐XML Package (reference form)

•  Transform from the QTI-‐XML to the target EDUPUB formats and embed in EPUB3

•  Add the JScript libraries to provide the run-‐7me features e.g. naviga7on, response processing, analy7cs repor7ng, etc.

•  Complete EPUB3 packaging and release

41


Best Prac7ces Doc

© 2014 IMS Global Learning Consortium. All Rights Reserved. The$IMS$Logo$and$Learning$Tools$Interoperability®$(LTI®),$Accessible$Portable$Item$Protocol™$(APIP™),$Question$and$Test$Interoperability®$(QTI®),$Common$Cartridge™$(CC™),$AccessForAll™,$Caliper$Analytics™$and$Sensor$API™$

are$trademarks$of$IMS$Global$Learning$Consortium,$Inc.$in$the$United$States$and/or$other$countries.$

Using IMS Caliper Analytics™, Question and Test Interoperability™ and Learning Tools Interoperability™ with EPUB3TM:

EDUPUB Best Practices

Title: Using IMS Caliper, Question & Test Interoperability (QTI) and Learning Tools Interoperability (LTI) with EPUB3: EDUPUB Best Practices

Authors: Lisa Mattson (IMS Global, USA) Colin Smythe (IMS Global, UK) Stephen Vickers (IMS Global, UK) Thor Anderson (IMS Global, USA) Chris Vento (Intellify Learning, USA) Prashant Nayak (Intellify Learning, USA)

Version: PUBLIC DRAFT

Version Date: 16th June 2014

Release: 1.0

Status: Discussion Document

Summary: This document presents the best practice recommendations for using IMS Learning Tools Interoperability™ (LTI™), IMS Caliper Analytics™ and IMS Question & Test Interoperability™ (QTI™) based content within an EPUB3 context. These form a key part of the EDUPUB standard. Examples of these best practices are presented using the Readium open source EPUB3 reader but are generally applicable to other EPUB3 readers provided they follow the conformance requirements.


IMS EDUPUB Recommenda7ons

•  Ensure eBook/EPUB3 readers are IMS LTIv1.1 compliant

•  Ensure eBook/EPUB3 readers are IMS Caliper compliant

•  Ensure eBook/EPUB3 readers become IMS LTIv2.0 compliant

•  Establish best prac7ces for using these in EPUB3 publica7ons

43


IMS EDUPUB Informa7on

44

hjp://www.imsglobal.org/edupub/





45


IMS Learning Analy7cs

•  This is the IMS framework for standardizing the collec7on of learning metric data and the dissemina7on of learning analy7cs informa7on

•  IMS is concerned with learning analy7cs interoperability i.e. data collec7on from disparate systems and informa7on repor7ng to other disparate systems

46


47


The Metric Profiles

48


Caliper Events

49


Sensor API Service Framework

•  Different tools, apps, systems and content will drive the local Sensor API

•  Sensor API is responsible for: –  Sending data to a service end-‐point (normally a learning analy7cs repository)

–  Ensuring the data is protected during transmission –  Only accessed by an authen7cated service-‐end point

•  Open issues –  Offline usage/data caching/data synchroniza7on –  Content-‐based/tool-‐based Sensor API usage/interac7ons

50


Sensor API & Metric Profiles

•  Defining the set of Caliper Events for some MPs •  Current set of MPs being defined are:

–  Reading -‐ reading textual content – Assessment -‐ undertaking a test or quiz – Annota7on -‐ annota7ng content –  Performance – grading/scoring of some content – Media – interac7on with video/audio systems

51


Caliper & LTI

•  LTI launch of a tool that supports the Sensor API e.g. eBook reader

•  Use LTI to provide the key informa7on for the learning context – Supplied as LTI launch parameters –  Id for the learner, etc.

52


Caliper EDUPUB Deployment

53

ePub Reader

Widgets (ePub3)

edu Apps (LTI)

edu App (LTI)

Learning Environment

Widget(s) (ePub3)

edu App (LTI)

Analy>cs Data Store

Caliper (Sensor Endpoint)

S

S

S

S

S = Caliper Sensor

LTI (Consumer)

LTI (Provider)

LTI (Provider)

LTI (Consumer)

Reading Metrics

LMS Metrics

Widget Metrics

edu App Metrics

edu App(s) (LTI)

A = AuthN Service

A

A


The Learning Analy7cs Repository

•  The digital repository to which the Sensor API sends its data

•  Must support the Sensor API i.e. receive and store the caliper event data

•  Must provide some of:-‐ – Analy7cs algorithms –  Informa7on visualiza7on –  Informa7on export/repor7ng –  Repository-‐to-‐repository exchange

54


Learning Analy7cs Repository API

•  This has not been defined yet •  May include:

–  Capability to read Sensor sourced data –  Capability to read processed data –  Exchange data with another LA repository

•  Constraints are: – Authen7cated access –  Permijed access to specific Sensor data

55


Defining a Metric Profile

•  Iden7fy the learning ac7vity •  Define the set of state diagrams/tables •  Create the event label vocabulary •  Establish the set of parameters for each caliper event

•  Define the learning context/descrip7on informa7on

56


Caliper Conformance Process

•  This is not yet agreed •  Will be based upon a tool/app/system/content:

–  Sensor API ‘on-‐the-‐wire’ messages –  Confirm correct opera7on specific MPs –  Require the vendor to create test content to drive the Sensor API to produce the required set of messages

–  Sensor API messages logged at IMS Sensor Conformance Test Repository and analysed for correctness

57


Caliper Timeline

•  Alpha release of Sensor APIs (Sept 2014) •  Alpha release of MPs (Sept 2014) •  IMS Quarterly mee7ng (Nov 2014)

– Beta release of Sensor APIs – Beta release of MPs – Sensor API v1.0 Specifica7on Public Draz –  Ini7al set of MP Specifica7ons as Public Draz

58





59


EDUPUB Desk-‐top Demonstra7on

60

•  Desktop version of Readium •  Accessed using Chrome/Readium app •  Standard Readium distribu7on •  Only embedded Quiz access available


TAO QTI Demonstra7on

61

•  Using TAO Test Delivery System •  TAO hosted service •  Same test as per EDUPUB demonstra7on

•  Imported the test as an IMS QTIv2.1 Package


62


63


64


65


Caliper & EDUPUB Demonstra7on

66

•  Using IMS hosted Moodle •  Using IMS version of Readium •  Same test as per EDUPUB local demonstra7on •  LTI-‐based access to

•  Caliper Repository •  Ques7onmark remote test delivery system


Readium Codebase

•  Readium is an open source EPUB3 reader ini7a7ve (grew from IDPF but now standalone ac7vity)

•  Readium used as our EPUB3 reader codebase (Hosted service and desktop versions)

•  IMS has made a code fork for the EDUPUB work –  LTIv1.0 enabled (Consumer and Provider) –  Sensor API enabled

67


68


69


70


71


72


Making Adop7on Easy

•  Interoperability is a means to the end of improving learning impact

•  Moving from just specifica7on crea7on to direct solu7on support via APIs and reference implementa7ons

•  IMS need more involvement from the developer community to improve our implementa7on aids

73


Boot-‐camps & Development

•  Bootcamps – Hands-‐on events on various IMS specifica7ons

– Use the various IMS test and implementa7on materials

– Work on APIs and implementa7on issues

74

•  Developer Community – Community App Store Architecture (CASA)

– Caliper/Sensor APIs – New community efforts to be announced shortly


Summary

•  E-‐learning interoperability is one way to improve learning impact

•  IMS has an extensive set of specifica7ons released and adopted throughout the World

•  The specifica7on focus is now on making it easier to adopt e.g. Bootcamps

•  The success of IMS is heavily dependent on the Members’ involvement in the IMS ac7vi7es and not just paying the membership fee

75


Ques7ons & Comments

76

Internet

Edupub day1 ims spec