24
ASSESSMENT IN 3D VIRTUAL WORLDS: QTI IN WONDERLAND Diego Morillo Arroyo, Patricia Santos Rodríguez David Pérez Calle, Carlos Delgado Kloos María Blanca Ibáñez Espiga, Davinia Hernández-Leo

Assessment in 3D virtual worlds

Embed Size (px)

DESCRIPTION

This presentation explains the assessment engine performed by the UC3M and the UPF to include IMS QTI in Open Wonderland

Citation preview

Page 1: Assessment in 3D virtual worlds

ASSESSMENT IN 3D VIRTUAL WORLDS:

QTI IN WONDERLAND

Diego Morillo Arroyo, Patricia Santos Rodríguez

David Pérez Calle, Carlos Delgado Kloos

María Blanca Ibáñez Espiga, Davinia Hernández-Leo

Page 2: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

2

Page 3: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

3

Page 4: Assessment in 3D virtual worlds

3D virtual worlds:

Simulation of immersive environment Users are represented by avatars Interaction among users Interaction with objects

Virtual worlds lacks of some learning elements:

Learning objects Instructional design Intended learning outcomes Management of roles Assessment

INTRODUCTION

4

Page 5: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

5

Page 6: Assessment in 3D virtual worlds

3D ASSESSMENT(I)

6

New mechanisms for assessment are necessary

Virtual worlds allow the assessment of knowledge and competences

The user’s attention must be maintained (flow) Embedded assessment

Page 7: Assessment in 3D virtual worlds

3D ASSESSMENT (II)

7

Different virtual worlds have been used to asses students:

River City Quest Atlantis Second Life quizHUD

Page 8: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

8

Page 9: Assessment in 3D virtual worlds

ACTIONS: PROMPT

9

It can be showed in different ways:

A text message Talk with a NPC (AIML) An audio message

Students can do several actions to get the instructions: Approach to a NPC Select a NPC Select an object Access to a zone

Page 10: Assessment in 3D virtual worlds

ACTIONS: ANSWER

10

Students can do several actions:

Select an element in the virtual world NPC Object Zone

Talk with a NPC (AIML language)

The different options among student have to choose can :

Be visible all the time Appear when students get the instructions Disappear when students give their answer

Page 11: Assessment in 3D virtual worlds

ACTIONS: FEEDBACK

11

Different types of feedback:

Question’s feedback A text message Insert an image An object can appear An object can disappear Play an audio file

Test’s feedback Students receive their feedback and their final score

Page 12: Assessment in 3D virtual worlds

HELP SYSTEM

12

The time between the answer of a question and the beginning of the next one must be reduced

A track can be added to every question It is used to guide students toward the next question

Students use the menu bar to access to the track

Page 13: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

13

Page 14: Assessment in 3D virtual worlds

Questions are loaded from external files

The files are defined following the IMS QTI specification

This engine implements questions of the “multiple-choice” type

This engine is formed by:

NewAPIS Open Wonderland

FEATURES

14

Page 15: Assessment in 3D virtual worlds

QTI engine v2.1

Management of test Management of questions

It loads the QTI XML files

It manages the students’ answer

It stores all the assessment data, checks the answer of the students and calculates their scores

NEWAPIS

15

Page 16: Assessment in 3D virtual worlds

Open Source

It is written entirely in Java

It is a distributed client-server architecture

A WebDav-based content repository is hosted in the server

Its functionality is divided in different modules

OPEN WONDERLAND (I)

16

Page 17: Assessment in 3D virtual worlds

OPEN WONDERLAND (II)

17

Main features:

It supports desktop application sharing Integration with external data sources It has spatial sound capabilities It allows the communication among students

Chat Audio

Different users can see different objects

Page 18: Assessment in 3D virtual worlds

Virtual worlds introduce new interactions that there are not considered in QTI

This engine use two files:

QTI XML file It is managed by newAPIS

WL-QTI XML file It is managed by Wonderland It relates every part of a question with the corresponding

object in the virtual world It includes additional information

18

THE EXTENSION OF QTI (I)

Page 19: Assessment in 3D virtual worlds

19

THE EXTENSION OF QTI (II)

Page 20: Assessment in 3D virtual worlds

COMMUNICATION

20

Page 21: Assessment in 3D virtual worlds

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

21

Page 22: Assessment in 3D virtual worlds

Virtual worlds allow the assessment of students in a richer way

The use of the IMS QTI specification allows:

Reuse of existing assessment content Use an existing QTI engine that can manage the

actions that are not directly related with the virtual world

CONCLUSION

22

Page 23: Assessment in 3D virtual worlds

Include new types of questions It allows the management of new interactions in the virtual world

Improve the management of test

Create an authoring tool to create the WL-QTI files

Add different capabilities for objects in the virtual world by processing the WL-QTI file

Use this assessment engine in a real education context

FUTURE WORK

23

Page 24: Assessment in 3D virtual worlds

DEMO

24

You can see it in:

http://www.youtube.com/watch?v=3zVyPT3oh4E