Building eAssessmentBuilding eAssessmentBuilding eAssessmentBuilding eAssessment

Michael Gwyther

Connect with the Centre:twitter.com/VET_Centre

facebook.com/VETDevelopmentCentre

linkedin.com/company/vet-development-centre

vetcentre.vic.edu.au/research-and-reports

Subscribe to VET news and updates:

• What is e-assessment?• Facilitating webinar based assessments• Facilitating discussion forum based assessments• Group work projects• Principles and tools for mobile evidence capture and

submission• Student productivity and digital information organisation• Tools and approaches for student placement reporting• Principles for developing self paced assessment tasks

Today’s Agenda

ASQAASQA

ASQAASQA

When I hear the phrase e-Assessment I think……………….

Burning QuestionsBurning Questions

I am using e Assessments for:

•A I don’t use e Assessments•B Self Paced Learning•C Group Tasks•D Skills Demonstration•E Something else…

Burning Questions

What is e-Assessment?

E-assessment is the use of information technology for any assessment-related activity.

Assessment Distribution & Collection

Assessment Distribution & Collection

Assessment Response

Assessment Response

Assessment ManagementAssessment Management

Assessment Verification

& Moderation

Assessment Verification

& Moderation

Learners need to know:

1.What they must demonstrate to you as the trainer to show workplace competency

2. How they need to demonstrate competency

3. What methods you as the trainer will use to measure and assess their competency.

eAssessment

• Elements and performance criteria• Required skills and knowledge• Critical aspects of evidence• Employability Skills

(usually embedded in the unit of competency)

Assessment Design Tool Principles

Assessment Mapping Tool

Direct Evidence – things that we, as assessor, observes first-hand, e.g., observation, work samples

Indirect Evidence – things that someone else has observed and reported to us, e.g., third party reports

Supplementary Evidence – other things that can indicate performance, such as training records, questions, written work, portfolios

Types of Evidence

Develop an assessment model for a blended delivery approach

Face to Face

Face to Face

Self Paced

Self Paced

Online Facilitated

Online Facilitated

Modes of DeliveryModes of Delivery

Face to Face Self PacedOnline

Facilitated

Content

Activities

Assessment

Skills, Knowledge, Critical aspectsSkills, Knowledge, Critical aspects

Face to Face Self PacedOnline

Facilitated

Content

Skills KnowledgeActivities

Assessment

Applying a blendApplying a blend

Direct demonstration/observation

Indirect demonstration

Products

Workplace documents

Questions -  written and oral

Assignments

Third party reports

Self-assessment

Simulation

Portfolios

Indirect demonstration

Products

Workplace documents

Assignments

Third party reports

Self-assessment

Simulation

Portfolios

Products

Questions -  written and oral

Assignments

Third party reports

Examine your assessmentsExamine your assessments

Work in pairs, 10 minutes to discuss and list:

•What do we need to do to ensure our e-assessments are valid, current, sufficient and authentic?

•Enter answers athttp://tinyurl.com/qxku23n

eAssessment Principles

Issues and Concerns• Identity• Cheating• Skills• Variety of assessment• Information retrieval• Just online• Content• Isolation• Teachers• Storage• Literacy & Numeracy skills

Issues and Concerns• Identity – Personal data and questions• Cheating – Turnitin & random tutor contact• Skills – Online for Knowledge, F2F for skills• Variety of assessment - • Information retrieval – Problems, DMT• Just online – Blend with webinars & F2F• Content – Mix of video, case study, procedures,

problems.• Isolation – Social network, forum, FAQ, webinars• Teachers – Webinar, contact, forum support• Storage –intuitive navigation, location, privacy law,

integration with SMS systems and services

e-Assessment Scenariose-Assessment Scenarios

Work in pairs, 10 minutes each. 1 talk, the other document at: http://tinyurl.com/p5k75fr

Think of an existing assessment task ready for an e-assessment treatment. Describe the existing task and list:

A What the student needs to demonstrate?B Type of Assessment methodC Type of evidence you need to collectD Potential issues in using e with this assessment

Your eAssessment

e-Assessment methodse-Assessment methods

Trends - Quiz

• Tend to be knowledge retrieval• Align to required knowledge in work context• Put comprehension questions in context• Make a sub set of questions reflecting workplace

process• Mix up types

(MC, T or F, Matching, Short answer, cloze)• Ask less questions & focus on good distracters• Attempts, Feedback and randomisation

Self Paced Content – Writing Quizzes

Trends - Webinar

Plan an assessment activity for webinar delivery

In pairs, share 3 ways student focused webinars could contribute to assessment at your RTO for a specific qualification

http://tinyurl.com/ltcgh8l

Suggestion

Trends – Mobile Evidence

What do we need to consider when giving instructions to learners who use Video, Audio, Images and Text to demonstrate a skill for Assessment?

Demonstration Assessment Principles

•Visual evidence (Camera Phone)•Documented Evidence & Checklists (Evernote, Writable PDFs, Google forms)•Phone Casting (iPadio)•Group Work verification (Wikis)

Assessment

• ipadio combines the telephone with the blog to create an audio “phonecast” which is streamed Live to the Internet.

You can phonecast from any phone, anywhere in the world - no need for a computer or even access to the Internet.

•Learner can call in their responses via phone call. iPadio then converts the audio into a blog post accessible online. No software or app is required by the caller.

iPadio

• Use your mobile• Call 1800-802569• Enter registered number

1161409317625 or 1161353317625• Enter PIN – 5676• Talk when prompted• When finished access at

http://www.ipadio.com/phlogs/MichaelGwyther/

Share an opportunity to use eAssessment in your course delivery? Share an opportunity to use eAssessment in your course delivery?

Phlogging Example

Mobile Evidence Apps

How might your RTO verify evidence capture from mobile devices or apps off site or from remote learners?

Question

Trends – Discussion & Social Learning

Give an example of a discussion forum topic that could work with your learners

Activity 6

•Link to assessment

•Base on participants sharing experiences & prior knowledge – “learners stories”

•Application to workplace or experience

•Make pre readings short

•Mix of problems, case studies, reflections

•Commenting/Building on postings

•Use to demonstrate employability skills

•Track to determine contribution to group

•Peer Review

Discussions

Work in pairs – 15 minutesGet involved in the discussion at:http://tinyurl.com/k3dqegc

Describe a task you could use as a discussion forum assessment.Consider the relevant factorsWhat are the major issues for you to make this work?

Burning Questions Discussions

Workplace futures•Digital collaboration•Moving from Training to Performance Support•Social and Collaborative Learning•Information management

Student productivity & digital information organisation

•Digital Information collation, storage and retrieval•Sharing of resources•Paper less assessment and reporting

Productivity

•Cloud Storage (e.g. DropBox)•Social Media (Twitter, LinkedIn, Instagram, Facebook)•Social Bookmarks•Blogging•Electronic signing

Productivity Tools

•Learner/Trainer Digital Literacy•Cloud Storage•Responsiveness/Visibility•Knowledge management and “curation”

Productivity Issues

What productivity tools do you/could you use?

Productivity Issues

Take 10 minutes to review your original e-assessment idea. You will talk to these points:

A What the student needs to demonstrate?B Type of Assessment methodC Type of evidence you need to collectD Potential issues in using e with this assessment

After each presentation we’ll complete a short peer review to feed back on the task and suggest ideas!

http://tinyurl.com/kcgsx5n

Don’t be critical – be positive and seek to improve the task for the presenter

Share your eAssessment for peer review!

Trends - Simulation

Trends - Questioning

Trends - Placement

•Common Issues•Make assessment responses visible•Broaden industry knowledge•Third party reports•Confidentiality and non disclosure

Sharing placement

Sharing placement

RubricMapMarking GuidePresentations/SubmissionCollect peer reviewShare & Asses

Trends – Group work & Peer review

How do you use Group work assessments?

What information do you need to collect to gauge an individuals contribution to the group’s output?

Group work assessments

Trends – Demonstration becomes content

Trends – Decision Making Trees

Quiz

TopicTopic TopicTopic TopicTopic

Sequence (Comprehension)

Topics

Topic 1

Topic 2

Topic 3

Branch (Sequence & Choice)

Catchup

Catchup

Catchup

Catchup

Catchup

Catchup

Conditional (Decision making tree)

Content in Decision making trees

Catchup

Catchup

Catchup

Catchup

Catchup

Catchup

Complex Conditional (Decision making tree)

TopicTopic TopicTopic

Conditional (time/mark)

Decision making treesSelf Paced Content

Self paced content – Cathy Moore

Pull not PushSelf Paced Content

Pull not PushSelf Paced Content

Think of a difficult or dull process you need your learners to understand.

Describe a scenario that might work for this content

Burning Question

Draft a scenario

Draft a scenario

Closing remarks & Evaluation

You will receive an email introduction to our Resource Portal where you can download your certificate of attendance and other resources from today’s workshop