Mirror reflective-learning-at-work-presentation-sept2012

MIRROR Reflective Learning at Work

Project lifetime: 2010-2014 Status and progress (Sept 2012)

© MIRROR Project - Co-Funded by EU IST FP7 – www.mirror-project.eu 0


MIRROR Partners


Agenda

▪ Overall MIRROR Vision & Approach

▪ MIRROR apps

▪ Design-based Research

▪ Year 2 Achievements

▪ Outlook into Year 3

▪ Dissemination and exploitation


Challenge: Training-on-the-job does not Scale Is THE training method employed by most SMEs

Often there is no teacher, no HR manager, no author, no learning content, ...

Individuals learn by observing others, by getting feedback from others, by reflecting on own experiences and by (informally) sharing experiences

Goal: Enrich other TEL Approaches with Computational Support for Reflective Learning (CSRL) Reflective learning allows to derive knowledge which is not explicitly

documented

Support reflective learning in distributed/virtual environments

Systematically support reflective learning in increasingly accelerated work conditions


It’s Personal

You learn for yourself

You learn what interests you

You learn when you are motivated

You learn from your own successes/mistakes

Your emotions play a large part in what you are learning

[Boud et al. 1985]

Reflective Learning – it‘s Personal

Individual is foremost target


It’s Social

You learn by observing others

You learn from help/guidance of others

You learn by sharing/benchmarking with others

You learn within a team/community/organization

A team/community/organization learns through you

[Boud et al. 1985]

Reflective Learning – it‘s Social

Privacy and trust are crucial for sharing


It’s Revisiting the Past

You rely on your memory

You learn by returning to your experience

You learn by re-evaluating your experience from a different point of view/with different emotions

[Boud et al. 1985]

Reflective Learning – it‘s Revisiting the Past

Augment the individual and collective memory


Augment memory to intensify and extend reflective learning

Encourage systematic and periodic learning by reflection during work

Allow effortless capturing and sharing of experiences

Provide guidance and baselines for effective reflective learning

Support articulation and construction of knowledge

Make learning by observation scalable within organizations

Enable learning by observation in distributed environments

Close the reflective learning loop between individuals, teams, communities, and organizations

Computer Supported Reflective Learning - What can it offer?


Project Objectives

Objective A: Refine the conceptual understanding of learning by reflection in the workplace and its contribution to a holistic treatment of knowledge in the organization

Objective B: Develop a variety of Methods and Apps for learning by reflection based on historical or captured user data and experiences

Objective C: Apply the developed reflection methods and Apps in diverse testbeds and evaluate learning effectiveness “in the wild”


Four Activity Streams to Integrate the Six Perspectives

WP4 WP5 WP6 WP7 WP8 WP3

Reflective Learning Model

User & Design Studies

Storyboards & Requirements

Interoperability Framework

Obj. A

Tech Obj.

Obj. C

D1.4

D1.2

D1.3

D2.1

D 3.1

D 4.1

D 5.1

D 6.1

D 7.1

D 8.1

D1.1


Reflection Topics in the Testbeds

Regola

Disaster and emergency

management

Target group Volunteers,

Rescue Managers

NBN

Physician Education,

Conversations with relatives

Target group Physicians,

nurses

RNHA

Dealing with challenging behaviour

Target group Caregivers, managers

INFOMAN

Sales presentations and standard

slides

Target group

Sales consultants

BT

Virtual meetings, learning design

Target group Learning

Professionals


Theoretical Basis: Reflective Learning (Boud et al.)


Computer-Supported Reflective Learning - Basic Idea

Collect Data

Reflect on Data


The MIRROR Vision


MIRROR APPS

See for our Apps showroom: http://www.mirror-project.eu/showroom-a-publications/mirror-apps-status


Apps in Development (excerpt)

MIRROR App Name Description

CroMAR Sensing of information from several public data

providers

Timeline App Articulation of experiences and annotations

Task Tracker Articulation of current tasks

Proximity Sensors Sensing of proximity and articulation

DocTrain Articulation of medical specialist training tasks

Live Interest Meter (LIM) Articulation of thoughts and personal feedback

MoodMap App Articulation of moods and related thoughts

Task Detection App Sensing of computer activities

Carer Articulation of events (challenging behaviours)

Microblogging for Care

Staff in Dementia Care

Homes

Articulation of observations and experiences

Prep App Articulation of experiences

Serious Game - Moodmap Articulation of game-related moods

Issue Articulation and

Management App

Articulation of issues


Sensors


Mood Map App


Mood Map App


WatchIT App


CROMAR App


LIM App


DocTrain App


Carer App


Task Detection App


iBeeper Framework


iBeeper App - driving activities


iBeeper App - sport activities


3D Serious Games: Interface

3D Virtual Hospital


3D Serious Games: Dialogues

Example of branching story


Talk Reflection App (NBN)


Issue Articulation App (NBN)


Issue Management App (NBN)


DoWeKnow App (INFOMAN)


DoWeKnow App (INFOMAN)


DESIGN-BASED RESEARCH


The Role of CSRL Model

App Development

CSRL Model

Testbed Practices Ev

alu

atio

n F

ram

ew

ork


Year 2 in Perspective

Year 1

AS IS Situation

Year 2

TO BE Situation

Year 3

Generalizability

Year 4

Evaluation

Focus on

project-internal

users

Extend focus

to wider user

communities


Year 1: Understand AS IS Situation - Focus on User & Design Studies

What can we learn about reflective learning as it happens today within concrete testbeds in order to intensify and extend reflective learning in the future?

What do people reflect about?

What triggers reflection?

Is there support for reflection in place?

What kind of data, tools, practices could support reflection?

In which way are reflection results shared (if at all)?

...

Reflection session: A time-limited activity framing processes of reflection


Year 1: Initial Structure of CSRL Model

TEL Project Results

Literature Surveys

Triggers Objectives Content Process Outcomes Timing Support

Reflection Session

User Studies

Design

Studies

14 user & design studies 64 participants


App Development

Computer-Supported Reflective Learning (CSRL) Model

Testbeds

Design-based Research (from Y1 to Y2)

E

v

a

l

u

a

t

i

o

n

User Studies

Design

Studies

Story Boards

& Requ.

Apps & Games

TEL Project Results

Privacy

Creativity Work-shops

Literature Surveys D1.5

Evaluation

Methodology

D1.3 Scenarios & Requirements

D1.4 CSRL Model

D2.2 Interoperability Framework

D10.2

Formative

Evaluation

Results

D3.2-D8.2 & D9.3B

App Development and

Theory Refinement


Year 2: Define TO BE Situation - Focus on App Development

How can we support reflective learning at the workplace with Apps?

Which role can apps play?

Which apps should be developed?

How should the apps work and look like?

In which situations should the apps be used?

How should the apps handle data?

How can apps share data?

What kind of interfaces work well?

Which problems occur when using the apps?

...


Initiate reflection

session

Work

Make information

available for reflection

Re-evaluate work

experience

Make sense of

available information

Plan to apply reflection outcome

Apply reflection outcome

Conduct reflection

session

From Y1 to Y2: Emerging CSRL Model


Year 2: Refined CSRL Model

Initiate reflection

session

Work

Make information

available for reflection

Re-evaluate work

experience

Make sense of

available information

Plan to apply reflection outcome

Apply reflection outcome

Conduct reflection

session

Story Boards

& Requ.

Apps

Evaluation Results

evaluation of 9 apps in 10 settings

14 apps

25 storyboards


Year 2: 14 Apps Developed


Year 2: Apps in Action - Evaluation of 9 Apps in 10 different Settings


Year 2: MIRROR Spaces Concept & Interoperability Framework ▪ Spaces for the data exchange between clients on

different platforms

▪ Support for private and shared reflection

▪ Application can be connected to multiple spaces


OUTLOOK INTO YEAR 3


Just providing data is not enough!

High Expectations and Unclear Nature of Reflection

Huge interest in data

Personal benefit can be observed

«so what?» Reflection Support is needed

Linking ‘data curves’ to events and causes requires more context

Comparison between yesterday/today, today/average, me/others, ... could help people to ask interesting questions

What did we learn in Year 2?

Awareness Reflective Learning


Major Results

CSRL Model v1

14 Apps

Interoperability Framework

Evaluation of 9 Apps in 10 Settings

Learning Outcome

Leve

l 1

Reac

tion

Leve

l2Le

arni

ngLe

vel3

Beha

viou

rLe

vel4

Re

sult

s

Re-evaluation of Experience

BehaviouralIntentions

Knowledge / Skills

Action

Business Impact

MIRROR Adoption

Level of Participation

Process Indicators

Gained Knowledge

Quantity / Quality

Instances/Performance

Key Performance Indicators

Work

Community

Organization

Level of Participation

Learning Process (Reflection)

App Usage

Processes & Methods


DISSEMINATION AND EXPLOITATION


MIRROR journey

Get informed:

Project information on website www.mirror-project.eu

Get involved: Test Mirror apps: • Provide feedback to become a member of

our exploitation network

Stay up-to-date: Become a member of the LinkedIn group: Mirror – Reflective learning at work

http://www.mirror-project.eu/



http://www.linkedin.com/groups?home=&gid=3357670





Mirror website

▪ News & Tweets on homepage

▪ Deliverables, work package updates, publications, newsletters

▪ Labs: apps showroom with instructions to try out, video’s

▪ Use cases


16 Apps in showroom

Apps Manuals

Videos

Contacts

Evaluation form

Links

http://mirror-dev.fzi.de/lim/





Business Segment for Reflective Learning: Performance Support and Collaboration


MIRROR can fill a gap in the market of soft skills training

Topics: project management, conflict handling, presentation skills,

negotiation skills, …

Classroom training

• Theory

• Role Plays • In Groups

Individual Coaching

• Expert

Observation • Discussion

• Help

E-Learning Modules

• Theory

• Videos with best practices

• Exercises (e.g. multiple choice)

MIRROR Coaching

Apps

• Capturing • Data Analysis

• Reflection • Proactive

Help

$$$

+ Well accepted in

companies

- Long term effect?

$

+ Ease of use

- No training effect

$

+ Real training

effect

- Permanent data

capturing

$$$$$

+ High training

effect

- Costs a lot of

personal time


Industry Solutions

Focus Areas for Exploitation have been defined:

▪ Dementia Care (English)

▪ Healthcare (English and German)

▪ Sales (English and German)

▪ Crisis management (Italian, English)

▪ HR/L&D

-> Reflective Learning Solutions can also be industry specific exploited, if generalization is not applicable


▪ MIRROR will be the first approach to support agile learning by doing and reflective learning at work

▪ MIRROR will increase learning effectiveness, work outcome and quality

▪ MIRROR will foster the use of TEL in new application areas within organisations

Thank you very much