41
CEFcult An innovative web environment for online oral assessment of intercultural professional contexts Lut Baten & Lutgart Dusar, Instituut voor Levende Talen, K.U.Leuven, Belgium Jan Van Maele, Groep T Internationale Hogeschool Leuven, Belgium

CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult

An innovative web environment for online oral assessment of

intercultural professional contexts

Lut Baten & Lutgart Dusar, Instituut voor Levende Talen, K.U.Leuven, Belgium

Jan Van Maele, Groep T – Internationale Hogeschool Leuven, Belgium

Page 2: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

INTERCULTURAL COMMUNICATION

Page 3: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

What cies do: telepresence

Page 4: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CISCO

Learn. Share. Team up.

appreciation

status

Page 5: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 6: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 7: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Profile

Page 8: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

What students do: Web 2.0 samples

• Moodle: ‘Mahara’ portfolio & EuroPASS• WebCEF: peer, self and expert assessment of online oral

performance• LinkedIn: professional networking• Flashmeeting: online meetings and recording• Wiki: project work documentation • Google communities: integrated document sharing• Blackboard groups: for file exchange within a class

environment• Facebook• YouTube

Page 9: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 10: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 11: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 12: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 13: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 14: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

• Flashmeeting

Page 15: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Challenges

• How to bridge self assessment and peer assessment from a learning environment to a working environment?

– How to gain insight in intercultural patterns?– How to gain expert assessment? – How to promote awareness raising through a digital environment? – How to use assessments for life long learning (portfolio) ?

• How to elicit observable, intercultural behaviour in professional, online language tasks?

• How to design operational and userfriendly assessment scales in a social community for intercultural communicative competence: – Not for the expert end user but for the novice learner?

2-12-2010 www.cefcult.eu

Page 16: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult as an itinerary

as a tool

Page 17: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult as an itinerary

as a tool

communicating, learning, and evaluating

in professional context

in intercultural context

Page 18: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

what preceeded: WebCEF

Learning by assessment

Assessing in team, in a community

Learning how to assess with the CEFR

Page 19: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

WebCEF project (2006 – 2009)

• WebCEF established a social learning community for self, peer and expert assessment in which both productive and interactive performance in a foreign language was video recorded and online displayed to be assessed by means of CEFR

• http://www.webcef.eu/

Page 20: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult project (2009 – 2011)

• Follow-up of WebCEF project

• CEFcult aims to promote intercultural professional communication with foreign language users bymeans of a Web 2.0 assessment tool

• CEFcult provides the integration of linguistic and intercultural aspects of professional communication in assignments and assessment scales

• Duration: November 2009 until October 2011

• Funding body: European Commission, LifelongLearning Programme under KA2 languages

• http://www.cefcult.eu

Page 21: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Intercultural Communicative Competence

• “Fluent fool” (Bennett, 1993)

• Grammar and vocabulary are not sufficient

• Speakers of a foreign language need to understand the basic beliefs and values of their interlocutors

• How to find ‘common ground’ and speak the same ‘language’, banking on diversity and inclusion

Page 22: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Target users

employees

Language

teachers

those about to (re-)

enter the workplace

in-company trainers

Page 23: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Portfolio

Users -profile

Group

Video sample

ScenarioScenario Database

Social media

Export to portfolio

Self-assess

Peer-assess

Expertassess

Searchscenario

Add to profile

Create sample

Follow the scenario

Feedback evaluation

Add a scenario

Export to Europass

Page 24: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

task evaluation

Page 25: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Select Assessment Schema

Is this an Observation Task?

Description scenario

Name Scenario

Instructions for Assessor

Instructions for Assessor

Supportive documents for scenario Name document

Task

Name task

BrowseName supportive document

Description task

Name supportive media Browse

Customize Assessment SchemaSelect Assessment Schema

Is this an Observation Task?

scenario development

Page 26: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

2-12-2010 www.cefcult.eu

Page 27: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult: user profile

Page 28: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Leuven pilot

• Job interview scenario

• 2 tasks:

– Observation of a pre-recorded dialogue

– Guided simulation of monologue interviewee with pre-recorded questions

• Bridging CEFR scale and INCA scale

• Target language: English

Page 29: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

2. CEFCULT, THE VISION

Page 30: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFcult as an itinerary

as a tool

communicating, learning, and assessment

in professional contexts

in intercultural context

Page 31: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Output

• a modular, customizable web-environment that allows for self-, peer-, and expert- assessment, integrating CEF-scales with other rating scales for language and intercultural competence

• a set of authentic communication tasks (scenarios) through which learners can assess their speaking skills for intercultural professional purposes in different European languages

• training materials for self-, peer- and expert assessment in education and enterprises

• research-supported guidelines for foreign language teaching and educational policy based on observed international inter-rater differences

• viable and tested model(s) for collaborative assessment among higher education institutes, enterprises, and various partnership brokers

Page 32: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

3. CEFCULT, THE WEB-BASED ENVIRONMENT

Page 33: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

The web-based environment

• Choice of scenarios & tasks

• Recording of samples (using VideoLab or uploading of samples)

• Assessment of samples (self-, peer- or expert assessment)

• Assessment environment will be enhanced by available web 2.0 applications, advancing a number of user-driven functionalities (communities of practice; e-portfolio).

Page 34: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

CEFR-scale

Common European Framework of Reference (CEFR)

– Linguistic competence (oral production and interaction): range, accuracy, fluency, coherence, interaction.

– Sociolinguistic competence

Page 35: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

intercultural competence vs linguistic fluency

intercultural communicative competence

Respect for Otherness (Full)“Is able to cope tactfully with the ethical

problems raised by personally

unacceptable features of otherness”

“Withholds judgment; asks for clarification

before classifying the question as unlawful

or inappropriate”

Page 36: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

European framework of key competencies for life long learning

1. Communication in native language

2. Communication in foreign languages

3. Basic competencies science and technology

4. Digital competence

5. Learning how to learn

6. Social and civil competences

7. Developent of initiative and entrepreneurship

8. Cultural awareness and cultural expression

Page 37: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

INCA-scale

Intercultural Competence Assessment (INCA)

– Openness: respect for otherness, tolerance of ambiguity.

– Knowledge: knowledge discovery, empathy.

– Adaptability: behavioural flexibility, communicative awareness.

Page 38: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional
Page 40: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Consortium• K.U.Leuven (Belgium) Coordinator• Open Universiteit Nederland (The Netherlands)• Technische Universität Dresden (Germany)• Group T - Internationale Hogeschool Leuven (Belgium)• Université de Savoie (France)• Università di Bologna (Italy)• Uniwersytet Łódzki (Poland)• Helsingin Yliopisto (Finland)• Euneos Oy (Finland)• Jyväskylän Yliopisto (Finland)• The Open University (UK) • Fontys Hogescholen (The Netherlands)

Page 41: CEFcult - ILT KU Leuvenilt.kuleuven.be/onderzoek/docs/LutBerlin1.2.pdf · 2016. 2. 15. · CEFcult An innovative web environment for online oral assessment of intercultural professional

Work packages

• WP1 Project Management

• WP2 Quality and Evaluation

• WP3 Dissemination

• WP4 Preparation of web-based language assessment environment

• WP5 Development of web-based language assessment environment

• WP6 Pilots with language learners

• WP7 Exploitation