Assessing language for specific purposes - Cambridge...

Assessing language for specific purposes —

The role of background knowledge

Christian Krekeler Deutsch als Fremd- und Fachsprache

Konstanz University of Applied Sciences krekeler@htwg-konstanz.de

Assessing language for specific purposes — The role of background knowledge

1. The validity argument 2. Strategies 3. Conclusion

Validity Strategies Conclusion

The validity argument

Validity of Language Tests Validity Strategies Conclusion

Language Competence

Future Performance Language Use

Language Competence

Test Performance

Test Score

Validity of Language Tests

Language Competence

Interpretation

Mechanical Engineering 1 (ME1) Validity Strategies Conclusion

Language Competence Background Knowledge

construct irrelevant variance

Specific Purpose Language Use

Validity of Specific Purpose Language Tests

Specific Purpose Language Ability

“Specific purpose language ability results from the interaction between specific purpose background knowledge and language ability.” (Douglas, 2000: 40)

Specific Purpose Language Test

A specific purpose language test is one in which test content and methods are derived from an analysis of a specific purpose target language use situation, so that test tasks and content are authentically representative of tasks in the target situation […]. Such a test allows us to make inferences about a test taker's capacity to use language in the specific purpose domain (Douglas, 2000: 19).

background knowledge • contaminates the

validity argument • is regarded as

construct irrelevant variance

background knowledge • is part of specific

purpose language ability

• the validity of specific purpose language tests is limited to a specific language use domain

Strategies for writing task design in language for specific purposes tests

Language for specific purposes testing • general language tests • language for general academic purposes tests • language for business purposes tests

background knowledge =

contamination of construct = threat to validity

Validity

Conclusion Strategies

Validity

• avoiding subject specificity altogether • minimise the role of background knowledge • using general tests • creating the atmosphere of specificity

Validity

Strategy: Avoid specificity

Role of Background Knowledge

Validity

Role of Background Knowledge IELTS

Validity

Language for specific purposes testing • law • engineering • aviation

Validity

• reading tasks • gap filling tasks • listening tasks

Strategy: Avoid writing tasks

• instructions • prompts • charts • pictures • texts • video clips with subject specific information

Validity

Strategy: Provide subject specific input

Mechanical Engineering 1 (ME1) Validity

Validity

ME1 ME2 ME3

Validity

• Guided writing tasks

Validity

Strategy: Control expected response

ILEC/Cambridge English: Legal (CL1) Validity

ME1 ME2 ME3 CL1

Validity

ILEC/Cambridge English: Legal (CL2) Validity

Cambridge English: Legal (LE2)

http://www.cambridgeenglish.org/exams-and-qualifications/legal/

Validity

ME1 ME2 ME3 CL1 CL2

Validity

• "translations" into a more subject specific register

Validity

Strategy: Use different registers

TOLES/Test of Legal English Skills (LE1) Validity

Validity

Register

LE1 Validity

Register

LE1 Validity

Conclusion Strategies ME3

Register

LE1 Validity

Conclusion Strategies ME3 CL2

Register

LE1 Validity

Conclusion Strategies ME3 CL2 ME1 ME2 CL1

Strategies for task design in language for specific purposes tests Validity

1. Avoid specificity 2. Avoid writing tasks 3. Provide subject specific input 4. Control expected response 5. Use different registers

Conclusion

Conclusion • role of background knowledge

• strategies

Englisch Auswirkung Rettung

Assessing language for specific purposes —

The role of background knowledge

Christian Krekeler Deutsch als Fremd- und Fachsprache

Konstanz University of Applied Sciences krekeler@htwg-konstanz.de

Assessing language for specific purposes - Cambridge...

Documents

Assessment Session Outcomes Planning andoutcomes 4 Create learning opportunities Improve learning Gather, interpret evidence Mission Purposes Suskie, L. (2009). Assessing student learning:

Web viewData held on our grants management system is used for of the following purposes; statistical reporting, application assessing, accounting purposes and for contacting

Assessing Languages for Specific Purposes - alte.org talk on LSP, April... · Task types Role play: OET ... (LSP) reading performance, ... Occupational English test. [Developed by

1 ASSESSING LISTENING: purposes and techniques Prepared by Svetlana Sannikova, Vera Novikova and Olga Mironova Based on material by John Field

EAP ASSESSMENT LITERACY - Cambridge Englishevents.cambridgeenglish.org/alte-2014/docs/presentations/alte2014... · assessment practices reflect language testing research and practices

Central Asia-Caucasus Analyst · assessing china’s reaction to kyrgyzstan’s “tulip revolution” 5 matthew oresman nazarbayev’s grand design for kazakhstan‘s domestic purposes

Assessing Languages for Specific Purposes Cambridge Language Assessment

DEPARTMENT OF PLANNING, INDUSTRY & ENVIRONMENT … · 2020-04-03 · Department of Planning, Industry and Environment (the Department) for the purposes of assessing the impacts on

CLIL/Emile in Italy - Cambridge Englishevents.cambridgeenglish.org/.../presentations/alte2014-gisella-lange.… · CLIL/Emile in Italy: a real driver for lifelong learning. Gisella

CREATING RUBRICS FOR ASSESSMENT...Creating Rubrics –Assessing course curriculum •Effective assessment and feedback for faculty •For curriculum purposes, a rubric should assess

Assessing Agricultural Consumptive Useucrcommission.com/RepDoc/Studies/Assessing _Ag_CU_PhaseI.pdf · Assessing Agricultural Consumptive Use ... 12.0_WORD_PROC\FINAL_REPORT\ASSESSING

Training and Competence · competency tests. [Note:annex III (3) of theMCD] For the purposes of assessing theemployee'sknowledge and competence, professional experience means their

The Accountable Care Organization · Physician Group Practice (PGP) ... by meeting ever increasing standards for purposes of assessing quality of care ... • Health plans working

CLIL/Emile in Italy - Cambridge Englishevents.cambridgeenglish.org/alte-2014//docs/presentations/alte2014... · curriculum and assists cross-section and cross-curricular dialogue,

Japan's Initial Experience with Technical Development … · 2016-09-01 · check lists for assessing teachers’ capacity in terms of lesson plan preparation and classroom ... purposes

Chapter 3 Clinical Assessment and Diagnosis. Assessing Psychological Disorders Purposes of clinical assessment –T–To understand the individual –T–To predict

Chapter 13 Written Language. Purposes for Assessing Written Language General education monitors spelling, handwriting, and composition Special education

Water Body Temperature Model for Assessing Climate Change ... · power plants require cold water for cooling purposes and efficient production of energy. Presently, 91% of energy

Voice from Test-takers: An Exploratory ... - Cambridge Englishevents.cambridgeenglish.org/alte-2014/docs/presentations/alte2014... · Cambridge English: Business Certificates, also

Novel Methods for Assessing the Protection …of distribution network planning is maintained throughout the thesis. The information systems applied for planning purposes are also considered