47
BILC BILC MJDB 2009 MJDB 2012 Designing and Assessing ESP Designing and Assessing ESP f f or or F F orward orward A A ir ir C C ontrollers ontrollers BILC CONFERENCE 2012 BILC CONFERENCE 2012 Prague, Prague, Czec Czec h Republic h Republic Maj F. Gratton - MJ Di Biase Italian Army Language

Designing and Assessing ESP f or F orward A ir C ontrollers

  • Upload
    ramla

  • View
    46

  • Download
    0

Embed Size (px)

DESCRIPTION

BILC CONFERENCE 2012. Prague, Czec h Republic. Designing and Assessing ESP f or F orward A ir C ontrollers. Maj F. Gratton - MJ Di Biase Italian Army Language School. SUMMARY. ‘ THE PROBLEM ’. IMPLICATIONS FOR ESP TESTING. MILITARY OPERATIONAL ENGLISH. THE PROBLEM:. - PowerPoint PPT Presentation

Citation preview

Page 1: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Designing and Assessing ESPDesigning and Assessing ESP

ffor or FForward orward AAir ir CControllersontrollers

BILC CONFERENCE 2012 BILC CONFERENCE 2012 Prague, Prague, CzecCzech Republich Republic

Maj F. Gratton - MJ Di BiaseItalian Army Language School

Page 2: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SUMMARYSUMMARY

• IMPLICATIONS FOR ESP TESTINGIMPLICATIONS FOR ESP TESTING

• ‘‘THE PROBLEM’THE PROBLEM’

• MILITARY OPERATIONAL ENGLISHMILITARY OPERATIONAL ENGLISH

Page 3: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

THE PROBLEM:

• 3797 vs 6001 COMPARATIVE STUDY

• NEEDS ANALYSIS

• SUBJECT MATTER EXPERTS

INCREASED LANGUAGE REQUIREMENTS 3333

and how we addressed it:

Page 4: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Who is a

FAC and

what

does he

do?

Page 5: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Mission statementMission statement

A soldier from a forward position can

deliver joint indirect fires and direct the

actions of joint combat aircraft engaged in

operations in close proximity to friendly

fires

Page 6: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

COMMUNICATIVE EVENT BETWEEN:

Pilot and FAC sometimes FAC and FAC

• Acknowledge message

• Ask and/or provide information

• Ask pilot or FAC to……

• Check, confirm and clarify

• Give and/or ask for approval

In which they:

Page 7: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

LINGUISTIC REQUIREMENTS

STANAG 3797STANAG 3797

“ English is the language to be used when controlling

NATO aircraft. Therefore FACs need adequate

knowledge of and proficiency in the English language to

the EQUIVALENT OF NATO STANAG 6001 Level 3.

The competency examination should be biased

towards military, particularly FAC, terminology ”

Page 8: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

ProficiencyProficiency

‘‘Infinite number of unique Infinite number of unique

instances…. with negotiation of instances…. with negotiation of

meaning’ (Bachman)meaning’ (Bachman)

Page 9: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

FAC tasksFAC tasks

• Plan CAS missionPlan CAS mission

• Build and maintain Situation AwarenessBuild and maintain Situation Awareness

• Maintain personal safetyMaintain personal safety

Page 10: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

In doing these tasks, FACs…

AdviseAdvise PlanPlan

RequestRequest

AnalyzeAnalyze

DetectDetect

ProvideProvideDescribeDescribe

Page 11: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Stanag Stanag vsvs

Stanag Stanag

Page 12: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

STANAG 3797 vs. 6001STANAG 3797 vs. 6001

Can name parts, tools, and simple facts1rehearsed speech

liv60013797

2instructions and directions

Can predict and resolve problems 2handle non-routine

situations

Can determine step-by-step procedures

Can identify why and when the task can

be done and why each step is needed 2narration

state facts 2

Can identify relationships of basic facts

and state general principles 2state facts

Page 13: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

STANAG 3797 vs. 6001STANAG 3797 vs. 6001

Can analyze facts and draw conclusions 2state facts

liv60013797

Can evaluate conditions and make proper

conditions 2handle non routine

situations

Effective (flexible and responsive)

communication 3effective

communication

Can evaluate Battle Damage Assessment

(BDA) and Mission Reporting (MISREP) in

terms of activity, location, time,

munitions, number of tanks destroyed

2past narration

Page 14: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Needs analysisNeeds analysis• Questionnaire Questionnaire

• Visits to FAC schoolsVisits to FAC schools

• Assistance from RamsteinAssistance from Ramstein

• Interviews with Subject Matter Interviews with Subject Matter

ExpertsExperts

Page 15: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

NEEDS ANALYSIS QUESTIONNAIRENEEDS ANALYSIS QUESTIONNAIRE

• Technical

terminology

• Strategic

competence

• reference material

• Players involved

• Physical setting

• Human context

• Linguistic setting

• Hierarchy of skills

Page 16: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

1. How many times have you been deployed as an FAC?

1

2

3

4

5

more 1. Are you familiar with STANAG 6001 on language proficiency levels?

very familiar familiar fairly familiar not familiar

1. In my experience as an FAC in theatre, I have engaged….

a. with native speakers of English….

Most of the time sometimes seldom never

b. With non native speakers of English:

Most of the time sometimes seldom never

1. The most difficult skill to perform in English as an FAC is

Listening reading speaking writing

Please explain (ex. When listening to a pilot, native speaker accent,

medium interference due to terrain etc, when reading

low frequency acronyms etc)) –

NEEDS ANALYSIS NEEDS ANALYSIS QUESTIONNAIREQUESTIONNAIRE

Page 17: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

FCS Mission “Improve quality and quantity of NATO

Forward Air Controllers”

Remember ….. “the problem”???

Page 18: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB201218

FAC Capability Section

Mission & Update

Briefing

HQ AC RAMSTEIN

06-07 Jul 11

TV Francesco “Spike” SPINOSA FAC Capability SectionNATO FAC Standardisation Team LeaderHQ AC Ramstein - DEU

Page 19: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Stakeholders meetingJULY 2011JULY 2011

• AGREEMENT REACHEDAGREEMENT REACHED

• TIMELINETIMELINE

Page 20: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

IDENTIFIED PROBLEMSIDENTIFIED PROBLEMS

NEW NEEDSNEW COURSE

NEW SYLLABUSNEW TEST

ACADEMIC PRACTICAL

Page 21: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Specific purpose language abilitySpecific purpose language ability

“…results from Interaction btwn specific

purpose background knowledge and language

ability by means of strategic competence

engaged by specific purpose input in the form of

test method characteristics…” (Douglas)

Page 22: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

LINGUISTIC REQUIREMENTS

IMMEDIATEIMMEDIATE

CLEARCLEAR

EFFECTIVEEFFECTIVE

CONFIDENTCONFIDENT

COMMUNICATION

Page 23: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

CONTENT:WEATHER, TERRAIN

FEATURES ETC

TASKS:

DESCRIBE, GIVE INSTRUCTIONS

AND DIRECTIONS

ACCURACY:READILY, EFFECTIVELY,

WITH EASE AND

CONFIDENCE

Page 24: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Interpretation of level neededInterpretation of level needed

Level 3 accuracy:

…with considerable ease… (confident?)…reliably….(effective?)

….conveys meaning correctly

and effectively….….speaks readily…. (immediate?)….can use the language clearly

and relatively naturally ….make ideas easily

understandable to native

speakers…….but can easily repair th

e conversation….

….pronunciation may be

obviously foreign….

….occasional errors in

pronunciation, grammar, or

vocabulary are not serious enough

to distort meaning …..

Page 25: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SUMMARYSUMMARY

• IMPLICATIONS FOR ESP TEACHING AND TESTINGIMPLICATIONS FOR ESP TEACHING AND TESTING

• ‘‘THE PROBLEM’THE PROBLEM’

• MOEMOE

Page 26: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

TEACHING & TESTINGTEACHING & TESTING(JOB-RELATED, TASK-BASED)(JOB-RELATED, TASK-BASED)

The result isThe result is

Mixed skills to simulate authentic Mixed skills to simulate authentic communicative event and taskscommunicative event and tasks

proficiencyproficiency requirements?requirements?accuracyaccuracy

Page 27: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SKILLS-BASED SYLLABUSSKILLS-BASED SYLLABUS

• HIERARCHY OF SKILLSHIERARCHY OF SKILLS

• ADAPT EXISTING TEXTS ADAPT EXISTING TEXTS

• DEVISE ACTIVITIES TO TEACH SKILLSDEVISE ACTIVITIES TO TEACH SKILLS

• FOCUS ON PRONUNCIATIONFOCUS ON PRONUNCIATION

Page 28: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SYLLABUSSYLLABUS

• Corpus of specific terminology/phraseologyCorpus of specific terminology/phraseology

• Emphasis on PronunciationEmphasis on Pronunciation

• No proceduresNo procedures

and listeningand listening

Page 29: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

MMilitaryilitary OOperationalperational EEnglishnglish

• ESP SyllabusESP Syllabus

• Compilation of materialCompilation of material

• Authentic unclassified videos Authentic unclassified videos

• Authentic unclassified documents (SPINS, 9 Authentic unclassified documents (SPINS, 9

liners etc)liners etc)

MOEMOE

Page 30: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SCREENING SCREENING

• ENTRY TEST AT LEVEL 2 ALL FOUR SKILLSENTRY TEST AT LEVEL 2 ALL FOUR SKILLS

• PROFICIENCY TESTING TO DETERMINE PROFICIENCY TESTING TO DETERMINE

BASELINEBASELINE

Page 31: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

MOEMOE

• TWO INSTRUCTORSTWO INSTRUCTORS

• 6 STUDENTS PER CLASS6 STUDENTS PER CLASS

• TECHNOLOGY IN THE CLASSROOM TECHNOLOGY IN THE CLASSROOM

(Ipads, PCs, etc.)(Ipads, PCs, etc.)

MMilitaryilitary OOperationalperational EEnglishnglish

Page 32: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

2. Test

Early afternoon

Putting the morning

activity into practice

Teaching style: “native

speaker” (teacher

speak to be avoided).

Peer collaboration.

2. Test

Early afternoon

Putting the morning

activity into practice

Teaching style: “native

speaker” (teacher

speak to be avoided).

Peer collaboration.

3. Teach (consolidate) - Late afternoon

Feedback on activity Points on where

and how to improve (language focus on

errors). Teaching style: peer-learning/

correction. Teacher monitors

3. Teach (consolidate) - Late afternoon

Feedback on activity Points on where

and how to improve (language focus on

errors). Teaching style: peer-learning/

correction. Teacher monitors

1. Teach

Morning

Lexical domains &

language functions

Teaching style:

traditional-frontal

1. Teach

Morning

Lexical domains &

language functions

Teaching style:

traditional-frontal

Listening & Speaking

Listening & Speaking

5 WEEK COURSE5 WEEK COURSE

Page 33: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Ex. skills-based:task, language and content are

drawn from input (video, simulation etc)

Page 34: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

LEXICAL / TASK BASED SYLLABUSLEXICAL / TASK BASED SYLLABUS

• Terrain / StructuresTerrain / Structures

• Weather / VisibilityWeather / Visibility

• Urban / Non-Urban Urban / Non-Urban

AreasAreas

• Target IdentificationTarget Identification

• Friendly / Enemy ForcesFriendly / Enemy Forces

• Threats / ObstaclesThreats / Obstacles

• Aircraft / OrdnanceAircraft / Ordnance

• Vehicles / EquipmentVehicles / Equipment

SITUATIONAL

SITUATIONAL

AWARENESS

AWARENESS

Page 35: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

CLASSROOM ACTIVITIESCLASSROOM ACTIVITIES

COURSE BOOK: Compiled materialCOURSE BOOK: Compiled material

FOCUS : Listening - SpeakingFOCUS : Listening - Speaking

• VIDEOSVIDEOS

• SIMULATIONSSIMULATIONS

• MAP READING MAP READING (Authentic / Google Maps)(Authentic / Google Maps)

• MISSION REPORT / BDA MISSION REPORT / BDA (Filling in forms)(Filling in forms)

• Job ManualsJob Manuals

Page 36: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

RADIO COMMUNICATIONRADIO COMMUNICATION

UNDERSTANDUNDERSTAND

•PronunciationPronunciation

•Variety of accentsVariety of accents

•Speed of deliverySpeed of delivery

•Colloquial/Established ProtocolColloquial/Established Protocol

•Background InterferenceBackground Interference

EXPRESSEXPRESS

•Clear, concise communicationsClear, concise communications

•Unpredictable situationsUnpredictable situations

•Acronyms and Brevity TermsAcronyms and Brevity Terms

Page 37: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

FACE TO FACE CLASSROOM TALK ONSFACE TO FACE CLASSROOM TALK ONS

RADIO SIMULATED TALK ONS• w/out background interference• w/ background interference (battle sounds)

RADIO SIMULATED TALK ONS• w/out background interference• w/ background interference (battle sounds)

PRACTICE:•Describe•Request•Direct•Clarify•Confirm

PRACTICE:•Describe•Request•Direct•Clarify•Confirm

Page 38: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SUMMARYSUMMARY

• IMPLICATIONS FOR ESP TESTINGIMPLICATIONS FOR ESP TESTING

• ‘‘THE PROBLEM’THE PROBLEM’

• MOEMOE

Page 39: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

IMPLICATIONS FOR TESTINGIMPLICATIONS FOR TESTING

• ESP (CONTINUUM SPECIFICITY)ESP (CONTINUUM SPECIFICITY)

• TASK-BASEDTASK-BASED

• PERFORMANCE-BASEDPERFORMANCE-BASED

• LEVEL 3 ACCURACY, LEVEL 2 CONTENT AND TASKSLEVEL 3 ACCURACY, LEVEL 2 CONTENT AND TASKS

Page 40: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SPEAKING USING GOOGLE EARTHSPEAKING USING GOOGLE EARTH

• Task: guide pilot to pre-defined target Task: guide pilot to pre-defined target

unknown to the pilotunknown to the pilot

• Emphasis on description of places and things Emphasis on description of places and things

(terrain, weather, coordinates, directions)(terrain, weather, coordinates, directions)

• FAC phraseologyFAC phraseology

TEST SPECIFICATIONSTEST SPECIFICATIONS

Page 41: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

• Direct testing of discrete phonological elementsDirect testing of discrete phonological elements

• Gap-filling – tapescript or summaryGap-filling – tapescript or summary

• MCQ to assess understanding of authentic MCQ to assess understanding of authentic

communicative eventscommunicative events

TEST SPECIFICATIONS: LISTENING TEST SPECIFICATIONS: LISTENING

Page 42: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

• AUTHENTIC MATERIALAUTHENTIC MATERIAL

• MCQS TO ASSESS MCQS TO ASSESS

UNDERSTANDING OF UNDERSTANDING OF

SPINSSPINS

TEST SPECIFICATIONS: READINGTEST SPECIFICATIONS: READING

Page 43: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

SPECIFICATIONSSPECIFICATIONS

TEST TEST

SPECIFICATIONS SPECIFICATIONS

WRITING:WRITING:

Dear Abby…

Page 44: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

FEEDBACK QUESTIONNAIREFEEDBACK QUESTIONNAIRE

Page 45: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

Limitations/challengesLimitations/challenges

• Classified material?Classified material?

• Train the trainer?Train the trainer?

• Informants as FAC experts Informants as FAC experts and and have have

language awarenesslanguage awareness

• Authentic tasks (and responses)Authentic tasks (and responses)

Page 46: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012

[email protected]@gmail.com

THANK YOUTHANK YOU

Page 47: Designing  and  Assessing  ESP f or  F orward  A ir  C ontrollers

BILCBILC

MJDB 2009MJDB2012REFERENCES

REFERENCES

• Canadian FAC info

• Douglas, D (2005) Assess.Lang.for Spec. Purp.• Hutchington, E (2005) Eng.for Spec.Purp.

• JTAC MOA 2007

• Pub. 3093 – Tatt., tecn.e proc.per supp.aereo

• STANAG 3797

• STANAG 6001 ed. 4