Innovative Technology in the Public InterestTM 1Innovative Technology in the Public InterestTM 1

Impact of Encroachment on Military Training Quality

A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges

National Defense Industrial Association 30th Environmental and Energy Symposium and Exhibition

April 7, 2004

Innovative Technology in the Public InterestTM 2Innovative Technology in the Public InterestTM 2

Study Objective

Create a methodology that determines the Create a methodology that determines the contribution and significance of encroachment and contribution and significance of encroachment and training workarounds to degraded mission skills.training workarounds to degraded mission skills.

Innovative Technology in the Public InterestTM 3Innovative Technology in the Public InterestTM 3

Reviewed Previous Efforts

• Skills Based Training (CNA) Skills Based Training (CNA) • Camp Pendleton (USMC and SRA)Camp Pendleton (USMC and SRA)• SAF/IE Capacity Analysis (BAH)SAF/IE Capacity Analysis (BAH)• ATTAC & ISR Enhancements (Army DCSOPS/G3)ATTAC & ISR Enhancements (Army DCSOPS/G3)• Navy Range Needs Assessment -- Air to Ground Navy Range Needs Assessment -- Air to Ground

Ranges (N44)Ranges (N44)• PACFLEET Encroachment Matrix (N433)PACFLEET Encroachment Matrix (N433)

Innovative Technology in the Public InterestTM 4Innovative Technology in the Public InterestTM 4

Review Findings

• Training Range and Facility Impact Analysis Methodologies…Training Range and Facility Impact Analysis Methodologies…- Focus on resource optimization (i.e., capacity analysis) and constraints on Focus on resource optimization (i.e., capacity analysis) and constraints on

full/effective usefull/effective use- Link Encroachment to Training Facility Mission Link Encroachment to Training Facility Mission - May not directly address effect of Encroachment on Training QualityMay not directly address effect of Encroachment on Training Quality- Encroachment Effect measured by Percentage of Land Available or Maps of Usable Encroachment Effect measured by Percentage of Land Available or Maps of Usable

Facility, etc.Facility, etc.

• Readiness Impact Analysis Methodologies …Readiness Impact Analysis Methodologies …- Tie Location to a Training Requirement (Mission Essential Task)Tie Location to a Training Requirement (Mission Essential Task)- Link Encroachment to Readiness RatingLink Encroachment to Readiness Rating- May not directly link a Readiness Rating to a Specific RangeMay not directly link a Readiness Rating to a Specific Range- May not address the May not address the significancesignificance of an encroachment factor on a Readiness Rating of an encroachment factor on a Readiness Rating

To meet our objective both methodologies needed to be harmonized and enhanced

Innovative Technology in the Public InterestTM 5Innovative Technology in the Public InterestTM 5

Developed a Conceptual Framework

Range Capability

Mission Requirement

METLS

Completion Completion RatesRates

Training Training TasksTasks

Range Range CapacityCapacity

Skill Proficiency

Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Training and Results in Degraded Skill ProficiencyTraining and Results in Degraded Skill Proficiency

Innovative Technology in the Public InterestTM 6Innovative Technology in the Public InterestTM 6

Conceptual Model

Range Capacity to Range Capacity to Support METLSupport METL

METL Task METL Task Completion RateCompletion Rate

Estimated Estimated Effectiveness Effectiveness

Per Training TaskPer Training Taskxx

Skill Skill Proficiency Proficiency

ScoreScore=

Impacted Training ProficiencyImpacted Training Proficiency

Innovative Technology in the Public InterestTM 7Innovative Technology in the Public InterestTM 7

Concept Elements

1.1. IdentifyIdentify- Specific Combat Missions Specific Combat Missions - Combat Units and their Training/OPAREAsCombat Units and their Training/OPAREAs- Unit METLsUnit METLs

2.2. Obtain DataObtain Data- Interview Units based at specific installations and OPAREAsInterview Units based at specific installations and OPAREAs- Interview OPAREA and Training Range managersInterview OPAREA and Training Range managers- Relate contribution of conditions to training and skill acquisition Relate contribution of conditions to training and skill acquisition

performanceperformance• Internal (logistics, schedules, certifications, etc.)Internal (logistics, schedules, certifications, etc.)• External (weather, deployment, encroachment, safety)External (weather, deployment, encroachment, safety)

IdentifyIdentify Obtain DataObtain Data AnalyzeAnalyze CorrectCorrect

Innovative Technology in the Public InterestTM 8Innovative Technology in the Public InterestTM 8

Concept Elements (concluded)

3.3. AnalyzeAnalyze- Calculate proficiency impactsCalculate proficiency impacts- Perform comparative impact analysesPerform comparative impact analyses- Determine root causes of skill proficiency impactsDetermine root causes of skill proficiency impacts- Identify options to mitigate the impact of root causes on skill Identify options to mitigate the impact of root causes on skill

proficiencyproficiency

4.4. CorrectCorrect- Determine which root cause factors should be addressed locally, Determine which root cause factors should be addressed locally,

regionally, or nationallyregionally, or nationally- Assign responsibility for corrective actionAssign responsibility for corrective action

IdentifyIdentify Obtain DataObtain Data AnalyzeAnalyze CorrectCorrect

Innovative Technology in the Public InterestTM 9Innovative Technology in the Public InterestTM 9

Five Step Methodology for Concept Validation

2. Site Visits

Unit Survey

Range Survey

1. Target Specific Units

Identify Characteristics of Ranges and Training Areas

Unit METL

Database

3. Data Inputs

4. Impact Analysis

Baseline Impact Analysis

Survey Report Impact Analysis

5. Root Cause Analysis

Database Reports on Specific METL Activities

Innovative Technology in the Public InterestTM 10Innovative Technology in the Public InterestTM 10

Concept Validation Field StudyStep 1: Target Specific Units

• Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers of the Squadron’s training rangesof the Squadron’s training ranges- Naval Auxiliary Landing Field (NALF), VANaval Auxiliary Landing Field (NALF), VA- Dare County Bombing Range, NCDare County Bombing Range, NC- TACTS ranges comprising Virginia Capes, MD, VA, NCTACTS ranges comprising Virginia Capes, MD, VA, NC- Fallon Range Training CenterFallon Range Training Center

• Four core mission skill sets analyzedFour core mission skill sets analyzed- MobilityMobility- Strike warfareStrike warfare- Anti-air warfareAnti-air warfare- Amphibious warfareAmphibious warfare

• Each mission has a defined number of tasks for trainingEach mission has a defined number of tasks for training

Innovative Technology in the Public InterestTM 11Innovative Technology in the Public InterestTM 11

Concept Validation Field Study Step 2: Data/Information Collection

• SurveysSurveys- Range-specific QuestionnaireRange-specific Questionnaire

• Given to range managers, environmental staff, logistics personnel, Given to range managers, environmental staff, logistics personnel, training event plannerstraining event planners

• 27 questions focused on range characteristics, encroachment 27 questions focused on range characteristics, encroachment present, knowledge of training workaroundspresent, knowledge of training workarounds

- Unit-level QuestionnaireUnit-level Questionnaire• Given to unit commanders and unit training officersGiven to unit commanders and unit training officers• 16 questions focused on training to task, supplemental training, and 16 questions focused on training to task, supplemental training, and

training effectivenesstraining effectiveness

Innovative Technology in the Public InterestTM 12Innovative Technology in the Public InterestTM 12

Concept Validation Field StudyConcept Validation Field StudyStep 3: Data InputsStep 3: Data Inputs

Interview specific to selected Mission Training Interview specific to selected Mission Training activities [COMNAVAIRFORINST 3500.1 and activities [COMNAVAIRFORINST 3500.1 and

COMNAVSURFORINST 3502.1]COMNAVSURFORINST 3502.1] Carrier (CVW) Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A) Encroachment Impact Analysis

Training to Task Question Series

Supplemental Training Question Series

Estimate of Training Effectiveness Question Series Core Missions / Tasks

COMNAVAIRFORINST 3500.1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A)

Mobility (MOB) (4) Air Navigation (MOB 201) Field Carrier Landing Practice (MOB 202)

Carrier Qualification (MOB 203) Inflight Refueling (MOB 204) MSN/Recovery Tanker (MOB 205) Strike Warfare (STW) (30) Target Acquisition (STW 201) Target Attack-Visual (STW 202) Target Attack-Sensor (STW 203) Target Attack-GPS (STW 204) Air-to-Ground Strafe (STW 205) Paraflare BMB (STW 206) SACT (STW 207) Low Altitude Tactics Training (STW 208)

Low Level (STW 209) Night Vision Device Low Level (STW 210)

LST (STW 211) Self-Escort Strike (STW 212) Coordinated/CVW/Joint Strike (STW 213)

Anti-Surface Warfare (STW 214) Close Air Support/Forward Air Controller (Airborne) (STW 215)

Combat Search and Rescue/ RESCAP/RESCORT (STW 216)

Coordinated MINEX (STW 217) Reconnaissance (STW 218) High-Speed Anti-Radiation Missile/

Example:Example: VF/VFA (F/A-18C, F14A) VF/VFA (F/A-18C, F14A)•MobilityMobility•Strike WarfareStrike Warfare•Antiair WarfareAntiair Warfare•Amphibious WarfareAmphibious Warfare•Antisurface WarfareAntisurface Warfare•Mine WarfareMine Warfare

Responses captured and entered Responses captured and entered into a database for analysisinto a database for analysis

Generic Survey with METL-specific ResponsesGeneric Survey with METL-specific Responses

Innovative Technology in the Public InterestTM 13Innovative Technology in the Public InterestTM 13

Concept Validation Field Study Training Step 4: Impact Analysis

• An algorithm is used to calculate “scores” for baselined and survey reported METL performance data to enable variance analysis

• Similar scores for Baselined and Reported METL performance indicates training/workarounds are successful

• Dissimilar scores for baselined and reported METL performance indicates proficiency issues; requires Root Cause analysis.

• “Strike Warfare” example above illustrates which scores need root cause analysis

Training Quality Impact Analysis Tool Populated with Field Study DataTraining Quality Impact Analysis Tool Populated with Field Study Data

Mission Type for CVW Fighter

Squadron (F-14B)

Actual Range Complex

Capabilities (a)

Required Range

Capabilities (b)

Range Capability Index (a/b)

Tasks Completed (c)

Total METL Tasks (d)

Task Completion Index (c/d)

Encroachment Factors

Impacting Training (e)

Total Encroachment

Factors Present (f)

Encroachment Impact Index (e/f)

Actual Effectiveness

Score (h)

Maximum Effectiveness

Score (i)

Effectiveness Index (h/i)

Impacted Training Quality Score (z)

Mobility: Baseline 3 4 0.75 5 5 1.00 1 2 0.5 40 40 1.000 27Mobility: Survey Responses 3 4 0.75 4 5 0.80 4 7 0.6 33 40 0.825 24

Strike Warfare: Baseline 8 13 0.62 19 19 1.00 1 3 0.3 128 128 1.000 49Strike Warfare: Survey Responses 8 13 0.62 1 19 0.05 3 8 0.4 16 128 0.125 103

Amphibious Warfare: Baseline 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30

Amphibious Warfare: Survey Responses 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30

Innovative Technology in the Public InterestTM 14Innovative Technology in the Public InterestTM 14

Concept Validation Field Study: Step 5: Root Cause Analysis via Database

• Allowed trace-back to main root causesAllowed trace-back to main root causes- Munitions use restrictionsMunitions use restrictions- Inadequate physical conditionsInadequate physical conditions- Inadequate training facilityInadequate training facility

• Analysis revealed specific reasons for lower-than-expected Analysis revealed specific reasons for lower-than-expected training proficiency skills and task completion rates in strike training proficiency skills and task completion rates in strike warfarewarfare

- Physical ability of the range or training area to accept additional increases in user demand (capacity Physical ability of the range or training area to accept additional increases in user demand (capacity constraints)constraints)

- Training airspace corridors (private and commercial encroachment)Training airspace corridors (private and commercial encroachment)- Restrictions on munitions use due to resources need to clean or clear material from the ranges (safety Restrictions on munitions use due to resources need to clean or clear material from the ranges (safety

concerns, fire hazards, ESA)concerns, fire hazards, ESA)- Electronic equipment and general safety (logistics supply)Electronic equipment and general safety (logistics supply)- Hours of operation restrictions (community issues with noise)Hours of operation restrictions (community issues with noise)

Innovative Technology in the Public InterestTM 15Innovative Technology in the Public InterestTM 15

Project Conclusions

1.1. Field study validated concept and methodologyField study validated concept and methodology2.2. Identified specific impacts from encroachment vs. range capacity Identified specific impacts from encroachment vs. range capacity

constraintsconstraints3.3. Method able to identify root causes of degraded trainingMethod able to identify root causes of degraded training4.4. Effort builds on capacity analysis models of encroachment: Effort builds on capacity analysis models of encroachment:

- Uses existing data from range inventoryUses existing data from range inventory- Uses official Service METLs or training instructions to baseline proficiency Uses official Service METLs or training instructions to baseline proficiency

requirements against actual training resultsrequirements against actual training results- Integrates mission training impacts (delayed, modified, relocated, cancelled) with Integrates mission training impacts (delayed, modified, relocated, cancelled) with

encroachment pressures encroachment pressures 5.5. Identifies encroachment impact on specific training activities to help Identifies encroachment impact on specific training activities to help

mitigation actions and investment decisionsmitigation actions and investment decisions

Innovative Technology in the Public InterestTM 16Innovative Technology in the Public InterestTM 16

For Copies of the Full Report:

• Paul.reinke@mitretek.orgPaul.reinke@mitretek.org• 703-610-1540703-610-1540