Upload
jag
View
28
Download
1
Embed Size (px)
DESCRIPTION
Impact of Encroachment on Military Training Quality A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges National Defense Industrial Association 30 th Environmental and Energy Symposium and Exhibition April 7, 2004. Study Objective. - PowerPoint PPT Presentation
Citation preview
Innovative Technology in the Public InterestTM 11Innovative Technology in the Public InterestTM 11
Impact of Encroachment on Military Training Quality
A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges
National Defense Industrial Association 30th Environmental and Energy Symposium and Exhibition
April 7, 2004
Impact of Encroachment on Military Training Quality
A Framework and Methodology for Establishing Degraded Military Skills Due to Encroachment of Training Ranges
National Defense Industrial Association 30th Environmental and Energy Symposium and Exhibition
April 7, 2004
Innovative Technology in the Public InterestTM 22Innovative Technology in the Public InterestTM 22
Study ObjectiveStudy Objective
Create a methodology that determines the Create a methodology that determines the contribution and significance of encroachment and contribution and significance of encroachment and training workarounds to degraded mission skills.training workarounds to degraded mission skills.
Create a methodology that determines the Create a methodology that determines the contribution and significance of encroachment and contribution and significance of encroachment and training workarounds to degraded mission skills.training workarounds to degraded mission skills.
Innovative Technology in the Public InterestTM 33Innovative Technology in the Public InterestTM 33
Reviewed Previous EffortsReviewed Previous Efforts
• Skills Based Training (CNA) Skills Based Training (CNA)
• Camp Pendleton (USMC and SRA)Camp Pendleton (USMC and SRA)
• SAF/IE Capacity Analysis (BAH)SAF/IE Capacity Analysis (BAH)
• ATTAC & ISR Enhancements (Army DCSOPS/G3)ATTAC & ISR Enhancements (Army DCSOPS/G3)
• Navy Range Needs Assessment -- Air to Ground Navy Range Needs Assessment -- Air to Ground Ranges (N44)Ranges (N44)
• PACFLEET Encroachment Matrix (N433)PACFLEET Encroachment Matrix (N433)
• Skills Based Training (CNA) Skills Based Training (CNA)
• Camp Pendleton (USMC and SRA)Camp Pendleton (USMC and SRA)
• SAF/IE Capacity Analysis (BAH)SAF/IE Capacity Analysis (BAH)
• ATTAC & ISR Enhancements (Army DCSOPS/G3)ATTAC & ISR Enhancements (Army DCSOPS/G3)
• Navy Range Needs Assessment -- Air to Ground Navy Range Needs Assessment -- Air to Ground Ranges (N44)Ranges (N44)
• PACFLEET Encroachment Matrix (N433)PACFLEET Encroachment Matrix (N433)
Innovative Technology in the Public InterestTM 44Innovative Technology in the Public InterestTM 44
Review FindingsReview Findings
• Training Range and Facility Impact Analysis Methodologies…Training Range and Facility Impact Analysis Methodologies…- Focus on resource optimization (i.e., capacity analysis) and constraints on Focus on resource optimization (i.e., capacity analysis) and constraints on
full/effective usefull/effective use- Link Encroachment to Training Facility Mission Link Encroachment to Training Facility Mission - May not directly address effect of Encroachment on Training QualityMay not directly address effect of Encroachment on Training Quality- Encroachment Effect measured by Percentage of Land Available or Maps of Usable Encroachment Effect measured by Percentage of Land Available or Maps of Usable
Facility, etc.Facility, etc.
• Readiness Impact Analysis Methodologies …Readiness Impact Analysis Methodologies …- Tie Location to a Training Requirement (Mission Essential Task)Tie Location to a Training Requirement (Mission Essential Task)- Link Encroachment to Readiness RatingLink Encroachment to Readiness Rating- May not directly link a Readiness Rating to a Specific RangeMay not directly link a Readiness Rating to a Specific Range- May not address the May not address the significancesignificance of an encroachment factor on a Readiness Rating of an encroachment factor on a Readiness Rating
• Training Range and Facility Impact Analysis Methodologies…Training Range and Facility Impact Analysis Methodologies…- Focus on resource optimization (i.e., capacity analysis) and constraints on Focus on resource optimization (i.e., capacity analysis) and constraints on
full/effective usefull/effective use- Link Encroachment to Training Facility Mission Link Encroachment to Training Facility Mission - May not directly address effect of Encroachment on Training QualityMay not directly address effect of Encroachment on Training Quality- Encroachment Effect measured by Percentage of Land Available or Maps of Usable Encroachment Effect measured by Percentage of Land Available or Maps of Usable
Facility, etc.Facility, etc.
• Readiness Impact Analysis Methodologies …Readiness Impact Analysis Methodologies …- Tie Location to a Training Requirement (Mission Essential Task)Tie Location to a Training Requirement (Mission Essential Task)- Link Encroachment to Readiness RatingLink Encroachment to Readiness Rating- May not directly link a Readiness Rating to a Specific RangeMay not directly link a Readiness Rating to a Specific Range- May not address the May not address the significancesignificance of an encroachment factor on a Readiness Rating of an encroachment factor on a Readiness Rating
To meet our objective both methodologies needed to be harmonized and enhanced
Innovative Technology in the Public InterestTM 55Innovative Technology in the Public InterestTM 55
Developed a Conceptual FrameworkDeveloped a Conceptual Framework
Range Capability
Mission Requirement
METLS
Completion Completion RatesRates
Training Training TasksTasks
Range Range CapacityCapacity
Skill Proficiency
Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Training and Results in Degraded Skill ProficiencyTraining and Results in Degraded Skill Proficiency
Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Assumption: Encroachment Limits Capacity and Forces Workarounds that Negatively Impact Training and Results in Degraded Skill ProficiencyTraining and Results in Degraded Skill Proficiency
Innovative Technology in the Public InterestTM 66Innovative Technology in the Public InterestTM 66
Conceptual ModelConceptual Model
Range Capacity to Range Capacity to Support METLSupport METL
METL Task METL Task Completion RateCompletion Rate
Estimated Estimated Effectiveness Effectiveness
Per Training TaskPer Training Taskxx
Skill Skill Proficiency Proficiency
ScoreScore=
Impacted Training ProficiencyImpacted Training Proficiency
Innovative Technology in the Public InterestTM 77Innovative Technology in the Public InterestTM 77
Concept ElementsConcept Elements
1.1. IdentifyIdentify- Specific Combat Missions Specific Combat Missions - Combat Units and their Training/OPAREAsCombat Units and their Training/OPAREAs- Unit METLsUnit METLs
2.2. Obtain DataObtain Data- Interview Units based at specific installations and OPAREAsInterview Units based at specific installations and OPAREAs- Interview OPAREA and Training Range managersInterview OPAREA and Training Range managers- Relate contribution of conditions to training and skill acquisition Relate contribution of conditions to training and skill acquisition
performanceperformance• Internal (logistics, schedules, certifications, etc.)Internal (logistics, schedules, certifications, etc.)• External (weather, deployment, encroachment, safety)External (weather, deployment, encroachment, safety)
1.1. IdentifyIdentify- Specific Combat Missions Specific Combat Missions - Combat Units and their Training/OPAREAsCombat Units and their Training/OPAREAs- Unit METLsUnit METLs
2.2. Obtain DataObtain Data- Interview Units based at specific installations and OPAREAsInterview Units based at specific installations and OPAREAs- Interview OPAREA and Training Range managersInterview OPAREA and Training Range managers- Relate contribution of conditions to training and skill acquisition Relate contribution of conditions to training and skill acquisition
performanceperformance• Internal (logistics, schedules, certifications, etc.)Internal (logistics, schedules, certifications, etc.)• External (weather, deployment, encroachment, safety)External (weather, deployment, encroachment, safety)
IdentifyIdentifyIdentifyIdentify Obtain DataObtain DataObtain DataObtain Data AnalyzeAnalyzeAnalyzeAnalyze CorrectCorrectCorrectCorrect
Innovative Technology in the Public InterestTM 88Innovative Technology in the Public InterestTM 88
Concept Elements (concluded)Concept Elements (concluded)
3.3. AnalyzeAnalyze- Calculate proficiency impactsCalculate proficiency impacts- Perform comparative impact analysesPerform comparative impact analyses- Determine root causes of skill proficiency impactsDetermine root causes of skill proficiency impacts- Identify options to mitigate the impact of root causes on skill Identify options to mitigate the impact of root causes on skill
proficiencyproficiency
4.4. CorrectCorrect- Determine which root cause factors should be addressed locally, Determine which root cause factors should be addressed locally,
regionally, or nationallyregionally, or nationally- Assign responsibility for corrective actionAssign responsibility for corrective action
3.3. AnalyzeAnalyze- Calculate proficiency impactsCalculate proficiency impacts- Perform comparative impact analysesPerform comparative impact analyses- Determine root causes of skill proficiency impactsDetermine root causes of skill proficiency impacts- Identify options to mitigate the impact of root causes on skill Identify options to mitigate the impact of root causes on skill
proficiencyproficiency
4.4. CorrectCorrect- Determine which root cause factors should be addressed locally, Determine which root cause factors should be addressed locally,
regionally, or nationallyregionally, or nationally- Assign responsibility for corrective actionAssign responsibility for corrective action
IdentifyIdentifyIdentifyIdentify Obtain DataObtain DataObtain DataObtain Data AnalyzeAnalyzeAnalyzeAnalyze CorrectCorrectCorrectCorrect
Innovative Technology in the Public InterestTM 99Innovative Technology in the Public InterestTM 99
Five Step Methodology for Concept ValidationFive Step Methodology for Concept Validation
2. Site Visits
Unit SurveyUnit Survey
Range SurveyRange Survey
1. Target Specific Units
Identify Characteristics of Ranges and Training Areas
Identify Characteristics of Ranges and Training Areas
Unit METLUnit METL
DatabaseDatabase
3. Data Inputs
4. Impact Analysis
Baseline Impact AnalysisBaseline Impact Analysis
Survey Report Impact Analysis
Survey Report Impact Analysis
5. Root Cause Analysis
Database Reports on Specific METL Activities
Database Reports on Specific METL Activities
Innovative Technology in the Public InterestTM 1010Innovative Technology in the Public InterestTM 1010
Concept Validation Field StudyStep 1: Target Specific UnitsConcept Validation Field StudyStep 1: Target Specific Units
• Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers of the Squadron’s training rangesof the Squadron’s training ranges- Naval Auxiliary Landing Field (NALF), VANaval Auxiliary Landing Field (NALF), VA- Dare County Bombing Range, NCDare County Bombing Range, NC- TACTS ranges comprising Virginia Capes, MD, VA, NCTACTS ranges comprising Virginia Capes, MD, VA, NC- Fallon Range Training CenterFallon Range Training Center
• Four core mission skill sets analyzedFour core mission skill sets analyzed- MobilityMobility- Strike warfareStrike warfare- Anti-air warfareAnti-air warfare- Amphibious warfareAmphibious warfare
• Each mission has a defined number of tasks for trainingEach mission has a defined number of tasks for training
• Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers Surveyed Navy F-14B (Tomcat) Carrier Air Wing Fighter Squadron and managers of the Squadron’s training rangesof the Squadron’s training ranges- Naval Auxiliary Landing Field (NALF), VANaval Auxiliary Landing Field (NALF), VA- Dare County Bombing Range, NCDare County Bombing Range, NC- TACTS ranges comprising Virginia Capes, MD, VA, NCTACTS ranges comprising Virginia Capes, MD, VA, NC- Fallon Range Training CenterFallon Range Training Center
• Four core mission skill sets analyzedFour core mission skill sets analyzed- MobilityMobility- Strike warfareStrike warfare- Anti-air warfareAnti-air warfare- Amphibious warfareAmphibious warfare
• Each mission has a defined number of tasks for trainingEach mission has a defined number of tasks for training
Innovative Technology in the Public InterestTM 1111Innovative Technology in the Public InterestTM 1111
Concept Validation Field Study
Step 2: Data/Information CollectionConcept Validation Field Study
Step 2: Data/Information Collection
• SurveysSurveys- Range-specific QuestionnaireRange-specific Questionnaire
• Given to range managers, environmental staff, logistics personnel, Given to range managers, environmental staff, logistics personnel, training event plannerstraining event planners
• 27 questions focused on range characteristics, encroachment 27 questions focused on range characteristics, encroachment present, knowledge of training workaroundspresent, knowledge of training workarounds
- Unit-level QuestionnaireUnit-level Questionnaire
• Given to unit commanders and unit training officersGiven to unit commanders and unit training officers• 16 questions focused on training to task, supplemental training, and 16 questions focused on training to task, supplemental training, and
training effectivenesstraining effectiveness
• SurveysSurveys- Range-specific QuestionnaireRange-specific Questionnaire
• Given to range managers, environmental staff, logistics personnel, Given to range managers, environmental staff, logistics personnel, training event plannerstraining event planners
• 27 questions focused on range characteristics, encroachment 27 questions focused on range characteristics, encroachment present, knowledge of training workaroundspresent, knowledge of training workarounds
- Unit-level QuestionnaireUnit-level Questionnaire
• Given to unit commanders and unit training officersGiven to unit commanders and unit training officers• 16 questions focused on training to task, supplemental training, and 16 questions focused on training to task, supplemental training, and
training effectivenesstraining effectiveness
Innovative Technology in the Public InterestTM 1212Innovative Technology in the Public InterestTM 1212
Concept Validation Field StudyConcept Validation Field StudyStep 3: Data InputsStep 3: Data Inputs
Interview specific to selected Mission Training Interview specific to selected Mission Training activities [COMNAVAIRFORINST 3500.1 and activities [COMNAVAIRFORINST 3500.1 and
COMNAVSURFORINST 3502.1]COMNAVSURFORINST 3502.1] Carrier (CVW) Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A) Encroachment Impact Analysis
Training to Task Question Series
Supplemental Training Question Series
Estimate of Training Effectiveness Question Series
Core Missions / Tasks COMNAVAIRFORINST 3500.1
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Strike Fighter Squadron (VF/VFA) (F/A-18C, F-14A)
Mobility (MOB) (4) Air Navigation (MOB 201) Field Carrier Landing Practice (MOB 202)
Carrier Qualification (MOB 203) Inflight Refueling (MOB 204) MSN/Recovery Tanker (MOB 205) Strike Warfare (STW) (30) Target Acquisition (STW 201) Target Attack-Visual (STW 202) Target Attack-Sensor (STW 203) Target Attack-GPS (STW 204) Air-to-Ground Strafe (STW 205) Paraflare BMB (STW 206) SACT (STW 207) Low Altitude Tactics Training (STW 208)
Low Level (STW 209) Night Vision Device Low Level (STW 210)
LST (STW 211) Self-Escort Strike (STW 212) Coordinated/CVW/Joint Strike (STW 213)
Anti-Surface Warfare (STW 214) Close Air Support/Forward Air Controller (Airborne) (STW 215)
Combat Search and Rescue/ RESCAP/RESCORT (STW 216)
Coordinated MINEX (STW 217) Reconnaissance (STW 218) High-Speed Anti-Radiation Missile/
Example:Example: VF/VFA (F/A-18C, F14A) VF/VFA (F/A-18C, F14A)•MobilityMobility•Strike WarfareStrike Warfare•Antiair WarfareAntiair Warfare•Amphibious WarfareAmphibious Warfare•Antisurface WarfareAntisurface Warfare•Mine WarfareMine Warfare
Responses captured and entered Responses captured and entered into a database for analysisinto a database for analysis
Generic Survey with METL-specific ResponsesGeneric Survey with METL-specific Responses
Innovative Technology in the Public InterestTM 1313Innovative Technology in the Public InterestTM 1313
Concept Validation Field Study Training Step 4: Impact Analysis Concept Validation Field Study Training Step 4: Impact Analysis
• An algorithm is used to calculate “scores” for baselined and survey reported METL performance data to enable variance analysis
• Similar scores for Baselined and Reported METL performance indicates training/workarounds are successful
• Dissimilar scores for baselined and reported METL performance indicates proficiency issues; requires Root Cause analysis.
• “Strike Warfare” example above illustrates which scores need root cause analysis
Training Quality Impact Analysis Tool Populated with Field Study DataTraining Quality Impact Analysis Tool Populated with Field Study Data
Mission Type for CVW Fighter
Squadron (F-14B)
Actual Range Complex
Capabilities (a)
Required Range
Capabilities (b)
Range Capability Index (a/b)
Tasks Completed (c)
Total METL Tasks (d)
Task Completion Index (c/d)
Encroachment Factors
Impacting Training (e)
Total Encroachment
Factors Present (f)
Encroachment Impact Index (e/f)
Actual Effectiveness
Score (h)
Maximum Effectiveness
Score (i)
Effectiveness Index (h/i)
Impacted Training Quality Score (z)
Mobility: Baseline 3 4 0.75 5 5 1.00 1 2 0.5 40 40 1.000 27Mobility: Survey Responses 3 4 0.75 4 5 0.80 4 7 0.6 33 40 0.825 24
Strike Warfare: Baseline 8 13 0.62 19 19 1.00 1 3 0.3 128 128 1.000 49Strike Warfare: Survey Responses 8 13 0.62 1 19 0.05 3 8 0.4 16 128 0.125 103
Amphibious Warfare: Baseline 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30
Amphibious Warfare: Survey Responses 1 1 1.00 1 1 1.00 1 3 0.3 8 8 1.000 30
Innovative Technology in the Public InterestTM 1414Innovative Technology in the Public InterestTM 1414
Concept Validation Field Study: Step 5: Root Cause Analysis via DatabaseConcept Validation Field Study: Step 5: Root Cause Analysis via Database
• Allowed trace-back to main root causesAllowed trace-back to main root causes- Munitions use restrictionsMunitions use restrictions- Inadequate physical conditionsInadequate physical conditions- Inadequate training facilityInadequate training facility
• Analysis revealed specific reasons for lower-than-expected Analysis revealed specific reasons for lower-than-expected training proficiency skills and task completion rates in strike training proficiency skills and task completion rates in strike warfarewarfare
- Physical ability of the range or training area to accept additional increases in user demand (capacity Physical ability of the range or training area to accept additional increases in user demand (capacity constraints)constraints)
- Training airspace corridors (private and commercial encroachment)Training airspace corridors (private and commercial encroachment)- Restrictions on munitions use due to resources need to clean or clear material from the ranges Restrictions on munitions use due to resources need to clean or clear material from the ranges
(safety concerns, fire hazards, ESA)(safety concerns, fire hazards, ESA)- Electronic equipment and general safety (logistics supply)Electronic equipment and general safety (logistics supply)- Hours of operation restrictions (community issues with noise)Hours of operation restrictions (community issues with noise)
• Allowed trace-back to main root causesAllowed trace-back to main root causes- Munitions use restrictionsMunitions use restrictions- Inadequate physical conditionsInadequate physical conditions- Inadequate training facilityInadequate training facility
• Analysis revealed specific reasons for lower-than-expected Analysis revealed specific reasons for lower-than-expected training proficiency skills and task completion rates in strike training proficiency skills and task completion rates in strike warfarewarfare
- Physical ability of the range or training area to accept additional increases in user demand (capacity Physical ability of the range or training area to accept additional increases in user demand (capacity constraints)constraints)
- Training airspace corridors (private and commercial encroachment)Training airspace corridors (private and commercial encroachment)- Restrictions on munitions use due to resources need to clean or clear material from the ranges Restrictions on munitions use due to resources need to clean or clear material from the ranges
(safety concerns, fire hazards, ESA)(safety concerns, fire hazards, ESA)- Electronic equipment and general safety (logistics supply)Electronic equipment and general safety (logistics supply)- Hours of operation restrictions (community issues with noise)Hours of operation restrictions (community issues with noise)
Innovative Technology in the Public InterestTM 1515Innovative Technology in the Public InterestTM 1515
Project ConclusionsProject Conclusions
1.1. Field study validated concept and methodologyField study validated concept and methodology2.2. Identified specific impacts from encroachment vs. range capacity Identified specific impacts from encroachment vs. range capacity
constraintsconstraints3.3. Method able to identify root causes of degraded trainingMethod able to identify root causes of degraded training4.4. Effort builds on capacity analysis models of encroachment: Effort builds on capacity analysis models of encroachment:
- Uses existing data from range inventoryUses existing data from range inventory- Uses official Service METLs or training instructions to baseline proficiency Uses official Service METLs or training instructions to baseline proficiency
requirements against actual training resultsrequirements against actual training results- Integrates mission training impacts (delayed, modified, relocated, cancelled) with Integrates mission training impacts (delayed, modified, relocated, cancelled) with
encroachment pressures encroachment pressures
5.5. Identifies encroachment impact on specific training activities to help Identifies encroachment impact on specific training activities to help mitigation actions and investment decisionsmitigation actions and investment decisions
1.1. Field study validated concept and methodologyField study validated concept and methodology2.2. Identified specific impacts from encroachment vs. range capacity Identified specific impacts from encroachment vs. range capacity
constraintsconstraints3.3. Method able to identify root causes of degraded trainingMethod able to identify root causes of degraded training4.4. Effort builds on capacity analysis models of encroachment: Effort builds on capacity analysis models of encroachment:
- Uses existing data from range inventoryUses existing data from range inventory- Uses official Service METLs or training instructions to baseline proficiency Uses official Service METLs or training instructions to baseline proficiency
requirements against actual training resultsrequirements against actual training results- Integrates mission training impacts (delayed, modified, relocated, cancelled) with Integrates mission training impacts (delayed, modified, relocated, cancelled) with
encroachment pressures encroachment pressures
5.5. Identifies encroachment impact on specific training activities to help Identifies encroachment impact on specific training activities to help mitigation actions and investment decisionsmitigation actions and investment decisions
Innovative Technology in the Public InterestTM 1616Innovative Technology in the Public InterestTM 1616
For Copies of the Full Report:For Copies of the Full Report:
• [email protected]@mitretek.org
• 703-610-1540703-610-1540
• [email protected]@mitretek.org
• 703-610-1540703-610-1540