Measuring Technology MaturityMeasuring Technology Maturity

Actual system “flight proven” through successful mission operations

Actual system completed and “flight qualified” through test and demonstration

System prototype demonstration in a operational environment

System/subsystem model or prototype demonstration in a relevant environment

Component and/or breadboard validation in relevant environment

Component and/or breadboard validation in laboratory environment

Analytical and experimental critical function and/or characteristic proof-of-concept

Technology concept and/or application formulated

Basic principles observed and reported

System Test, Launch & Operations

System/Subsystem Development

Technology Demonstration

Technology Development

Research to Prove Feasibility

Basic Technology Research

TRL 9

TRL 8

TRL 7

TRL 6

TRL 5

TRL 4

TRL 3

TRL 2

TRL 1

Technology Readiness Levels Description

#1 Basic principles observed and reported

Scientific research begins translation to applied R & D (paper studies)

#2 Technology concept and/or application formulated

Basic principles documented and practical applications formulated (analytic studies)

#3 Analytical and experimental critical function and/or characteristic proof of concept

Active R & D initiated (physical validation in laboratory)

#4 Component and/or breadboard validation in laboratory environment

Component integration in “low-fidelity” laboratory environment (HIL/SIL simulation)

#5 Component and/or breadboard validation in relevant environment

Component/subsystem integration in “high-fidelity” laboratory environment (more realistic simulation)

#6 System/Subsystem model or prototype demonstration in a relevant environment

System/subsystem prototype evaluation in a simulated laboratory operational environment

#7 System prototype demonstration in an operational environment

Whole system prototype evaluation in actual operational environment (“open-air” or “at-sea”)

#8 Actual system completed and qualified through test and demonstration

Final phase of system development . . . validation of technical performance and compliance with design specifications

#9 Actual system proven through successful mission operations

Fuel mission evaluation in realistic operational conditions (combat environment, all-wx, typical operators, countermeasures, tactics, etc.)

TRLs

• Breadboard- Integrated components that provide a representation of a system/subsystem and which can be used to determine concept feasibility and to develop a technical data. Typically configured for laboratory use to determine the technical principles of immediate interest. May resemble final system/subsystem in function only.

• “High Fidelity”- Addresses form, fit and function. High-fidelity laboratory environment would involve testing with equipment that can simulate and validate all system specifications within a laboratory setting.

• “Low-Fidelity”- A representative of the component or system that has limited ability to provide anything but first order information about the end product. Low-fidelity assessments are used to provide trend analysis.

• Model- A functional form of a system, generally reduced in scale, near or at operational specification. Models will be sufficiently hardened to allow demonstration of the technical and operational capabilities required of the final system to include platform/packaging.

• Prototype: A physical or virtual model used to evaluate the technical or manufacturing feasibility or military utility of a particular technology or process, concept, end item or system.

• Relevant Environment- Testing environment that simulates the key aspects of the operational environment.

• Simulated Operational Environmental- Either 1) a real environment that can simulate all of the operational requirements and specifications required of the final system, or 2) a simulated environment that allows for testing of a virtual prototype; used in either case to determine whether a developmental system meets the operational requirements and specifications of the final systems

TRLs

• Findings from multiple studies attribute some program Findings from multiple studies attribute some program troubles to lack of technology maturity (TM)troubles to lack of technology maturity (TM)

• GAOGAO• QDRQDR• DAPADAPA• SSE/AS Program Support ReviewsSSE/AS Program Support Reviews

• “ “Programs that started development with immature Programs that started development with immature technologies experienced an average acquisition unit cost technologies experienced an average acquisition unit cost increase of nearly 21 percent” (GAO Report)increase of nearly 21 percent” (GAO Report)• FY06, PL 109-163, Section 801 requires USD(AT&L) FY06, PL 109-163, Section 801 requires USD(AT&L) certification, before Milestone B, that certification, before Milestone B, that “the technology in “the technology in the program has been demonstrated in a relevant the program has been demonstrated in a relevant environment”environment”• Above wording equates to Technology Readiness Level Above wording equates to Technology Readiness Level (TRL) 6(TRL) 6 Mr. Chris DiPetto, Deputy Director

Developmental Test & EvaluationNovember 7, 2006

Measuring Technology MaturityMeasuring Technology Maturity

Technology Readiness LevelsTechnology Readiness Levels(TRLs)(TRLs)

Actual system “flight proven” through successful mission operations

Actual system completed and “flight qualified” through test and demonstration

System prototype demonstration in a operational environment

System/subsystem model or prototype demonstration in a relevant environment

Component and/or breadboard validation in relevant environment

Component and/or breadboard validation in laboratory environment

Analytical and experimental critical function and/or characteristic proof-of-concept

Technology concept and/or application formulated

Basic principles observed and reported

System Test, Launch & Operations

System/Subsystem Development

Technology Demonstration

Technology Development

Research to Prove Feasibility

Basic Technology Research

TRL 9

TRL 8

TRL 7

TRL 6

TRL 5

TRL 4

TRL 3

TRL 2

TRL 1

Demonstrated atleast TRL 6

by Milestone B

Reaching TRL 6Reaching TRL 6

• TRL 6 definition – System/subsystem model or TRL 6 definition – System/subsystem model or prototype demonstrated in a relevant environmentprototype demonstrated in a relevant environment

• TRL 6 can be reached at the subsystem level. The TRL 6 can be reached at the subsystem level. The model or prototype, whether hardware or model or prototype, whether hardware or software, should show that the essential software, should show that the essential functionality is achievable.functionality is achievable.• For hardware, demonstrate the technology under For hardware, demonstrate the technology under

relevant conditions of the physical environment.relevant conditions of the physical environment.• For software, demonstrate the algorithms and processes For software, demonstrate the algorithms and processes

under relevant conditions of input data quality and rate.under relevant conditions of input data quality and rate.

• Relevant conditions are not ideal conditions. They Relevant conditions are not ideal conditions. They are stressing conditions but not necessarily the are stressing conditions but not necessarily the worst conditions imaginable.worst conditions imaginable.

TRA Lessons Learned TRA Lessons Learned

• Start earlyStart early• Early identification and agreement on critical Early identification and agreement on critical

technologiestechnologies• Flexibility required – No two TRAs will be the Flexibility required – No two TRAs will be the

samesame• Technology Readiness Assessment must be Technology Readiness Assessment must be

performed independently from Risk Assessmentperformed independently from Risk Assessment• Regular IPRsRegular IPRs

• Test data the most difficult to verifyTest data the most difficult to verify

• Working Group should include representatives Working Group should include representatives from PM, Component S&T Executive, Component from PM, Component S&T Executive, Component Acquisition Executive, and DUSD(S&T)Acquisition Executive, and DUSD(S&T)

System System IntegrationIntegration

System System DemoDemo

System Dev & DemonstrationSystem Dev & Demonstration

IOC

Defense Acquisition Management Defense Acquisition Management Framework Framework DoDI DoDI 5000.2

Defense Acquisition Management Defense Acquisition Management Framework Framework DoDI DoDI 5000.2

DesignReadiness

Review

LRIPLRIP

OperationsOperations& Support& Support

• Process entry points at Milestone A, B, or C

• Entrance criteria met before entering phase

• Evolutionary Acquisition or Single Step to Full Capability

• Integrate Integrate subsystems, subsystems, complete complete detailed design, detailed design, and reduce and reduce system-level risksystem-level risk

SystemIntegration

• Conduct AoA, refine Conduct AoA, refine initial concept & initial concept & develop Technology develop Technology Development Development StrategyStrategy

ConceptRefinement

FRPDecision Review

Full-Rate Prod &Deployment

• Full rate Full rate productionproduction

• Deployment of Deployment of systemsystem

ConceptConceptRefinementRefinement

TechnologyTechnologyDevelopmentDevelopment

Concept Decision

FRP & FRP & DeploymentDeployment

Production & DeploymentProduction & Deployment

Low-Rate InitialProduction

• Create Create efficient efficient manufacturinmanufacturing cap,LRIPg cap,LRIP

• IOT&E, LFT&E IOT&E, LFT&E of prod-rep of prod-rep articlesarticles

C

Pre-Systems AcquisitionPre-Systems Acquisition Systems AcquisitionSystems Acquisition SustainmentSustainment

User Needs & User Needs & Technology Technology

OpportunitiesOpportunities

FOC

• Complete developmentComplete development• Demonstrate ability of Demonstrate ability of

system to operate in system to operate in useful way consistent with useful way consistent with KPPsKPPs

• Combined DT/OTCombined DT/OT

SystemDemonstration

• Reduce technology risk & Reduce technology risk & determine the determine the appropriate set of appropriate set of technologies to be technologies to be integrated into a full integrated into a full systemsystem

• Demo the technologies in Demo the technologies in a relevant environmenta relevant environment

Technology Development

Funding:

Rqmnts:

BA 3/4 BA 5 BA 5/Procurement Proc/Operations & MaintenanceBA 5

CDD CPD

Validated & approved by operational validation authority

ICD

Increment II

Increment III

B DRR C FRP

B DRR C FRP

BA

1&21&2

3&43&4 6677

88

9955

Pacing Technologies: Cannon -

• Recoil Mitigation Munitions -

• Electro-Thermal-Chemical Propulsion • Seeker/Guidance & Control• Multi-Mode Warhead

Armament & Ammunition ATDArmament & Ammunition ATDAn Army ExampleAn Army Example

Objective: Demonstrate compact, direct/indirect fire armament system module capable of rapid lethality against the full spectrum of threats at 0-50km range.

“One Shot..….At Least One Kill”

“Precision Point Target Defeat”

NLOS 4-50KM BLOS 2-12km LOS 0-4Km

Warfighter Payoffs:• Heavy Force Lethality with a 105mm

> Multi-range - LOS, BLOS, & NLOS> Multi-Threat Capable

• Reduced logistic footprint> High number of stowed rounds

A Lightweight Armament System For Dominating the Red Zone and Beyond A Lightweight Armament System For Dominating the Red Zone and Beyond

TRL=6Seeker/G&C

METRIC:• 50-150m CEP to 50km• Ambient Temp functionality

TRL=4Seeker/G&CAcqDemo

METRICS:• Pacq/Enc to 8km via CFT Demo

TRL=4 ETC Propellant Demo

METRICS:Sub Scale firings of Gen II. Model to validate launch velocity.Full Scale Firing With Adv JA2. Validate integration

TRL=4Recoil MitigationDemo

METRICS:• 50% reduced recoil force w/Fire-out-of-battery modified M35 cannon w/ETC ignition

TRL=5Seeker/G&CHigh-gDemo

METRIC:• MP-ERM:

•18k g’s air gun test

• Cargo:• 20k g’s air gun test

FY01 FY02 FY03 FY04 FY05 FY06 FY07

Cannon

TRL=5PropulsionDemo

METRICS:Fire Full Scale Case Telescoped Ammo, Demo M829A2 + 20% performance

TRL=5Recoil MitigationDemo

METRICS:• <80K lbs hardstand firing of KE slugs

TRL=5Multi-ModeWHD

METRIC:• Shaped Charge

• L/D=1 (vs 1.7)• EFP

• 25% increase in armor penetration

TRL=6Multi-ModeWHD

METRIC:• Integrated WHD demo of 3 lethality modes

TRL=6Seeker/G&C

METRIC:• Pacq/Enc via Integ Projectile Guide to Hit gun launch to 10km

TRL=7Systems Level Live fire demo of Ammo Suite

METRICS:• Turret integrated on candidate vehicle

Armament & Ammunition ATDArmament & Ammunition ATDAn Army ExampleAn Army Example