Upload
shamar-wasden
View
216
Download
0
Tags:
Embed Size (px)
Citation preview
WBC Leadership Review Slides
WBC Collaboration
“We want to engage with customers to help us all understand what will be delivered at each stage, capture any missing, changed or delayed requirements and ensure a positive Customer Experience”
To do this we:
• Hold frequent bilaterals
• Encourage direct customer involvement
• Provide “War Room” Support
• Flexibly reprioritise each 90 day development cycle
• Add and amend requirements with our customers
We need to take this approach forward into the End to End testing world.
WBC – Providing a Positive Customer Experience
“We are aiming for a Smooth and Seamless CE delivered through joint testing & collaborative development and communications”
We do this with:
• A CE roadmap planned and measured throughout the trial, launch and in-life stages of WBC.
• Use measurable CE targets to share underlying test results with customers, rather than getting bogged down in reams of test results.
• We focus on delivering a positive E2E CE for BTW, the CP and their EU customers.
• We help customers deliver a marketing and sales message based on the CE delivered by the product.
WBC CE Roadmap - High Level View Milestones
High Level Measures POCService
TrialCustomer Trial (1)
Launch(Apr 08)
Customer Trial (2)
In Life(Q3)
Mar-09Commit
QoS & CE Provide to ODD L2C AP/EP NA NA 96% 96% 96% 96% 96%
ELFs L2C AP/EP NA NA 7% 7% 7% 7% 4%(1)
RFT L2C EUA 80% 80% 85% 85% 87% 87% 95%
ELF EUA N/A 8% 8% 8% 8% 7% 4%(1)
RFT T2R EUA 50% 50% 60% 60% 65% As 20C 95% (6)
Repeat Reports N/A 20% 20% 20% As 20C As 20C As 20C (7)
Cleared in objective time T2R AP/EP NA NA 86% 86% 86% 86% 86%
Repeats T2R AP/EP NA NA 18% 18% 18% 18% 18%
Provisioning exceptions Migrations NA NA 3% 2% 2% 1% 1%
ELFs Migrations NA NA 8% 8% 8% 7% 4%(1)
CT L2C EUA 8WD 6.5WD 5WD 5WD 5WD 5WD
SelectableLead time(2)1 Hr (3)
CT L2C AP/EP N/A 23WD 10WD 10WD 10WD 10WD 5WD(4)
CT T2R EUA <96Hrs <72Hrs <50Hrs <40Hrs <40Hrs <40Hrs 2-24 (5)
CT T2R AP/EP N/A 7Hrs 7Hrs 6Hrs 6Hrs 6Hrs 5Hrs
In-life Fault Rate N/A N/A N/A 0.1 0.1 0.1 0.08
Billing Accuracy N/A N/A 100% 100% 100% 100% 100%
CP satisfaction with WBC service. NA 60% 80% 90% 80% 90% 90% (8)
WBC CE Roadmap – Consolidates underlying CE criteria and test results
Division/Author/OwnerMay 9, 2006www.btwholesale.com
WBC CE Roadmap - High Level View
NA
N/A
N/A
N/A
<96Hrs
N/A
8WD
NA
NA
NA
NA
N/A
50%
N/A
80%
NA
NA
POC
1%1%2%2%3%NAProvisioning exceptions Migrations
As 20C (7)As 20CAs 20C20%20%20%Repeat Reports
95%87%87%85%85%80%RFT L2C EUA
90% (8)90%80%90%80%60%CP satisfaction with WBC service.
100%100%100%100%100%N/ABilling Accuracy
0.080.10.10.1N/AN/AIn-life Fault Rate
5Hrs6Hrs6Hrs6Hrs7Hrs7HrsCT T2R AP/EP
2-24 (5)<40Hrs<40Hrs<40Hrs<50Hrs<72HrsCT T2R EUA
5WD(4)10WD10WD10WD10WD23WDCT L2C AP/EP
SelectableLead time(2)1 Hr (3)5WD5WD5WD5WD6.5WDCT L2C EUA
4%(1)7%8%8%8%NAELFs Migrations
18%18%18%18%18%NARepeats T2R AP/EP
86%86%86%86%86%NACleared in objective time T2R AP/EP
95% (6)As 20C65%60%60%50%RFT T2R EUA
4%(1)7%8%8%8%8%ELF EUA
4%(1)7%7%7%7%NAELFs L2C AP/EP
96%96%96%96%96%NAProvide to ODD L2C AP/EPQoS & CE
Mar-09Commit
In Life(Q3)
Customer Trial (2)
Launch(Apr 08)
CustomerTrial (1)
Service TrialHigh Level Measures
Milestones
Trial & launch success criteria – customer service requirements
As 20CAs 20CAs 20CAs 20C20%60%NAMaximum % CP manual handlingSupport/ Resource
100%100%99%99%95%90%NAEUA & AP/EP Product Compliance with Handbook, STINs etc
100%100%99%99%95%90%TBDEUA & AP/EP availability of product functionality
Product Functionality
99.995%TBDTBDTBDTBDTBDTBDNetwork service availability (including planned outages)
6.1.46.1.46.1.45.0.35.0.35.0.35.0.3Network releases availabilityNetwork
Same as IPstream
16%18% total order types
15% provide, cease, modify
20% simprovide
20% provide, cease & modify
50% simprovide
60% provide, cease & modify
100%Maximum % Customer Service manual handling
99%99%99%99%90%50%NASuccess rate of T2R transactions
99%99%99%99%90%50%NASuccess rate of L2C transactions
5000OSS live test environment requirement volume dependency
TBDTBDTBDTBDTBDTBDTBDBB E2E system response time (L2C & T2R) - latency
99%99%99%99%90%50%NABB E2E system & OSS network availability (inc planned outages)
TBDCycle 8Cycle 8Cycle 7Cycle 6Cycle 5ManualDevelopment cycle availabilityOSS
2mTBD200003000300025015EUA volume ramp-up profile (up to)Volume Profiles
Mar-09CommitIn Life
Customer Trial (2)Launch
Customer Trial (1)
Service TrialPOCHigh Level Measures
Milestones
Trial & launch success criteria – CP & EU requirements
TBDTBDTBDTBDTBDTBDTBDEtc – to be determined
90%90%80%90%80%60%NAEU Perception of WBC Service
40%40%40%40%40%NANA% on higher line rate than Max
5%5%5%5%10%NANA% on lower line rate than Max
0.005%0.005%0.005%0.005%0.05%0.5%NA% flappers
5 days5 days5 days8 days10 daysNANATime to stabiliseQoS & CE
Mar-09CommitIn Life
Customer Trial (2)Launch
CustomerTrial (1)
Service TrialPOCHigh Level Measures
Milestones
Trial & launch success criteria – customer migration additional requirements
TBDTBDTBDTBDTBDTBDTBDEtc – to be determined
TBDTBDTBDTBDTBDTBDTBDVolume supported
TBDTBDTBDTBDTBDTBDTBDNo of single line regressions
TBDTBDTBDTBDTBDTBDTBDAve time out of service
TBDTBDTBDTBDTBDTBDTBDNo of outagesQoS & CE
Mar-09CommitIn Life
Customer Trial (2)Launch
CustomerTrial (1)
Service TrialPOCHigh Level Measures
Milestones
1-Urgent2-High
Defects - Age Graph
Times: D-Days, W-Weeks, M-Months, Y-Years
0D
1D
2D
3D
4D
5D
6D
1W
2W
3W
4W 1M
2M
3M
4M
5M
6M
7M
8M
Nu
mber
of D
efe
cts
40
35
30
25
20
15
10
5
0
27
9
2
14
10
13
10
23
12
5
2
38
10
31 1
3 21
4.081.473.2Test run rate4.080.943.2Pass run rate
19/11/2007
12/11/2007UAT Start date - duration 30 days
RequiredActualPlanned
8No. of tests in flight2No. of tests descoped
32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible
21%% Passed77No. of tests possible
1Failed19No. of tests blocked16Passed98Initial no. of tests
wBc Q2/Cycle 6 L2C IVVT High level progress
4.081.473.2Test run rate4.080.943.2Pass run rate
19/11/2007
12/11/2007UAT Start date - duration 30 days
RequiredActualPlanned
8No. of tests in flight2No. of tests descoped
32%% Tests possible complete10%% Inflight25Total number of tests run1%% Failed79%% of initial no. possible
21%% Passed77No. of tests possible
1Failed19No. of tests blocked16Passed98Initial no. of tests
wBc Q2/Cycle 6 L2C IVVT High level progress
High Level View
Lower Level CE Support Requirements Detailed network &
IVV&T results
WBC product overview
CP
CMSANs
Aggregation Point 1
Metros
BRAS
Aggregation Point 20
*
*
*EU
*
*
*EU
MSIL
MSIL Downstream Network
WBC – three main components
EUA Aggregation Point & Extension Path
Customer Network & Interconnect
123
What Does End to End Testing Mean for WBC? ->
WBC End to End Testing overview
CP
CMSANs
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
*
*
*EU
*
*
*EU
MSIL
MSIL Downstream Network
CP
CMSANs
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
AggregationPoint 1
Metros
BRAS
AggregationPoint 20
*
*
*EU
**
**
**EU
*
*
*EU
**
**
**EU
MSIL
MSIL Downstream Network
123Internet
End Users CP Help Desks Web Portals
CPE
B2B GatewaysBTW SMC
VOIP
VAD/ IPTV
WBC ProductCP Servers &
Interface
People OSS
Support Systems
CPE Compatibility Testing is also a key component of the E2E testing story for Customers