Assuring Quality of Experience in Dynamic NetworksGaining Full End-user Visibility Through Programmable Test & Measurement
Marcus Friman, CPO & Co-founder
Ensuring an Awesome Experience in the Connected World
The Two Most Important Lessons Today
Biggest challenges for ensuring exceptional end user experience
Why programmable, active testing is a “must-have”
1
2
Actions Helping You Reach Your Top Goals
Main Goals for Agile Operators
Improved customersatisfaction
Operational costs & resources
Capture new revenue opportunities more quickly
1
2
3
Agile
Orchestrated
Assured
6
MEF’s Third Network Vision
Main Goals for Agile Operators
Challenges – and Solutions
Assuring Quality of Experience in Dynamic Networks
Only 2 Processes Matter
”The time it takes to provide me with a service after you have introduced it to me...”- ”Once delivered, was it right?”
”When things go wrong, how long does it take for you to notice the issue and fix it?”
- Matt Beal, Vodafone CTO Office
1
2
What Matters for Customers
Deliver Fast and keep your Promise (deliver right)
Detect Issues with My Service
Minimize PerformanceDegradation Time
Service Life Cycle
Fulfillment1
2
3
Assurance
Troubleshooting (Assurance)
1
23
Mapping Customer Demands to Service Lifecycle
10
Service Activation Testing and Troubleshooting
$$$
PASSIVE METHOD
ACTIVE NON-SW METHOD(S)
Check device counters Comprehensive testing in the field
Inadequate but fast Sufficient but slow
ICMP ping
Service Activation Testing and Troubleshooting
PASSIVE METHOD
Check device counters
Inadequate but fast
ICMP ping Automated, comprehensive testing
Sufficient AND FAST
THIS IS REQUIRED!
ACTIVE SW METHOD(S)
A Problem Today – CRITICAL Tomorrow
Deployed → Updated → Scaled in → Scaled out → Reconfigured → Redeployed
VNFVNFValue–added
servicesVNF VNF
Frequent changesShared resourcesIncreased complexity
?
Another Operator Pain Point
- James Crawshaw, Senior Analyst of OSS/BSS Transformation, Heavy Reading
“…another operator pain point is service assurance. How do you ensure the service you are delivering is meeting the quality that the customer expects? How do you pinpoint problems?”
Confirmed by Telecoms.com survey
What do you consider to be the biggest challenge of ensuring exceptional end user experience?
Delivering new services faster and right the first time (agile service creation)
Detecting and correcting failed services before the customer notices
Eliminating manual efforts that prevent full automation of fulfilment and assurance workflows
Other (please specify)
Conclusion #1: Add Active Testing to Service Model
What Matters for Customers
Deliver Right the First Time
Quickly Detect Issues with My Service
Minimize PerformanceDegradation Time
Service Life Cycle
Fulfillment
Assurance
Troubleshooting (Assurance)
Quality Monitoring and Assurance
1
2
3
NFV Alone Will Not Make Assurance Easier
Service
“Everything looks ok.”
?
! “My service is not working”
vFW
vWAN
Are my switches up?
How much CPU load?
Interface counters?
Automation and Control Theory
Control Loop for Assuring QoE in Dynamic Networks
Service SLA and KPI requirements Service
Orchestrator
E2E Service
?
Must add e2e service quality insights
Control Loop for Assuring QoE in Dynamic Networks
Service SLA and KPI requirements Service
Orchestrator
E2E Service
Measured SLAs and KPIs
Virtual Test Agent
(virtual user)
Conclusion #2: Add Active Assurance to Service Model
The Service Orchestration Loop
Introducing Orchestrated Active Assurance
Service Assurance
PM FM
Device Counters Passive Monitoring
EventsActive Monitoring Alarms
Service Fulfillment
Service Activation
Test Service E2E TroubleshootingLogs
OrchestratedActiveAssurance
1
23 This adds Active Network Analytics Insight
Software is Key to Solving Existing Challenges
Service Life Cycle
Service Delivery
Ongoing Assurance
Problem Resolution
1
2
3
Key Success Factors
Multi LayerActivation Testing
ActiveMonitoring
Automatic Troubleshooting
Loss, Delay, JitterQoS Preservation
Video/Voice QualityServer Latency
TCP Throughput
One YANG Model Covering All Phases of The Life Cycle
Service Life Cycle
Fulfillment
Assurance
Troubleshooting (Assurance)
Key Success Factors
Mapping to the ETSI NFV ArchitectureStep 1: Fully automated & programmable active test platform
2016 2020
Service Quality
Management
Orchestrator
EM
VNF VNF
EM
Virtual Compute Virtual Storage Virtual Network
Network HardwareStorage HardwareComputing Hardware
Virtualization Layer
VNF Managers
Service, VNF & Infrastructure Description
Virtual Infrastructure
Manager
VNF VNF
NFVI
EM
Virtual Test Agent
Test Controller
Test Results Analysis Module
Control Center
OSS / BSS
Fault Management
Performance Management
19
The Two Most Important Lessons Today
Biggest challenges for ensuring exceptional end user experience
Why programmable, active testing is a “must-have”
1
2
Actions Helping You Reach Your Top Goals
Recommended
