Embed Size (px)
Citation preview
TEMS Investigation KPI Definitions – WAP
TEMS Investigation KPI Definitions – WAP 2010-10-08
Ascom 2010. All rights reserved.
TEMS is a trademark of Ascom. All other trademarks are the property of their respective holders.
No part of this document may be reproduced in any form without the written permission of the copyright holder.
The contents of this document are subject to revision without notice due to continued progress in methodology, design and manufacturing. Ascom shall have no liability for any error or damage of any kind resulting from the use of this document.
Public
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D
Contents
1. Introduction ................................................................. 1
2. Service Independent KPIs .......................................... 1
2.1. Network Unavailability [%] ...................................................... 1 2.2. Attach Failure Ratio [%] .......................................................... 1 2.3. Attach Setup Time [s] .............................................................. 2 2.4. PDP Context Activation Failure Ratio [%] ............................... 2 2.5. PDP Context Activation Time [s] ............................................. 2 2.6. PDP Context Cut-off Ratio [%] ................................................ 3
3. WAP Specific KPIs ...................................................... 3
3.1. Service Non-Accessibility [%] ................................................. 3 3.2. Setup Time [s] ......................................................................... 3 3.3. IP Service Access Failure Ratio [%] ........................................ 4 3.4. IP Service Setup Time [s] ........................................................ 4 3.5. Mean Data Rate [kbit/s] .......................................................... 4 3.6. Data Transfer Cut-off Ratio [%] ............................................... 5 3.7. WAP Activation Failure Ratio [%] ............................................ 5 3.8. WAP Activation Time [ms] ....................................................... 5 3.9. WAP Page Request Failure Ratio [%] ..................................... 6 3.10. WAP Page Request Time [s] ................................................... 6 3.11. WAP Portal Access Time [s] .................................................... 6 3.12. WAP Portal Non-accessibility [%] ............................................ 7 3.13. WAP Site Access Time [s] ....................................................... 7 3.14. WAP Site Non-accessibility [%] ............................................... 7 3.15. Signaling Diagram .................................................................. 9
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D 1(9)
1. Introduction
This document describes in detail how KPIs (Key Performance Indicators) for the WAP service are calculated in TEMS Investigation.
How input data to KPI calculations is collected is not dealt with in this document.
2. Service Independent KPIs
2.1. Network Unavailability [%]
Denotes the probability that no packet-switched network is available in the cell currently used by the customer.
In GSM, the phone has access to a PS network if it has received System Information 13. This message is read once per KPI measurement cycle, at the beginning of the cycle.
In WCDMA, matters are simpler: the phone is always known to have access to a PS network.
The information element "Mode - System" in TEMS Investigation indicates whether the phone is connected to a WCDMA or a GSM network.
Because of the nature of this KPI, no start or stop triggers can be identified for it in the signaling diagrams.
2.2. Attach Failure Ratio [%]
Denotes the probability that a subscriber cannot attach to the GPRS/UMTS PS network:
Start trigger: Phone sending Attach Request message. Trigger point 1 in sections 3.15
Stop trigger: Phone receiving Attach Accept/Reject message. Trigger point 4 in sections 3.15
# of unsuccessful attempts to access PS network Network Unavailability [%] = -------------------------------------------------------------------- x 100
total # of attempts to access PS network
# of unsuccessful attach attempts Attach Failure Ratio [%] = ----------------------------------------------- x 100
total # of attach attempts
TEMS Investigation KPI Definitions – WAP 2010-10-08
2(9) Public
2.3. Attach Setup Time [s]
Denotes the length of the time period taken to attach to the GPRS/UMTS PS network:
Start trigger: Phone sending Attach Request message. Trigger point 1 in sections 3.15
Stop trigger: Phone receiving Attach Accept message. Trigger point 4 in sections 3.15
2.4. PDP Context Activation Failure Ratio [%]
Denotes the probability that the PDP context cannot be activated. It is the ratio of unsuccessful PDP context activation attempts to the total number of PDP context activation attempts:
Start trigger: Phone sending PDP Context Activation Request message. Trigger point 5 in sections 3.15
Stop trigger: Phone receiving PDP Context Activation Accept message. Trigger point 8 in sections 3.15
2.5. PDP Context Activation Time [s]
Denotes the length of the time period taken to activate a PDP context:
Start trigger: Phone sending PDP Context Activation Request message. Trigger point 5 in sections 3.15
Stop trigger: Phone receiving PDP Context Activation Accept message. Trigger point 8 in sections 3.15
PDP Context Activation Time [s] = tPDP Context Activation Accept – tPDP Context Activation Request
Attach Setup Time [s] = tAttach Accept – tAttach Request
# of unsuccessful PDP context activation attempts PDP Context Activation Failure Ratio [%] = ---------------------------------------------------------------------- x 100 total # of PDP context activation attempts
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D 3(9)
2.6. PDP Context Cut-off Ratio [%]
Denotes the probability that a PDP context is deactivated without this being initiated intentionally by the user:
Start trigger: Phone receiving PDP Context Activation Accept message. Trigger point 8 in sections 3.15
Stop trigger: Phone receiving the last data packet containing content. Trigger point 20 in sections 3.15
PDP context deactivation not initiated intentionally by the user can be caused by either SGSN failure or GGSN failure, so the PDP context may be deactivated either by the SGSN or by the GGSN.
Note: The precondition for measuring this parameter is that a PDP context has been successfully established.
3. WAP Specific KPIs
(not in ETSI)
3.1. Service Non-Accessibility [%]
Denotes the probability that a subscriber cannot access the service successfully due to a failure that has occurred either during PDP context activation or during service access. This means that the data transfer cannot be started:
Start trigger: PDP Context Activation Request sent. Trigger point 5 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.2. Setup Time [s]
Denotes the period of time it takes to access a service successfully, from the moment the dial-up connection is established until the first data packet is received:
# of unsuccessful attempts Service Non-Accessibility [%] = -------------------------------------- x 100
total # of attempts
# of PDP context deactivations (not initiated by user) PDP Context Cut-off Ratio [%] = ------------------------------------------------------------------------ x 100
total # of successfully activated PDP contexts
TEMS Investigation KPI Definitions – WAP 2010-10-08
4(9) Public
Start trigger: PDP Context Activation Request sent. Trigger point 5 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.3. IP Service Access Failure Ratio [%]
Denotes the probability that, after successfully activating a PDP context, a subscriber cannot access the service, so that the data transfer cannot be started:
Start trigger: WSP Connect Request sent. Trigger point 9 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.4. IP Service Setup Time [s]
Denotes the time period needed to establish a TCP/IP connection to the WAP server, from sending the initial query to a server until the first data packet is received:
Start trigger: WSP Connect Request sent. Trigger point 9 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.5. Mean Data Rate [kbit/s]
Denotes the average data rate measured throughout the entire connect time (application throughput):
# of unsuccessful service accesses IP Service Access Failure Ratio [%] = -------------------------------------------------- x 100 total # of service access attempts
Setup Time [s] = treception of first data packet – tconnect to socket
IP Service Setup Time [s] = treception of first data packet – tfirst [SYN] sent
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D 5(9)
Start trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
3.6. Data Transfer Cut-off Ratio [%]
Denotes the probability that a data transfer cannot be completed when it has been started successfully:
Start trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
3.7. WAP Activation Failure Ratio [%]
Denotes the probability that the subscriber cannot activate the WAP session:
Start trigger: WSP Connect Request sent. Trigger point 9 in section 3.15
Stop trigger: WSP Connect Reply received. Trigger point 12 in section 3.15
3.8. WAP Activation Time [ms]
Denotes the length (in ms) of the time period taken to activate the WAP session:
WAP Activation Time [ms] = tWSP Connect Reply – tWSP Connect Request
# of failed WAP activations WAP Activation Failure Ratio [%] = ----------------------------------------------- x 100
total # of WAP activation requests
# of incomplete data transfers Data Transfer Cut-off Ratio [%] = ----------------------------------------------------- x 100
# of successfully started data transfers
file size (kB) x 8 Mean Data Rate [kbit/s] = -----------------------------------
tlast data packet – tfirst data packet
TEMS Investigation KPI Definitions – WAP 2010-10-08
6(9) Public
Start trigger: WSP Connect Request sent. Trigger point 9 in section 3.15
Stop trigger: WSP Connect Reply received. Trigger point 12 in section 3.15
3.9. WAP Page Request Failure Ratio [%]
Denotes the probability that a WAP page request is unsuccessful after a timeout period. This parameter is only calculated if the WAP activation attempt and/or the PDP Context activation attempt is successful.
Start trigger: WAP Get URL sent. Trigger point 15 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.10. WAP Page Request Time [s]
Denotes the time (in seconds) elapsed from selection of the WAP page link until reception of the first data packet containing WAP page content. Only successful measurements are taken into account when calculating the average time:
Start trigger: WAP Get URL sent. Trigger point 15 in section 3.15
Stop trigger: Reception of the first data packet containing content. Trigger point 18 in section 3.15
3.11. WAP Portal Access Time [s]
Denotes the time (in seconds) taken to load the requested portal homepage including all images and navigational elements, i.e. the average time between initiation of WAP service access and the display of the homepage via GPRS/UMTS. Only successful measurements are taken into account when calculating the average time.
# of failed WAP page requests WAP Page Request Failure Ratio [%] = -------------------------------------------- x 100
total # of WAP page requests
WAP Page Request Time [s] = treception of first data packet – tselection of WAP site
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D 7(9)
Start trigger: PDP Context Activation Request sent. Trigger point 5 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
3.12. WAP Portal Non-accessibility [%]
Denotes the probability that the requested portal homepage, including all images and navigational elements, is not successfully downloaded:
Start trigger: PDP Context Activation Request sent. Trigger point 5 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
3.13. WAP Site Access Time [s]
Denotes the time (in seconds) needed to download the requested portal homepage, including all images and navigational elements. Only successful measurements are taken into account when calculating the average time.
Start trigger: WAP Get URL sent. Trigger point 15 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
3.14. WAP Site Non-accessibility [%]
Denotes the probability that a WAP page, including all images and navigational elements, is not successfully downloaded. This parameter uses the GPRS/UMTS service. When starting the test, a WAP connection between the mobile and the WAP server already exists.
# failed WAP portal homepage download att’s WAP Portal Non-accessibility [%] = -------------------------------------------------------------- x 100 total # WAP portal homepage download att’s
WAP Site Access Time [s] = tappearance of WAP page – tselection of WAP site
WAP Portal Access Time [s] = tappearance of WAP portal homepage – tinitiation of access
TEMS Investigation KPI Definitions – WAP 2010-10-08
8(9) Public
Start trigger: WAP Get URL sent. Trigger point 15 in section 3.15
Stop trigger: Reception of the last data packet containing content. Trigger point 20 in section 3.15
# failed WAP site access attempts WAP Site Non-accessibility [%] = ------------------------------------------------ x 100
total # WAP site access attempts
2010-10-08 TEMS Investigation KPI Definitions – WAP
TMS-06:000080 Uen Rev D 9(9)
3.15. Signaling Diagram
WSP Connect Request
WSP Connect Reply
WAP Get URL
WTP [ACK]
WAP Data [first block] 1718
13
15
9
12
14
16
10
11
WAP
UE Network
Attach Request
Attach Response
PDP Context Activation Accept
PDP Context Activation5
8
1
4
6
7
2
3
Attach
WAP Data [last block] 1920
Data Transfer
PDP
Service
IP Service
Data
