Media Report 2017 - tra.gov.ae · As LTE is currently still in a deployment phase, apart from the percentage of good coverage, an absolute level of LTE Service Coverage is also presented

@THEUAETRAwww.tra.gov.ae

Media Report 2017

Mobile Network QoSBenchmarking Campaign

Media Report 2017 2

BACK GROUND

The UAE is an ICT leader in the Gulf region. The Telecommunications Regulatory Authority (TRA) plays a vital role in maintaining the highest standards of the ICT sector. It is achieved by ensuring country-wide reach of mobile services and a constant improvement in the quality of offered services. To encourage the highest stand-ards in mobile services, the TRA has carried out an extensive benchmarking survey of the Mobile networks in the UAE. The results of the survey are discussed with mobile licensees (Etisalat and du) to enable the operators to further enhance the quality of mobile services offered.

The survey was taken in October 2017, covering more than 22,000 km of the UAE’s roads, making approximately 25,000 voice calls on each operator’s network and testing the full range of data services available across all technologies (2G,

All Emirates including: Abu Dhabi, Dubai, Sharjah, Ajman, Um Al Quwain, Ras Al Khaimah, Fujairah, and the Western Region were covered. Testing was performed in the cities and towns of all the emirates as well as on the main roads in the UAE. Quality of mobile services was also tested in 40 key indoor locations in the UAE.

1

2

20173

VOICE CALLSETUP

SUCCESSRATE

VOICE CALLDROP RATE

GOODCOVERAGE

DATALATENCY

VOICE CALLCOMPLETIONSUCCESS RATE

VOICEQUALITY

DATATRANSFER

RATE

Media Report 2017 3

WHAT WAS MEASURED?

The survey addressed 2nd, 3rd and 4th generation mobile networks for both licensees (du and Etisalat). Key performance indicators used in the survey include:

Media Report 2017 4

DEFINITION

OF USER SIMULATION QUALITY OF SERVICE (QOS)

1

2

4

3

5

Voice Call Completion Success Rate: Is the measure of calls that were successfully set up and normally terminated, note that a high Call Completion Success Rate is

Voice Call Setup Success Rate: Percentage of attempts that resulted in successful voice call setup up, note that a high Call Setup Success Rate is desirable.

Voice Call Drop Rate: This refers to the disconnection of mobile calls by the network during a 90-second call-holding period for each call, note that a low Call Drop Rate is desirable. The target is to achieve a ratio of less than 2% call drop rate.

Voice Quality: The overall voice quality rate is equal to the average voice quality on the downlink and uplink, which refers to the network's ability in achieving an acceptable level of voice quality using the Mean Opinion Score (MOS) measure and a score of 2.8 has been set as the MOS thresh- old, note that a high Voice Quality Rate is desirable.

Good Coverage: This is based on signal strength, and refers to the network's ability in achieving a signal strength of -100 dBm or higher, which is considered as a level of good coverage, sufficient to provide a typical user with all requested services.

Data Transfer Rate: This is rate at which data is transmitted over the application protocol levels. Provided in Meg- abits per second (Mbps). Both FTP & HTTP protocols have been tested:FTP (File Transfer Protocol): used to upload files from a workstation to an FTP server or download files from an FTP server to a workstation. FTP uses 1 TCP connec- tion for user data transfer, and another TCP connec- tion for signaling purposes.

HTTP (Hyper Text Transfer Protocol): used to transfer files from a Web server onto a browser in order to view a Web page that is on the Internet. May use 1 or more TCP connec-tions, depending on comfigration. A 400 megabyte file was used to test the network speed from a performance point of view, over a period of 15 seconds in downlink and uplink.

Data Latency: This metric reflects the time (in ms) that data packets need to travel from a User Terminal through the operator’s network, to a remote server and return – also known as Average Ping Duration. The short- er the Data Latency, the better is user perceived respon- siveness of the data network, which is important for real-time applications. In each test, a series of 10 pings are sent and average round trip time is calculated.

6

7

Media Report 2017 5

METHODOLOGY

To ensure that the testing provides a fair competitor comparison of the service provided by the mobile networks, and that it provides a reliable basis for the encouragement of ever-improving quality of service throughout the UAE, the TRA has employed state – of – the – art test equipment and services. By using the latest equipment; the TRA ensured the measurements were done in a manner, that was statistically valid, repeatable, technically consist- ent, providing abso-lute comparability of KPIs for all networks, technology independent, using ITU & ETSI standards as a minimum, and are robust enough to stand legal scrutiny of claims.

The equipment measures “Key Performance Indicators” that directly relate to the public’s experience through Out- door (in-car user experience) and Indoor user experience. These include network coverage, dropped calls and the clarity of calls.The ratio of Mobile Originated /Mobile Terminated voice Calls (MOC/MTC) was 1/1. The call test scenario consisted of a 90 second holding period followed by a 40 second idle time. For measurement purposes 3 different models of top smartphones were used.

Results InterpretationIn interpreting the results, it should be noted that:The drive test results represent a snapshot of the mobile service provider's network in-car user experience based on the specified routes during the time of day when the measurements were carried out and using a particular type of handset. The reported level of service quality may therefore not be exactly comparable with the consumer's own experience;Consumers should not treat the drive test results as recommended best buys. Factors such as price plans, value added services, customer care and support are not captured in this report.

Media Report 2017 6

SURVEY RESULTS Outdoor 1

Voice Call Completion Success RateThis parameter measures the capability of the network to successful set up a call and terminate it normally. The call completion success rate shown below is based on more than 20,000 voice call attempts per operator.

Voice Call Setup Success RateThis parameter measures the capability of the network to successfully set up a call.The call setup success rate below is based on more than 20,000 voice call attempts for each operator.

Etisalat

du

99.53%

99.15%

Call CompletionSuccess Rate in Outdoor coverage

Call SetupSuccess Rate in Outdoor coverage

Etisalat

du

99.67%

99.29%

Media Report 2017 7

Call Drop Rate

A call is dropped when it is disconnected prematurely during the 90-second holding period. Call drop may

occur due to poor coverage, interference or other network related issues. The Call Drop Rate statistics for

each mobile network are shown below based on more than 20,000 voice call attempts per operator:

Etisalat

du

0.14%

0.14%

Call Drop Ratein Outdoor coverage

1

2

3

4

5

Voice Quality

Media Report 2017 8

The MOS method is a means to provide an objective result of voice quality of calls in the operator's network.

In each call, speech samples are sent in the uplink and downlink direction. These samples are then analyzed

in both directions to measure the speech quality using the ITU-T Rec. P.863 (POLQA) algorithm. This is a

recognized method widely used to evaluate voice quality showing the following categories:

Excellent

Good

Acceptable

Not good

Poor

Understandable without interference noise

Understandable with minor interference noise

Fairly understandable

Requires a lot of effort to understand

Not understandable

Conversation Description Result (MOS) Quality

Voice Quality

Media Report 2017 9

Based on the definition that an acceptable level of voice quality is one with an opinion score of at least "2.8",

the percentage of samples with opinion scores greater than "2.8" for each mobile network is as shown:

Etisalat

du

94.35%

94.58%

Voice quality

in Outdoor coverage

Good Coverage - LTE

Media Report 2017 10

This parameter measures the availability of service coverage in the regions. Therefore, it measures the network's ability to achieve the minimum signal strength of - 100dBm.

Charts in this section were constructed based on data from a scanner which continuously measured all avail-able technologies and carriers, and their respective signal level.

As LTE is currently still in a deployment phase, apart from the percentage of good coverage, an absolute level of LTE Service Coverage is also presented below. This metric was constructed similarly to LTE Good Coverage, with minimal required signal strength considered as RSRP > -128 dBm

Etisalat

du

98.94%

97.60%

LTE Service Coverage(% of unique geographic locations with RSRP > -128 dBm)


This parameter measures the availability of service coverage in the regions. Therefore, it measures the network's ability to achieve the minimum signal strength of - 100dBm.Charts in this section were constructed based on data from a scanner which continuously measured all avail-able technologies, carriers and their respective signal level.

Good Coverage - GSM and UMTS

Etisalat

du

99.98%

99.87%

Etisalat

du

99.99%

99.99%

GSM Good coverage(% of samples with RxLev > -100 dBm)

UMTS Good coverage(% of samples with RSCP > -100 dBm)

1

3

5

2

4


Data Transfer Rate

Packet Data Performance (Throughputs): This is the rate at which data is transmitted over the application protocol layers. Provided in Megabits per second (Mbps), where 1 Megabit = 104857 bits. Both FTP & HTTP have been tested.

FTP (File Transfer Protocol): This test was used to download small files from an FTP server to a Mobile Device. A file size of 3 MB was used for the test.

HTTP (Hyper Text Transfer Protocol): This test was used to transfer small files from a Mobile Device onto the Server. A file size of 1 MB was used for the test.

HTTP Browser test: This test was used to download a complete web page using the HTTP protocol.

Capacity Test: This test provides a level of real-world throughputs that the network can deliver under stressed, highly-utilized conditions. The capacity test sets up multiple, simultaneous and parallel HTTP threads which transfer large files (400MB) in uplink or downlink, over a fixed period of time (10s) to exercise the Mobile network, to 100% of its technical capability.


Data transfer rate in Auto Mode (4G/3G/2G)

Data transfer rate in Dual Mode (3G/2G)

HTTP Capacity Download HTTP Capacity Upload FTP Download HTTP Upload

58.7

34.7 34.5

28.1

20.97

17.915.55

13.44


10.5

3.5 2.9

9.7 7.4

2.7 2.4

11.8

Data Transfer Rate [Mbps]

Data Transfer Rate [Mbps]

0

10

20

30

40

50

60

0

2

4

6

8

10

12


Delay Before a Transfer of Data Begins

Latancy in Auto Mode (4G/3G/2G)

Latancy in Dual Mode (3G/2G)

Etisalat

du 44

46

Latency [ms]

Latency [ms]Etisalat

du

63

58

200 40 60 80 100

5249464340


MOBILE NETWORK PERFORMANCE TRENDS

(2012 - 2017) in the Outdoor SurveyThe below graphs compare the performance of both Etisalat’s and Du’s mobile networks in terms of the major Quality of Service Parameters over the past 6 years (2012 - 2017)

Voice Call Completion Success Rate

98.45%

98.69% 2%98.8

98.56%

98.59%

98.55%

99.76%99.20% 99.53%

98.96% 98.96%

99.15%

2012 2013 2014 2015 2016 2017

100.00%

99.50%

99.00%

98.50%

98.00%

97.00%

Voice Call Setup Success Rate

2012

%98.81

99.00%

99.09%

%99.1298.84%

99.85%99.44% 99.67%

99.56%

99.39%99.29%

2013

98.83%

2014 2015 2016 2017

98.00%

97.00%

100.00%

99.50%

99.00%

98.50%

Voice Call Completion Success Rate in Outdoor Coverage - Trend

Etisalat Du

Voice Call Setup Success Rate in OutdoorCoverage - Trend

Etisalat Du


Voice Call Drop Rate

Voice Quality

2012

0.32%

0.37%

0.27%

0.56%

0.25%

0.30%

0.09%0.24%

0.14%

0.60%

0.43%

0.14%

2013 2014 2015 2016 2017

0.80%

1.00%

0.00%

0.20%

0.40%

0.60%

Voice Call DropRate in OutdoorCoverage -trend

Etisalat Du

2012

94.96%

97.48% 97.02%

95.13%

95.33%95.02%

96.09%

95.52%

94.66%

94.58%

94.35%

2013 2014 2015 2016 2017

98%

97%

96%

95%

94%

93%

Voice quality (% of samples with MOS > 2.8) in Outdoorcoverage -Trend

Etisalat Du

97.50%


HTTP Capacity Downlink Data Transfer Rate in Auto Mode (4G/3G/2G) in Outdoor coverage - Trend Average Data Transfer Rate [Mbps]

HTTP Capacity Uplink Data Transfer Rate in Auto Mode (4G/3G/2G) in Outdoor coverage - Trend Average Data Transfer Rate [Mbps]

Etisalat Du

28.5034.70

46.60 58.71

25.8032 34.30

34.79

10

0

60

50

40

30

20

2014 2015 2016 2017

Etisalat Du

2014 2015 2016 2017

10

0

40

30

20

2.10

1.60

34.51

28.08

0.0

0.5

1.0

1.5

2.0

2.5

3.0

.972

2..27 584.

307.606.

1.

5.72

8.70 8.40 9.70

7.40

1.79 93

2012 2013 2014 2015 2016 2017


FTP Downlink Data Transfer Rate in Dual Mode (3G/2Gi)n Outdoor coverage - Trend Average Data Transfer Rate [Mbps]

HTTP Uplink Data Transfer Rate in Dual Mode (3G/2G)in Outdoor coverage - Trend Average Data Transfer Rate [Mbps]

0

2

4

6

8

10

12

Etisalat Du

Etisalat Du.160

0.85

.250

2.40

1.90

0.23

0.20

0.27

0.73

2.60 2.70

201420132012 2015 2016 2017

0.29

2


SURVEY RESULTS Indoor

The TRA has conducted an Indoor Benchmarking Survey similar to the Outdoor Benchmarking Survey of 40 Static Venues. The results have shown that the licensees (Etisalat and Du) achieved very good results in the KPI's of voice and data services in 2G, 3G, and 4G.



Etisalat

du

99.70%

99.40%

Call CompletionSuccess Rate in Indoor coverage

Call SetupSuccess Rate in Indoor coverage

Etisalat

du

99.81%

99.52%

Etisalat

du

0.12%

0.12%



Voice Quality

Voice Call DropRate in Indoor coverage

Voice quality(% of samples with MOS > 2.8) in Indoor coverage

Etisalat

du

94.29%

94.38%

0

10

20

30

40

50

60

70

80


38.3

18.1 22.9 17.2

12.5

18.2

27.6

75.2


Data Transfer Rate Overall in Auto Mode (4G/3G/2G)

Data TransferRate [Mbps]

Data Transfer Rate (Auto Mode) in Indoor coverage


Mobile Network Performance Trends (between 2012 - 2017) in the Indoor Locations



98.42%

%99.06

98.8

99.74%

9%99.07% 99.07%

98.80% 98.95%

17%99.

99.06%

99.70%

99.40%

201420132012 2015 2016 2017

Voice Call CompletionSuccess Rate in Indoor Coverage - Trend

Etisalat Du

Voice Call SetupSuccess Rate in Indoor Coverage - Trend

Etisalat Du

99.81%

99.52%

201420132012 2015 2016 2017

99.29%

99.02%

99.63%

99.57%



Voice Quality

0.12%

0.12%

201420132012 2015 2016 2017

0.44%

0.61%

Etisalat Du

Voice Call DropRate in Indoor Coverage - Trend

Etisalat Du

Voice quality(% of samples with MOS > 2.8) in Indoor coverage - Trend

97.81%

96.89%

94.38%

94.29%

.396 1%

201420132012 2015 2016 2017


FTP Downlink Transfer Rate in Auto Mode (4G/3G/2G) in Indoor coverage - Trend Average Data Transfer Rate [Mbps]

HTTP Uplink Transfer Rate in Auto Mode (4G/3G/2G)in Indoor coverage - Trend Average Data Transfer Rate [Mbps]

17.10

22.90

2.97

1.79

0

5

10

15

20

25

2012 2013 2014 2015 2016 2017

18.20

0.23

0.20

12.50

0

2

4

6

8

12

10

14

16

18

20

Etisalat Du

Etisalat Du

CONCLUSION


This survey of the quality of services of the mobile networks shows the continuous improvements achieved by both Licensees (Etisalat and du). Year on year KPI improvements are especially visible in data services. This was achieved thanks to the usage of the latest LTE advancements by both operators. The results were also compared with other ICT advanced countries in the world using the data of similar Benchmarking Surveys conducted in those countries. Mobile operators in the UAE have achieved a competitive performance compared with other ICT advanced countries.

The survey has also confirmed efficient utilization of radio frequencies allocated by the TRA to both Etisalat and du.

Outlook – The survey has demonstrated fast adoption of the latest mobile technologies by both Licensees (Etisalat and du). It is benefiting mobile services users by providing top class mobile data services. With the demand for mobile data services increasing the TRA expects both Etisalat and du to continue to enhance their networks to maintain the high standard of services despite higher traffic in the networks. The TRA will continue to work closely with the operators providing feedback on the quality of mobile network to the Licensees. We see that this framework of coopera- tion with operators, produces tangible results for the consumers with overall quality of mobile services improving year on year. High standards of mobile services in the country provide a firm basis on which the UAE ICT leadership in the region can be built.

Documents

Media Report 2017 - tra.gov.ae · As LTE is currently still in a deployment phase, apart from the percentage of good coverage, an absolute level of LTE Service Coverage is also presented