19
Independent Drive Test Report - August’16 Nagpur to Bhopal Highway Key performance indicators for most of the operators: Most of the operators failed to meet the Call Setup Success Rate (CSSR) benchmark, where as most of the operators fall below the 2% Call Dropped Rate (CDR) threshold. Methodology: Independent Drive test was conducted in Nagpur to Bhopal Highway from 9:00 AM to 9:PM from 29 th to 30 th of August 2016. The total drive test covered in Nagpur to Bhopal highway area was approximately 350 km over a period of 2 days. A total of ~3098 calls were made for eight 2G networks, six 3G networks and one CDMA networks covering eight operators 1 2 3 4 City-Level Performance Area-Level Performance Analysis Summary and Highlights Date: 3 November 2016 5 Appendix I. Benchmarking KPIs II. Coverage III. Receive (Rx) Quality IV. City-Level Ranking V. City-Level KPI The independent drive test has been carried out by M/s IMRB International on behalf of TRAI Introduction

Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Embed Size (px)

Citation preview

Page 1: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Independent Drive Test Report

- August’16

Nagpur to Bhopal Highway

Key performance indicators for most of the operators: Most of the operators failed to meet the Call

Setup Success Rate (CSSR) benchmark, where as most of the operators fall below the 2% Call

Dropped Rate (CDR) threshold.

Methodology:

Independent Drive test was conducted in Nagpur to Bhopal Highway from 9:00 AM to 9:PM from 29th to 30th of August 2016. The total drive test

covered in Nagpur to Bhopal highway area was approximately 350 km over a period of 2 days. A total of ~3098 calls were made for eight 2G

networks, six 3G networks and one CDMA networks covering eight operators

1 2 3 4

City-Level

Performance Area-Level

Performance Analysis Summary

and

Highlights

Date: 3 November 2016

5

Appendix I. Benchmarking KPIs

II. Coverage

III. Receive (Rx) Quality

IV. City-Level Ranking

V. City-Level KPI

The independent drive test has been carried out by M/s IMRB International on behalf of TRAI

Introduction

Page 2: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

Overview

TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of

Service (QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also

undertakes audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit

agencies conduct sample ‘Drive tests’ across various cities all over the country as part of audit and assessment of the TSPs’

performance

In view of complaints on call drops and other network issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted from

29th August 2016 to 30th August 2016 covering various locations in Nagpur to Bhopal Highway . The performance of Aircel, Airtel,

BSNL, Idea, Vodafone, Reliance, Tata, Telenor was monitored across various technologies (2G, 3G and CDMA). The drive test route was

defined on the basis of several factors that include - areas from where call drop complaints are commonly received; areas of heavy

usage; residential areas away from arterial roads; office areas; areas where previous Drive tests showed network issues; etc.

For the purpose of these tests, 2G + 3G Mode (Auto) was used. The test results obtained from these drive tests were conducted to

assess the network condition more specifically in terms of Radio Frequency (RF) Coverage; Rx Quality; Call Setup Success Rate; Call

Drop Rate; Blocked Calls and Carrier to Interference ratio.

Drive Route Details For Goa Area:

Independent Drive test was conducted in Nagpur to Bhopal area from 9:00 AM to 9:PM from 29th to 30th of August 2016. The total

drive test covered in Goa area was approximately 350 km over a period of 2 days. Total of ~3098 calls were made for eight 2G

networks, six 3G networks and one CDMA networks covering eight operators. Roads and Areas covered in Nagpur to Bhopal Highway is

shown in the below map.

Below is the List of Areas Covered and Drive Routes

1

Day 1 Day 2

Nagpur Itrarsi

Koradi Colony Raisalpur

Raj Nagar Biaora

New Mankapur Pawerkheda

Lumbini Nagar Puwar Kheda basti

Koradi Naka Hoshangabad

GaneshNagri Budhni

Panjara Colony Barkhera

CPRI Colony Bhayiapur

New Nanda Umariya Village

Dahegaon Ibaidullganj

Kawadas Mahaveer Colony

Takli Bishankheda village

Savner Bypass Nanakhedi

Bhagi Mahari Shobhapur

Umari Sarakiya

Chattarpur Jhalar Kalan

Badchicholi Patel Nagar

Seoni Indra Nagar

Pandhruna Mahaveer Nagar

Multai Samrdhya Kaliasot

Betul Indus towan phase 4

Shahpur Kanha fun city

Itarsi Bhopal

Drive test route

Page 3: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

1. City-Level Performance

City-Level Details Operator Performance against Key Performance Indicators :

1. Call Setup Success Rate, 2. Blocked Call Rate, 3. Call Drop Rate, 4. Rx Quality

Legends

Threshold for each KPI are considered as per TRAI guidelines Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Most of the operators failed to meet

the Call Setup Success Rate

benchmark of >=95%, except Airtel

2G & 3G, Idea 2G & 3G and

Vodafone 2G & 3G. Refer. Fig 1

Most of the operators failed to meet

the Blocked Call Rate benchmark of

<=3%, except Idea 2G & 3G and

Vodafone 2G & 3G. Refer. Fig 2

All the operators failed to meet the

Call Drop Rate benchmark of <=2%,

except Idea 2G and Vodafone 2G &

3G.

Refer. Fig 3

Most of the operators meet the Rx

Quality Rate benchmark of >=95%,

except Airtel 2G, BSNL 2G, Reliance

2G, Tata 2G, Tata CDMA and Telenor

2G.

Refer. Fig 4

Operator meeting the benchmark Operator not meeting the benchmark

2

Current Drive: August 2016

81.31% 95.40% 96.46% 84.79% 87.16% 98.21% 98.96% 89.37% 89.47% 81.40% 85.64%

61.19% 82.61%

97.56% 97.74%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Rel

ian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 1. Call Setup Success Rate (%)

95%

5.75% 2.81% 3.21%

8.52% 8.95%

1.36% 3.16% 3.96% 8.09% 6.86% 6.83% 8.13%

21.05%

1.67% 1.85%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 3. Call Drop Rate (%)

2%

18.69%

4.60% 3.54% 15.21% 12.84%

1.79% 1.04% 10.63% 10.53%

18.60% 14.36%

38.81%

17.39%

2.44% 2.26%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

Bsn

l 2G

Bsn

l 3G

Idea

2G

Idea

3G

RC

OM

2G

RC

OM

3G

Tata

2G

Tata

3G

Tata

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 2. Block Call Rate (%)

3%

95.27% 94.95% 98.15% 88.85% 97.65% 97.45% 97.21% 92.45% 98.82% 94.16% 96.45% 78.19% 80.84%

96.25% 97.69%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 4. Rx Quality (%)

95%

Page 4: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

2. Area-Level Performance

Area-Level Details

Legends

Drive test route covered from Nagpur to Bhopal Highway

Fig 5. Area Level route map

Areas meeting the benchmark Areas not meeting the benchmark

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

3

Threshold for each KPI are considered as per TRAI guidelines

Current Drive: August 2016

Page 5: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

2. Area-Level Performance

Area-Level Details

Legends

Area Level KPI performance ( all operators inclusive)

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

4

Areas meeting the benchmark Areas not meeting the benchmark

Threshold for each KPI are considered as per TRAI guidelines Current Drive: August 2016

Blocked Call Rate Aircel Airtel BSNL Idea Reliance TATA Telenor Vodafone

Nagpur to Seoni 14.90% 1.60% 26.10% 3.10% 20.60% 22.00% 17.40% 2.30%

Seoni to Multai 13.30% 4.90% 11.90% 2.60% 12.80% 28.20% N/A 1.80%

Multai to Betul 41.40% 7.10% 24.40% 0.00% 21.20% 3.70% N/A 2.10%

Betul to Itarsi 2.10% 6.90% 6.50% 0.00% 9.40% 44.50% N/A 2.00%

Itarsi to Bhopal 26.20% 2.30% 8.20% 0.80% 2.20% 12.80% N/A 3.00%

Call Setup Success Rate Aircel Airtel BSNL Idea Reliance TATA Telenor Vodafone

Nagpur to Seoni 85.10% 98.40% 73.90% 96.90% 79.40% 78.00% 82.60% 97.70%

Seoni to Multai 86.70% 95.10% 88.10% 97.40% 87.20% 71.80% N/A 98.20%

Multai to Betul 58.60% 92.90% 75.60% 100.00% 78.80% 96.30% N/A 97.90%

Betul to Itarsi 97.90% 93.10% 93.50% 100.00% 90.60% 55.50% N/A 98.00%

Itarsi to Bhopal 73.80% 97.70% 91.80% 99.20% 97.80% 87.20% N/A 97.00%

Call Dropped Rate Aircel Airtel BSNL Idea Reliance TATA Telenor Vodafone

Nagpur to Seoni 7.50% 2.40% 10.20% 0.80% 6.00% 7.60% 21.10% 0.80%

Seoni to Multai 11.50% 5.20% 11.50% 0.00% 14.60% 12.50% N/A 5.60%

Multai to Betul 5.90% 1.90% 20.60% 0.00% 12.20% 1.90% N/A 0.00%

Betul to Itarsi 4.30% 5.60% 6.90% 0.00% 1.00% 5.30% N/A 4.00%

Itarsi to Bhopal 2.20% 0.80% 4.90% 6.30% 3.70% 7.70% N/A 0.00%

Rx Quality Aircel Airtel BSNL Idea Reliance TATA Telenor Vodafone

Nagpur to Seoni 93.20% 95.50% 94.00% 98.30% 91.10% 86.20% 81.30% 96.90%

Seoni to Multai 95.70% 96.10% 92.10% 97.20% 91.50% 92.10% N/A 94.10%

Multai to Betul 93.30% 95.00% 87.80% 98.10% 85.60% 96.40% N/A 87.40%

Betul to Itarsi 97.10% 97.30% 86.20% 98.70% 96.50% 89.70% N/A 95.80%

Itarsi to Bhopal 95.60% 96.20% 92.70% 95.60% 93.70% 94.40% N/A 90.10%

Page 6: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Detailed Analysis of Operators

High RLT

• Radio Link Timeout (RLT indicates how long the call can

sustain during poor quality – Higher the value the

longer it will sustain the call). Higher the RLT, poorer the

consumer experience during the call.

3. Analysis

Legends Current Drive: August 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark >=95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

Threshold for each KPI are considered as per TRAI guidelines

Operators No. of Cells with

RLT <= 40

No. of Cells

with RLT > 40 Current CDR

CDR, If all Cells

assume RLT <=

40

Airtel 100.00% 0.00% 2.81% 2.81%

Aircel 100.00% 0.00% 5.75% 5.75%

Vodafone 100.00% 0.00% 1.67% 1.67%

Idea 100.00% 0.00% 1.36% 1.36%

BSNL 98.60% 1.40% 8.52% 8.52%

Telenor 94.29% 5.71% 21.05% 21.05%

Reliance 98.70% 1.30% 3.96% 3.96%

TATA 97.10% 2.90% 6.86% 6.86%

5

Page 7: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

3. Analysis

Detailed Analysis of Operators

Aircel 2G (CDR : 5.75%, BCR : 18.69%, Coverage : 59.11%)

• Nagpur to Seoni and Seoni to Multai are the key contributed

areas, where most of the calls are dropped. 60% calls are

dropped in these area of total calls dropped in all areas.

• Poor coverage of network is clear indication of high call drop

rate.

• Itarsi to Bhopal and Multai to Betul are the key contributed

areas, where most of the calls are blocked. 70% calls are

blocked in these area of total calls blocked in all areas.

• Most of the calls are blocked, due to SDCCH access failure,

SDCCH drop.

• Aircel having poor coverage patches.

Legends Current Drive: August 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

6

Threshold for each KPI are considered as per TRAI guidelines

Parameter Highlighted areas (Seoni to

Multai Nagpur to Seoni )

Rest of

Highway

# call drops 6 4

Parameter Highlighted areas ( Itarsi to

Bhopal & Multai to Betul)

Rest of

Highway

# call blocks 28 12

BSNL 2G (CDR : 8.52%, BCR : 15.21%, Rx Quality : 88.85%, Coverage : 67.61%, HO Failure rate : 12.42%)

• BSNL 2G has call drops all across the highway network which is

the clear indication of poor Coverage and Quality.

• Poor HOSR is also an indication of high call drop rate.

• Most of the blocked calls are due to SDCCH access failure,

SDCCH drop.

Parameter Whole Highway

# call blocks 40

# call drops 19

BSNL 3G (CDR : 8.95%, BCR : 12.84%, Coverage : 37.21%)

• Due to poor coverage of BSNL 3G network, 70% of network are in

2G mode.

• Poor Coverage of network is clear indication of high call drops and

blocks and most of the drops and blocks call are on 2G mode.

• Most of the blocked calls are due to SDCCH access failure, SDCCH

drop.

Parameter Whole Highway

# call blocks 28

# call drops 17

Page 8: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

3. Analysis

Detailed Analysis of Operators

TATA 2G (CDR : 6.86%, BCR : 18.60%)

• Poor coverage/Quality of highlighted areas is clear indication of

high call drop rate. Nagpur to Seoni and Itarsi to Bhopal are the

key contributed areas of high drop rate.

• Nagpur to Seoni and Betul to Itarsi are the key contributed areas,

where most the calls are blocked. 82.50% calls are blocked in

these area of total blocked calls in all areas.

• Most of the blocked calls are due to unavailability of SD and TCH

resources .

TATA 3G (CDR : 6.83%, BCR : 14.36%, Coverage : 61.35%)

• Nagpur to Seoni is the key contributed areas, where most of the calls

are blocked.

• TATA 3G has call drops all across the highway, which is the clear

indication of poor coverage.

• Due to poor coverage 78.8% network are in 2G mode.

• Most of the calls are blocked on 2G mode, due to failure of SDCCH

access and SDCCH drop.

Legends Current Drive: August 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

7

Parameter Highlighted areas(

Seoni to Nagpur ) Rest of Highway

# call blocks 20 7

Threshold for each KPI are considered as per TRAI guidelines

Parameter Highlighted areas(Nagpur to

Seoni & Betul to Itarsi)

Rest of

Highway

# call blocks 33 7

Parameter Whole Highway

# call drops 11

TATA CDMA (CDR : 8.13%, BCR : 38.81% , Coverage : 49.47%, Quality : 78.19%)

• Seoni to Multani, Betul to Itarsi and Itarsi to Bhopal are the key

contributed area, where most of the calls are blocked. 96.15% calls

are blocked in these area of total blocked calls in all area

• Poor Coverage, Quality and coverage patches of network is clear

indication of high call drops.

Parameter

Highlighted (Seoni to

Multani, Betul to Itarsi &

Itarsi to Bhopal)

Rest of

Highway

# call Block 75 3

Parameter Highlighted areas (Nagpur to

Seoni & Itarsi to Bhopal)

Rest of

Highway

# call drops 8 4

Page 9: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

3. Analysis

Detailed Analysis of Operators

RELIANCE 2G (CDR : 3.96%, BCR : 10.63%, Coverage : 49.97%, Rx Quality : 92.45%)

Legends Current Drive: August 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

8

Threshold for each KPI are considered as per TRAI guidelines

RELIANCE 3G (CDR : 8.09%, BCR : 10.53%, Coverage : 51.52%)

• Seoni to Multai and Itarsi to Bhopal are the key contributed

areas of dropped calls. Dropped calls in these areas are 72.73%

of total dropped calls in all areas.

• Due to poor coverage of Reliance 3G, 77.25% network are in 2G

mode.

• Seoni to Multai and Itarsi to Bhopal are the key contributed

areas of blocked call. Blocked calls in these areas are 75.00%

of total blocked calls in all areas.

• Most of the calls are blocked, due to SDCCH access failure, SD

drop and TCH access failure .

• Reliance 3G was driven only for Bhopal circle as there is no

coverage in Nagpur circle.

Parameter Highlighted(Nagpur to Seoni &

Multai to Betul)

Rest of

Highway

# call blocks 12 4

• Nagpur to Seoni and Betul to Itarsi are the key contributed areas

of blocked calls. Block Calls in these areas are 66.67% of total

dropped calls in all areas.

• Most of the calls are blocked due to SDCCH access failure.

• Reliance 2G having coverage patches.

Parameter

Highlighted areas ( Nagpur to

Seoni & Betul to Itarsi )

Rest of

Highway

# call blocks 18 9

Parameter Highlighted(Seoni to Multai &

Itarsi to Bhopal)

Rest of

Highway

# call drops 8 3

Page 10: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

3. Analysis

Detailed Analysis of Operators

TELENOR 2G (CDR : 21.05%, BCR : 17.39%, Coverage : 26.39% , Signal Quality : 80.84%)

Legends Current Drive: August 2016

Operator meeting the set CDR threshold Operator not meeting the set CDR threshold

Abbreviation / Definition: CSSR (benchmark > =95%) : Call Setup Success Rate

BCR (benchmark <=3%): Blocked Call Rate

CDR (benchmark <=2%): Call Drop Rate

Good RxQuality (benchmark >=95%): 2G (RxQual <=5), 3G (EcNo >=-15dBm), CDMA (FER <=4%)

9

Threshold for each KPI are considered as per TRAI guidelines

• Telenor 2G has poor Coverage and Quality all across the network

which are the clear indication of high call drop rates.

• Most of the calls are blocked, due to SDCCH access failure and

SDCCH drop.

Parameter Whole Highway

# call blocks 4

# call drops 4

Page 11: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

4. Summary & Highlights

Summary & Highlights

Most of the operators failed to meet the Call Drop Rate Benchmark of <=2% except Idea 2G , Voda 2G

& Voda 3G.

Key Highlights

• All the operators are failed to meet the Call Drop Rate benchmark of <=2%, except Idea and Vodafone.

• Aircel 2G, BSNL 2G & 3G, Reliance 3G and TATA 2G, Tata 3G, Tata CDMA and Telenor 2G failed to meet the

benchmark by a wide margin of >5%

• BSNL 2G & 3G, Reliance 3G, TATA CDMA and Telenor 2G have Call Drop Rates in the range of above 7%. These high

drop rates of operator is clearly indicating for urgent need of improvement in order to deliver reasonable levels of

services.

• Huge gap between the performances of Idea (2G) and Vodafone(2G&3G) compared to the poor performances of

other operators are clearly showing in the areas driven. There are possibilities for other operators to offer a better

Quality of service than currently is being provided.

Fig 6. Call Drop Rate

10

5.75% 2.81% 3.21%

8.52% 8.95%

1.36% 3.16% 3.96% 8.09% 6.86% 6.83% 8.13%

21.05%

1.67% 1.85%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Fig 6. Call Drop Rate (%)

Page 12: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

5. Appendix

Ancillary Details

I. Benchmarking KPI Details

II. Coverage Details

III. Receive (Rx) Quality Details

IV. City-Level Ranking and KPI details

V. City-Level KPI details

Table of Contents in Appendix

11

Page 13: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

2. Benchmarking KPI Details

RF Coverage

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm

Accessibility

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts

Retainability

Retainability is “The ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability the regulation prescribes three important parameters namely Call Drop Rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. Drop Call and Connection with good voice quality were

monitored by the drive test

Mobility

In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to be out of range of a

base station while making a call. The process by which a mobile telephone call is transferred from one base station to another as the

subscriber passes the boundary of a cell is called a handover. The Handover success rate (HOSR) more than 95% is considered to be

good

Rx Quality

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo from 0 to -30 dBm and Frame Error Rate

(FERs) for CDMA service providers are measured. As per the QoS norms, RxQual between 0- 5 for GSM operators, EcNo >= -15 dBm and

between 0-4% FER value for CDMA operators FERs is considered to be good, where as RxQual beyond this benchmark is considered to

be bad

12

Coverage % Accessibility % Retainability % Mobility % Rx Quality %

Aircel 2G 59.11% 81.31% 94.25% 95.85% 95.27%

Airtel 2G 70.14% 95.40% 97.19% 97.22% 94.95%

Airtel 3G 57.77% 96.46% 96.79% 99.64% 98.15%

BSNL 2G 67.61% 84.79% 91.48% 87.58% 88.85%

BSNL 3G 37.21% 87.16% 91.05% 91.65% 97.65%

IDEA 2G 70.25% 98.21% 98.64% 98.79% 97.45%

IDEA 3G 61.65% 98.96% 96.84% 99.69% 97.21%

Reliance 2G 49.97% 89.37% 96.04% 96.73% 92.45%

Reliance 3G 51.12% 89.47% 91.91% 98.71% 98.82%

TATA 2G 72.85% 81.40% 93.14% 96.44% 94.16%

TATA 3G 61.35% 85.64% 93.17% 98.05% 96.45%

TATA CDMA 49.47% 61.19% 91.87% 100.00% 78.19%

Telenor 2G 26.39% 82.61% 78.95% 100.00% 80.84%

Vodafone 2G 62.41% 97.56% 98.33% 98.41% 96.25%

Vodafone 3G 53.59% 97.74% 98.15% 99.77% 97.69%

0.00%

25.00%

50.00%

75.00%

100.00%

KPI Distribution

Page 14: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

3. Coverage Details

RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data

session. The Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm. The details

are as follows.

Operators not meeting benchmark

13

Aircel 2G Airtel 2G Airtel 3G

BSNL 2G IDEA 2G BSNL 3G

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Coverage Distribution

-95 to -120 dBm -85 to -95 dBm -75 to -85 dBm 0 to -75 dBm

Operators Coverage Rate

Aircel 2G 59.11%

Airtel 2G 70.14%

Airtel 3G 57.77%

BSNL 2G 67.61%

BSNL 3G 37.21%

IDEA 2G 70.25%

IDEA 3G 61.65%

Reliance 2G 49.97%

Reliance 3G 51.12%

TATA 2G 72.85%

TATA 3G 61.35%

TATA CDMA 49.47%

Telenor 2G 26.39%

Vodafone 2G 62.41%

Vodafone 3G 53.59%

Page 15: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

3. Coverage Details

14

RELIANCE 2G RELIANCE 3G

TATA 2G TATA 3G TATA CDMA

Telenor 2G Vodafone 2G Vodafone 3G

IDEA 3G

Page 16: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo for 3G operators on a scale of 0 to -30

dBm and Frame Error Rate (FERs) for CDMA service providers are measured. As per the QoS norms, Rx Quality between 0- 5 for GSM

operators, EcNo >= -15 dBm and between 0-4% FER value for CDMA operators FERs is considered to be good, where as quality beyond

this benchmark is considered to be bad. The benchmark should usually be > =95%.

Operators are not meeting benchmark

15

Aircel 2G Airtel 2G Airtel 3G

BSNL 2G BSNL 3G IDEA 2G

Operator Rx Quality

Aircel 2G 95.27%

Airtel 2G 94.95%

Airtel 3G 98.15%

BSNL 2G 88.85%

BSNL 3G 97.65%

IDEA 2G 97.45%

IDEA 3G 97.21%

Reliance 2G 92.45%

Reliance 3G 98.82%

TATA 2G 94.16%

TATA 3G 96.45%

TATA CDMA 78.19%

Telenor 2G 80.84%

Vodafone 2G 96.25%

Vodafone 3G 97.69%

0.00%

25.00%

50.00%

75.00%

100.00%

Air

cel 2

G

Air

tel 2

G

Air

tel 3

G

BS

NL

2G

BS

NL

3G

IDE

A 2

G

IDE

A 3

G

Re

lian

ce 2

G

Re

lian

ce 3

G

TATA

2G

TATA

3G

TATA

CD

MA

Tele

no

r 2

G

Vo

da

fon

e 2

G

Vo

da

fon

e 3

G

Rx Quality Distribution

RxQual 6 to 7, EcNo <-15 dBm, FER <= 4% RxQual 0 to 5, EcNo >=-15 dBm, FER > 4%

Page 17: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

4. Receive (Rx) Quality Details

16

IDEA 3G RELIANCE 2G RELIANCE 3G

Tata 2G Tata 3G Tata CDMA

Telenor 2G Vodafone 2G Vodafone 3G

Page 18: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

5. City-Level Ranking and KPI details

Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.

In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup

Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts. The benchmark is >=95%. The details are as

follows:

Retainability is “the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For

determining the Retainability, the regulation prescribes three important parameters namely Call drop rate (CDR), Worst affected Cells

having more than 3% TCH drop and Connection with good voice quality. The call drop and connection with good voice quality were

monitored by the drive test

Call Drop Rate (CDR): The parameter gives a reliable measurement of the mobile network used by the service provider for maintaining a

call once it has been correctly established

Mobility: In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to get out of

reach of a base station while making a call. The process by which a mobile telephone call is transferred from one base station to

another as the subscriber passes the boundary of a cell is called a handover. The Handover Ssuccess Rate (HOSR) more than 95% is

considered to be good

*In case of multiple call failure in similar geo location in given period of 60sec has been counted as one call failure

Operators not meeting benchmark

17

Operator Total Call Attempt Blocked Calls Blocked Call Rate* CSSR

Aircel 2G 214 40 18.69% 81.31%

Airtel 2G 261 12 4.60% 95.40%

Airtel 3G 226 8 3.54% 96.46%

BSNL 2G 263 40 15.21% 84.79%

BSNL 3G 218 28 12.84% 87.16%

IDEA 2G 224 4 1.79% 98.21%

IDEA 3G 192 2 1.04% 98.96%

Reliance 2G 254 27 10.63% 89.37%

Reliance 3G 152 16 10.53% 89.47%

TATA 2G 215 40 18.60% 81.40%

TATA 3G 188 27 14.36% 85.64%

TATA CDMA 201 78 38.81% 61.19%

Telenor 2G 23 4 17.39% 82.61%

Vodafone 2G 246 6 2.44% 97.56%

Vodafone 3G 221 5 2.26% 97.74%

Operator Total Call Established Total Call Drop CDR CCSR

Aircel 2G 174 10 5.75% 94.25%

Airtel 2G 249 7 2.81% 97.19%

Airtel 3G 218 7 3.21% 96.79%

BSNL 2G 223 19 8.52% 91.48%

BSNL 3G 190 17 8.95% 91.05%

IDEA 2G 220 3 1.36% 98.64%

IDEA 3G 190 6 3.16% 96.84%

Reliance 2G 227 9 3.96% 96.04%

Reliance 3G 136 11 8.09% 91.91%

TATA 2G 175 12 6.86% 93.14%

TATA 3G 161 11 6.83% 93.17%

TATA CDMA 123 10 8.13% 91.87%

Telenor 2G 19 4 21.05% 78.95%

Vodafone 2G 240 4 1.67% 98.33%

Vodafone 3G 216 4 1.85% 98.15%

Operators Total HO Attempt HO Failure HO Success HO Failure Rate HO Success Rate

Aircel 2G 193 8 185 4.15% 95.85%

Airtel 2G 540 15 525 2.78% 97.22%

Airtel 3G 2246 8 2238 0.36% 99.64%

BSNL 2G 306 38 268 12.42% 87.58%

BSNL 3G 599 50 549 8.35% 91.65%

IDEA 2G 495 6 489 1.21% 98.79%

IDEA 3G 1635 5 1630 0.31% 99.69%

Reliance 2G 245 8 237 3.27% 96.73%

Reliance 3G 310 4 306 1.29% 98.71%

TATA 2G 365 13 352 3.56% 96.44%

TATA 3G 667 13 654 1.95% 98.05%

TATA CDMA 2119 0 2119 0.00% 100.00%

Telenor 2G 18 0 18 0.00% 100.00%

Vodafone 2G 504 8 496 1.59% 98.41%

Vodafone 3G 858 2 856 0.23% 99.77%

Page 19: Independent Drive Test Report - TRAI Analyticsanalytics.trai.gov.in:8001/trai/qos/export/Nagpur to Bhopal Report... · Independent Drive Test Report - August’16 Nagpur to Bhopal

Appendix

Ancillary Details

6. City-Level KPI details

18

Call Events

Operators (Summary)

Aircel Airtel BSNL IDEA RELIANCE TATA Telenor Vodafone

2G 2G 3G 2G 3G 2G 3G 2G 3G 2G 3G CDMA 2G 2G 3G

Call Attempt (August-16)

214 261 226 263 218 224 192 254 152 215 188 201 23 246 221

Blocked Call Rate (August-16)

18.69% 4.60% 3.54% 15.21% 12.84% 1.79% 1.04% 10.63% 10.53% 18.60% 14.36% 38.81% 17.39% 2.44% 2.26%

CSSR (Accessibility) (August-16)

81.31% 95.40% 96.46% 84.79% 87.16% 98.21% 98.96% 89.37% 89.47% 81.40% 85.64% 61.19% 82.61% 97.56% 97.74%

Dropped Call Rate (August-16)

5.75% 2.81% 3.21% 8.52% 8.95% 1.36% 3.16% 3.96% 8.09% 6.86% 6.83% 8.13% 21.05% 1.67% 1.85%

Mobility HOSR (August-16)

95.85% 97.22% 99.64% 87.58% 91.65% 98.79% 99.69% 96.73% 98.71% 96.44% 98.05% 100.00% 100.00% 98.41% 99.77%

Rx Quality (August-16)

95.27% 94.95% 98.15% 88.85% 97.65% 97.45% 97.21% 92.45% 98.82% 94.16% 96.45% 78.19% 80.84% 96.25% 97.69%

Operators meeting the benchmark Operators not meeting the benchmark