3 test solutions for 4 g devices in r&d or conformance environments

Test Solutions for 4G devices in R&D or Conformance environments

I International Workshop on

Challenges and Trends for

Broadband Mobile Networks –

Beyond LTE-A

Roberto Monteiro

Account Manager (Rohde & Schwarz do Brasil)

Novembro 2013 | Roberto Monteiro | 2

Core specification

Test specification

Work Items (WI)

Standards Different standards, study groups, and different applications


Test needs Mobile comms, Non-mobile comms, all together today

GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

Wifi

Offloading


WiFi OffLoading WLAN <-> LTE

EPC

UE

EPC

UE

seamless,

individual flows

HandoverInternet Internet

3GPP

Access

Wi-Fi

Access

3GPP

Access

Wi-Fi

Access

VoIP Video Conf. Web FTP



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

Wifi

Offloading



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading


Carrier Aggregation LTE Release 10


LTE Adv. Carrier Aggregation



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading

FADING


BLER results with and without fading



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading

FADING



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading

FADING



GSM

(E)GPRS

EDGEevo

VAMOS

WCDMA

HSPA HSPA+

DC

HSDPA CDMA2000

1xRTT

1xEV-DO

0 A B

LTE-FDD LTE-TDD

TD-

SCDMA

Mobile

WiMAX

Non-Cellular

Cellular

FM Stereo

ISDB-Tb GPS

Glonass

Galileo

Bluetooth

BT EDR

BT LE

WLAN

abgn

LTE-R10

2CC 2x2

MIMO Wifi

Offloading

FADING


End to End (E2E) Data and Call Performance

Good service ideas may fail

when the required performance

is not available

l Crucial for user experience of data services

l Verify quality of data and voice services l Service availability

l At cell borders

l During handovers


Testing UE Performance with Realistic Radio Conditions

LTE CA BTS

LTE BTS

3G BTS

Throughput and call performance

measurement with

l Noise (AWGN, OCNS)

l Fading

l During HO


Performance testing of Applications

1

7

l Web page Loading

l Video quality testing

l Audio performance testing

VTE Video

Analyzer

CMW-PQA UPV Audio

Analyzer


Performance

testing

Functional

testing

Audio Quality

testing

Voice over LTE (VoLTE) testing Different test setups

Verify audio quality using

PESQ® and POLQA®

algorithm

Acoustic analysis:

3GPP TS 26.132

Automated performance testing

impacts of noise, fading, IP traffic impairments on

audio quality

LTE attach procedure

IMS terminal testing

Session Initiation Protocol

(SIP)

Conformance Testing

Audio: Echo verification in

loopback mode

R&S®CMW-PQA

1

8

R&S®CMW500 LTE Call-box

R&S®UPV Audio Analyzer

R&S®CMW-ATE

LTE attach procedure

IMS registration

Audio: Echo verification in loopback mode

IP Traffic Logging

Impact of noise, IP traffic impairment

Automation via R&S CMWrun sequencer

tool

R&S®UPV Audio Analyzer


H.264/MPEG4AVC

1080p

R&S talking head

2 MBit/s

ı SSIM: 0.9821

ı PSNR: 38.13 dB

ı MOSV: 85.14%

50 kBit/s

ı SSIM: 0.7812

ı PSNR: 25.68 dB

ı MOSV: 22.32%

Image quality analysis with the R&S VTE


C/N = >18,00 dB

0

0,2

0,4

0,6

0,8

1

1,2

0 10 20 30 40 50 60

t in s

SS

IM

C/N = 17,60 dB

0

0,2

0,4

0,6

0,8

1

1,2

0 10 20 30 40 50 60

T in s

SS

IM

Error free

ı C/N > 18 dB

ı BER <1.40e-03

(BER = after Viterbi)

Picture failure point

ı C/N 17,60 dB

ı BER 3.30e-03

Σtime(PSNR drop) > 120ms = picture failure point

What is the picture failure point?


Influence of SNR on picture failure


LARGE NUMBER OF TESTS DEMAND…

AUTOMATION REPEATABILITY FIDELITY


Performance Automated tests for 3GPP verification


Performance Network Operators, R&D Labs


BUT SOMETIMES A CALLBOX IS NOT ENOUGH…

PROTOCOL TESTS… DEEP ANALYSIS

OR SIMPLY…..


Protocol tests

l R&D and verification

Testing

l MLAPI / LLAPI Medium / Lower Layer Application

Programming Interface

LLAPI:

PHY Layer

Link Layer

MAC Layer

MLAPI

RRC Layer

Layer 3

DAU

Upper layers

l Conformance Testing

l ETSI European Telecommunications Standards

Institute

l TTCN Testing and Test Control Notation

TTCN-1 (no longer used)

TTCN-2 (still widely used today)

TTCN-3 (current version and “universal”)


Protocol Test with MLAPI or TTCN

MLAPI Testcase

LLAPI Testcase

TTCN Testcase

TTCN Runtime Adapter

CMW500 LTE Protocol Stack

TTCN API

PHY

PDCP RLC Layer 2 LLAPI

RRC

NAS

Layer 3 MLAPI

MAC

ı Testcase created in C++ (MLAPI, IOT) or TTCN (Conformance)

ı Focus on UE signalling procedures


CMWcards – Closing the gap

RF Tester „CallBox“

„CMWcards Signaling Tester“

Protocol Tester


CMWcards – Closing the gap Ea

se o

f U

se

Flexibility low high

CMWcards


Protocol Tester


high


l Inter-RAT capabilities

l LTE WCDMA

l LTE GSM

l WCDMA GSM

l Triple-RAT LTE / WCDMA / GSM

l LTE CDMA2000

l Multi-cell support

l 2 cells on CMW500 standalone

l 4 cells on CMW500 Multibox

CMWcards – Key Features

LTE cells / WCDMA cells 0 1 2 3 4

0 Single Single Multi Multi

1 Single Single Multi Multi -

2 Single Multi Multi - -

3 Multi Multi - - -

4 Multi - - - -


CMW500 Use Cases


RF parametric tests

BLER measurements

RMCs

Dynamic behaviour

PRACH Tx/Rx

measurements

Ack/Nack measurements

Basic IMS/VoLTE

UL Power Control

Transmit Power Control

… …

Protocol Tester

Protocol Conformance

IOT Acceptance

R&D LLAPI/MLAPI

scenarios

TTCN2/3 R&D development

L1 – L3 and above

debugging

Multicell scenarios > 2

cells

Inter-RAT scenarios

Triple-RAT …

… … …



CMWcards Use Cases


• LTE, WCDMA (GSM and CDMA2000 planned) in one

GUI

• LTE Rel-10 carrier aggregation supported

• Basic registration and attach procedures

• Attach Reject and other failure causes

• Security and ciphering

• Intraband and interband cell

selection/reselection/handover

• Inter-RAT cell

selection/reselection/handover/redirection

• IMS and VoLTE including CS fallback

• SRVCC (planned)

• LTE and WCDMA Throughput Tests


Conformance 36.521 / 36.523

l Protocol Conformance (3GPP 36.523)

l Up to 8 cells (2G/3G/4G) at

sametime

l Or 2xCC 2x2 MIMO LTE R-

10 + 1x 2G + 1x 3G + 1x 4G

2x2 MIMO

l No extra Hardware

required!!!

l And you can use your

existing CallBox hardware


The road to Full Type Approval System RF Full Type Approval System (3GPP 36.521)

CMW500

TS-

80CON

N

TS8980S +interferers

TS8980IB +self-calibration

for max. RF accuracy

Protocol conformance / R&D

RF tests

Performance Quality Analysis (PQA)

RF precompliance

RRM conformance

RF conformance

TS-RRM +Multi-RAT

TS-PQA +real time fading

TS8980FTA + out-of-band and

TV interferer tests

Network operator suppl. RF conformance

e.g. Verizon, AT&T, USCC, Sprint


AND LAST BUT NOT LEAST…


What do we do about “Beyond 4G / 5G”?


THANK YOU!!!!

Technology

3 test solutions for 4 g devices in r&d or conformance environments