24
ITU-T Second Informal Workshop on Conformance and Interoperability Testing Geneve, 8 December 2006 Ministry of information technologies and communications of the Russian Federation Central Research Telecommunication Institute of the Russian Federation Bas Bas ic ic approaches approaches on on NGN NGN testing testing . . R R esults esults of of work work Q.8/11 Q.8/11 ITU ITU - - T T and and development development plans plans Denis Andreev Head of department “IT technologies and applications in telecommunication networks” Central Science Research Telecommunication Institute (ZNIIS), Moscow

communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Ministry of information technologies and communications of the

Russian Federation

Central Research Telecommunication Institute of the

Russian Federation

BasBasicic approachesapproaches onon NGN NGN testingtesting. . RResultsesults ofofworkwork Q.8/11Q.8/11 ITUITU--TT andand developmentdevelopment plansplans

Denis AndreevHead of department

“IT technologies and applications in telecommunication networks”Central Science Research Telecommunication Institute (ZNIIS), Moscow

Page 2: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Content

Basic approaches of NGN testingPurpose and importance of testingPrinciple of NGN testingNGN function under testSet of NGN technical meansModel networks – basic approaches for NGN tests

Common results of development NGN testing ITU-T Recommendations Q.8/11

NGN testing standardization processQ.3900 basic ITU-T Recommendation on NGN testingQ.tt3, Q.tt4, Q.tt5 plans of development

Page 3: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

In view of the NGN networks are widely spread and In view of the NGN networks are widely spread and internationally recognized, an essential attention when internationally recognized, an essential attention when constructing such networks should be given to network constructing such networks should be given to network functioning quality dependent on many factors, such as: functioning quality dependent on many factors, such as: applying an equipment of the different manufacturers, applying an equipment of the different manufacturers, using the distributed networks to provide a wide spectrum using the distributed networks to provide a wide spectrum of services etc.of services etc.

As a result the NGN technical means testing As a result the NGN technical means testing requires some new approaches. Therefore the WTSArequires some new approaches. Therefore the WTSA’’04 04 (Brasilia, Florianopolis, October 2004) opened for SG 11 (Brasilia, Florianopolis, October 2004) opened for SG 11 the new Question Q. 8/11.the new Question Q. 8/11.

Purpose of NGN testingPurpose of NGN testing

Page 4: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Importance of NGN testingComplex of NGN technical means testing methods will be used befoComplex of NGN technical means testing methods will be used before re

realizing the NGN solutions on the real public telecommunicationrealizing the NGN solutions on the real public telecommunication networksnetworks

Page 5: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Principle of NGN testing

At present the process of testing may be divided into the following stages

•• testing for conformancetesting for conformance•• testing for compatibilitytesting for compatibility•• testing for interoperabilitytesting for interoperability

The new part in NGN testing•• NGN solution testingNGN solution testing•• NGN functionality testingNGN functionality testing•• NGN testingNGN testing under pay loadunder pay load

Page 6: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Access EnvironmentAccess Environment•• NGN Integrated Access Devices (NGNNGN Integrated Access Devices (NGN--IAD)IAD)•• Media gateway for Legacy Terminal Media gateway for Legacy Terminal

Equipment (GWEquipment (GW--LTE)LTE)

Call Session Control SystemCall Session Control System•• Media Gateway ControllerMedia Gateway Controller ((MGCMGC))•• Proxy Server SIP (PS)Proxy Server SIP (PS)•• IP Multimedia Subsystem (IMS)IP Multimedia Subsystem (IMS)

Voice and signaling transmit systemVoice and signaling transmit system•• Media Gateway Media Gateway (GW)(GW)•• Signaling GatewaySignaling Gateway (SG)(SG)

Transport Network Environment Transport Network Environment (TNE)(TNE)

Management and billing systemManagement and billing system•• Management SystemManagement System (MS)(MS)•• Billing system (BS)Billing system (BS)

Application serversApplication servers•• Application Server (AS)Application Server (AS)•• Media serverMedia server (MS)(MS)•• Messaging ServerMessaging Server ((MeSMeS))

Classification of NGN Technical Means to be testedQ.3900

Page 7: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Service Control

ApplicationC

ore Transport

Scope of NGN

Man

agem

ent f

unct

ions

T-7:TrunkMedia

GatewayFE

T-6:Inter-

connection Border

Gateway FE

S-6: S. Authentication & Authorization FE

S-8: Access GWControl FE

NACF

S-15:Multimedia Service FE

RACF

LegacyTerminal

RGW

Customer Network

NGNTerminal

LegacyTerminal

ANIThird Party Application Providers

S-11: User Signaling Interworking FE

End-User Function

S-3: Interrogating Call Session Control FE

S-14: Media Resource Broker FE

T-16 Core TransportResource Control FE

Access Packet Transport Functions

T-2: AccessNode FE

T-1: AccessMedia

GatewayFE

T-3: Edge Node FE

T-5:AccessBorder

GatewayFE

S-1: Serving Call Session Control FE

S-10: BreakoutGateway Control FE

S-7: Interconnection Border Gateway

Control FE

S-9: Media GWControl FE

T-15: Access Transport Resource Control FE

S-13: Media Resource Control FE

Core Packet Transport Functions

T-8:Media

ResourceProcessing

FE

T-11:T. Authentication &Authorization

FE

T-12: T. User Profile FE

T-4: AccessRelay FE

T-13: T. Locationmanagement

FE

S-2: Proxy Call SessionControl FE

T-10:T. Network Access Control FE

S-4: Subscription Locator FE

S-5: S. User Profile FE

S-4: Subscription Locator FE

S-5: S. User Profile FE

Application/Service Support Functions(may include own Authentication, Authorization and Accounting)

T-14: Policy Decision FE

S-12: Network Signaling Interworking FE

T-9:SignallingGateway

FE

other IP MMNetwork

(e.g. IMS)

PSTN/ISDN

Internet

Other NGN

NGN functional architecture

Page 8: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

NGN Technical means NGN Functionality

Call Session Control System

Media Gateway Controller (MGC) S3, S7, S9, S10, S12T10, T11, T12, T13

Proxy Server SIP (PS) S2, S3, S7, S11, S12T10, T11, T12, T13

IP Multimedia Subsystem (IMS) S1, S3, S6, S7, S8, S10, S12, S13T10, T11, T12, T13, T14, T15, T16, T17

Voice and signaling transmit system

Media Gateway (GW) T7, T8

Signaling Gateway (SG) T8, T9

Transport Network Environment (TNE) T5, T6, T8

Application servers

Application Server (AS) S4, S5, S6, S14, S15

Media server (MS) S4, S5, S6, S14, S15

Messaging Server (MeS) S4, S5, S6, S14, S15

Management and billing system

Management System (MS)

Billing system (BS)

- error processing management- equipment configuration management- billing system management- service management- security management

Access Environment

NGN Integrated Access Devices (NGN-AD) T2, T4, T3, T5, T15, T14

Media gateway for Legacy Terminal Equipment(GW-LTE)

T1, T2, T3, T4, T5

Conformance of NGN Functions to NGN Technical Means to be tested

Page 9: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

NGN testing procedureLevel 1Level 1

NGN TM local testingNGN TM local testing

• Functional testing

• Load&Stress testing

• Conformance testing

• Functional testing

• Interconnect testing

• Services testing

• Ent-to-End testing

• QoS testing

• Mobility&Roamingtesting

Level 2Level 2NUT testingNUT testing

Page 10: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Model network Model network a network which simulates the capabilities similar to those available in present telecommunication networks, has a

similar architecture and functionality and uses the same telecommunication technical means

Model Network for NGN testing

Dedicated Model NetworkDedicated Model Network Distributed Model NetworkDistributed Model Networkis composed of several model networks, two as a minimum, interconnected via communication channels and are used to perform complex tests for compatibility, interoperability, testing QoSparameters and etc.

is a fragment of the public telecommunication network which is not connected to other model networks and are used to perform testing for conformance, compatibility and etc.

Page 11: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Dedicated Model Network

Page 12: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Base Model network 1 Base Model network 2IP network

PSTN/ISDN

InternetPLMN3G/GSM

PSTN/ISDN

InternetPLMN3G/GSM

Distributed Model Network

Page 13: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Configuration of Model Network

Page 14: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Load&Stress testing

Functional testing

Conformance testing

Database

QoS testing

End-to-End testing

Interconnect testing

Functions testing

Database

Mobility testing

NGN TM testingNGN TM testing

Services testing methodologyServices testing methodology NUT testing methodologyNUT testing methodology

Testing methodology on the Model NetworksTesting methodology on the Model Networks

Page 15: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Combination and aggregation work of development standards and recommendations devoted to NGN technical

means testing

NGN testing

ETSI

3GPP

NGN-GSI

NGN testing standardization process

Different Telecom

organizations

ITUQ.8 WP3/11

ITU-TSG17

Page 16: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Q.8/11 role of NGN testing

Goal Goal -- to develop the principle, methodology and to develop the principle, methodology and set of tests for NGN technical means testing basis set of tests for NGN technical means testing basis on the model networkon the model network

Page 17: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Set of NGN testing Recommendations under Q.8/11

QQ..39003900 Methods of testing and model network architecture for NGN Methods of testing and model network architecture for NGN technical means testing as applied to public technical means testing as applied to public telecommunication networks telecommunication networks (approved 09/06)(approved 09/06)

Q.tt3Q.tt3 Integral testing. Tests and services' distribution for NGN Integral testing. Tests and services' distribution for NGN technical means testing in the model and operator networkstechnical means testing in the model and operator networks

QQ..tttt44 Parameters to be monitored in the process of operation when Parameters to be monitored in the process of operation when introducing NGN in PSTNintroducing NGN in PSTN

Q.tt5Q.tt5 Formalized presentation of testing resultsFormalized presentation of testing results

QQ..tttt66 Handbook on NGN technical means testing as applied to NGN Handbook on NGN technical means testing as applied to NGN technologies to be introduced on PSTN networkstechnologies to be introduced on PSTN networks

Page 18: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Classification of NGN functionsClassification of NGN Technical Means to be testedClassification of NGN functions to be testedConformance of NGN Functions to NGN Technical Means to be tested

Testing procedureModel Networks

Purposes of using Model NetworksTypes of model networks

Dedicated model networkDistributed model networkRegional model network

Testing requirementsModel network configuration requirementsMethodology of Model Networks testing

Methodology of NGN TM local testingMethodology of NUT testingMethodology of services testing

Methods of testing and model network architecture for NGN techniMethods of testing and model network architecture for NGN technical cal means testing as applied to public telecommunication networksmeans testing as applied to public telecommunication networks

(approved 09/06)(approved 09/06)

QQ..39003900

Page 19: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Integral testing. Tests and services' distribution for NGN Integral testing. Tests and services' distribution for NGN technical means testing in the model and operator technical means testing in the model and operator

networksnetworks

Q.tt3Q.tt3

•• Methodology of NGN TM testingMethodology of NGN TM testing

•• Methodology of NUT testingMethodology of NUT testing

•• NUT service testingNUT service testing

Detailed description of NGN testingDetailed description of NGN testing

Page 20: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Example of NGN functionality testingExample of NGN functionality testingQ.tt3Q.tt3

Page 21: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Example of one test for NGN functionality testingExample of one test for NGN functionality testing

Q.tt3Q.tt3

Page 22: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

QQ..tttt44 Parameters to be monitored in the process Parameters to be monitored in the process of operation when introducing NGN in PSTNof operation when introducing NGN in PSTN

April 2007April 2007

Q.tt5Q.tt5 Formalized presentation of testing results Formalized presentation of testing results end of 2007end of 2007

Plans of development new Recommendations devoted to NGN testing

Page 23: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

The ZNIIS experience of model network practical realization

Huawei Quidway 3600

MGW Alcatel 7515

GK

Huawei Quidway 3600

Huawei Quidway 3600

Huawei Quidway 3600

SI-2000 S-12

ECI XDM-2000

ECI XDM-2000

ECI XDM-2000

ECI XDM-2000

MGW Alcatel 7515

MGC Alcatel 5020

Radionet RN 700

Radionet RN 700

Radionet RN 800

Radionet RN 820

Wi-Fi,WiMAX

Wi-Fi

Wi-Fi

xDSL

HE CPE

PLC Sumitoma

SDH Layer

PSTN LayerIP Layer

Access Layer

NGN Layer

Page 24: communications of the Russian Federation Basic approaches ... · Management and billing system ... NGN functional architecture. ITU-T Second Informal Workshop on Conformance and Interoperability

ITU-T Second Informal Workshop on Conformance andInteroperability Testing

Geneve, 8 December 2006

Denis AndreevDenis AndreevEditor of Q.8 WP3/11Head of department

Central Science Research Telecommunication Institute (ZNIIS), MoscowTel: +7-495-368-8745Fax: +7-495-306-3958

Email: [email protected]: [email protected]

Thank you for your attention