View
39
Download
2
Category
Preview:
DESCRIPTION
The Protocol & Testing Competence Centre. Test Specs. Specification. Testing. Development. In Pursuit of Interoperability. Ultimate aim of ICT standardisation is interoperability Likelihood of interoperability is increased with Well-defined, accurate and unambiguous standards - PowerPoint PPT Presentation
Citation preview
1
The Protocol & TestingCompetence Centre
2
In Pursuit of Interoperability
Ultimate aim of ICT standardisation is interoperability
Likelihood of interoperability is increased with Well-defined, accurate and unambiguous standards Systematic testing of products based on those standards
ETSI produces Base Standards and Test Specifications
Development Testing
Test Specs
Specification
3
TC MTS (Methods for Testing and Specification) Develops specification methodologies and techniques
• E.g., this is where TTCN-3 was defined and is further evolving with significant contribution of PTCC
• testing methodology (e.g., IPv6 Testing Framework) http://portal.etsi.org http://portal.etsi.org/mbs/
ETSI PTCC (Protocol and Testing Competence Centre) Supports ETSI Technical Bodies with the development of:
• Protocol and service standards (Standards Engineering)• Test specifications
http://www.etsi.org/ptcc
ETSI Plugtests Service Organises interoperability events http://www.etsi.plugtests
Unique Resources Available to ETSI Technical Bodies
5
How Does the PTCC Help?
Assist ETSI Technical Bodies on the use of state of the art techniques for Specification, validation and testing Good working practices (Standards Engineering)
Pragmatic and flexible approach Based on experience
Help to develop usable methodologies For ETSI’s current and emerging needs
Knowledge transfer Quality through Continuity
6
Who PTCC Supports
Technical Bodies (TB) Technical Committees ETSI Projects Partnership Projects etc.
Chairmen, Rapporteurs, Individuals Working Groups (WG) STFs (Specialist Task Forces)
PTCC budget for test specifications (15-20 STFs per yr)
ETSI Secretariat
7
Typical PTCC Areas of Activity
GSM and 3G (UMTS) terminals Wireless: HiperACCESS,
HiperMAN/WiMAX (802.16) Cordless phones: DECT Access terminals: FSK, SMS ISDN, Broadband ISDN OSA (API, IDL) – web services NGN VoIP: H.225, H.248, H.245 (ITU), SIP (IETF) SIGTRAN Smartcards DECT IPv6: Core, IPSEC, Mobility, v4 -> v6 DSRC (ITS) DMR ... future: More telematics/ITS, more security?
9
PTCC Expertise
Technical competence GSM/3G UMTS, OSA, VoIP, WirelessLan, IPv6, DECT, INAP, B-
ISDN etc. Protocol Specification and Validation
UML (Universal Modelling Language), MSC (Message Sequence Charts), SDL (Specification and Description Language), ASN.1 (Abstract Syntax Notation One),
Production of Test Specifications world recognised testing expertise TTCN (Tree and Tabular Combined Notation)
Modern tool support
10
Design for Interoperability
Interoperability takes place on external interfaces Normative (mandatory) features Options
• Consequences must be clear
Abnormal behaviour should be well-defined Robustness
Never specify how product is to be implemented internally Different levels of abstraction e.g., 3-stage approach
Methods like SDL, ASN.1, XML, MSC and UML used to specify these interfaces Data transferred on protocol interfaces
• syntax and encodings (ASN.1, XML)
Behaviour of modules as seen from these interfaces
TTCN and test methods used for black box testing No need to know how product is implemented External interface is tested according to specification
12
Profiling and Interworking
Many standards are ‘open’ Include many options
Interoperability requires profiling e.g. ETSI TISPAN NGN Options are screwed down (dropped) Works with ‘similar’ technologies Implement and test the profile
Significantly different technologies Interworking functions e.g., SIP – H.323
General reluctance to specify ‘profiles’ Indications that situation is changing
13
Different Kinds of ETSI Test Specifications
Conformance Robustness
PerformanceInteroperability
Network Integration
RF/EMC
14
The PTCC Testing STFs Write Test Specifications
PTCC 4 full-time experts + 1 assistant (employed by the ETSI
Secretariat) 60% test specification, 40% protocol specification
We use Specialist Task Forces (STFs) Experts are seconded from the ETSI membership
• PTCC STF Budget• Assignment of this budget is done by ETSI members (ETSI Board)
Produce test specifications Short projects
• e.g., 2 man-months maintenance of VoIP tests Long projects
• e.g., UMTS testing 58 man-months per year over 3-4 years 15 – 20 PTCC STFs per year Typical total yearly resource = 10-15 man-years (with UMTS)
What is an STF ?
An STF is a group of experts working together as a team, to produce one or more ETSI standards
STFs give ETSI a competitive advantage by accelerating the development of urgently needed standards
Funded by a dedicated budget line (FWP and PTCC)
STFs are proposed by the ETSI Technical Bodies
Experts are seconded from ETSI Members
Experts normally work at ETSI premises
Technical Body
STF (contracted
experts)
Funding
Boardapproval
TB approval
PublishedETSI
standard
DraftETSI
standardETSI
EC/EFTA
Members
STF ToR
Urgent work
Committee voluntary work
Normal work
Draft standard
The STF role in the standards production
17
22ndnd allocat. allocat. Jun
STF funding
OCG / OCG / BoardBoard
ETSIETSIMembersMembers
VoluntaryVoluntaryfundingfunding
ETSIETSIbudgetbudget
STF 1, STF 2, ..... STF nSTF 1, STF 2, ..... STF n
11stst allocat. allocat.Jan ……
ContractContractContractContract
EC/EFTAEC/EFTA
eEuropeeEuropeDirectDirect
contractscontracts
……ContractContract
ContractContract
19
Information on STF process
General information http://portal.etsi.org/Portal_Common/home.asp
List of STFs Open Call for experts etc.
STF Management principles and practice http://portal.etsi.org/stfs/process/home.asp
A guide through the STF process:
How to create an STF How to join an STF ETSI contractual conditions etc …
20
Summary
Standards can be designed for interoperability
Standards should be engineered
Plan for testing (early)
Do the right kind of testing and test in parallel
We can help you achieve the above
PEX Help!
Open-door electronic access phone: +33 4 92 94 43 26 fax: +33 4 93 95 84 51 e-mail: ptcchelp@etsi.org Web pages: http://www.etsi.org/ptcc
Recommended