Upload
others
View
7
Download
0
Embed Size (px)
Citation preview
Offshore Delivery of TTCN-3 Testing Services
Miguel [email protected]
TTCN-3 User Conference 2009
3 – 5 June 2009
ETSI, Sophia Antipolis, France
Index
� About Us : Métodos y Tecnología (MTP)
� MTP Delivery Centers
� Testing Services & our TTCN-3 Services
� Our TTCN-3 Operational Approaches
� Our Model for an Offshore TTCN-3 Testing Centre� Our Model for an Offshore TTCN-3 Testing Centre
� Advantages of Outsourcing TTCN-3 Testing Projects
� Issues to consider when Outsourcing TTCN-3 Projects
� Any Questions?
� The Spanish Leader Company in SW & Quality Engineering
� Preferred Leader Provider in Telecommunications companies:
About Us
� Strong alliances with testing and quality software companies:
About Us
� The First Spanish Organization Certified in ISO 9001:
Factory Software Testing Services
� Leader in TTCN-3, with an operative TTCN-3 Lab in Spain
� We carry out 400.000 Hours/year in testing activities
� MTP offers more than 250 Quality and Testing Engineers, � MTP offers more than 250 Quality and Testing Engineers, certified: CSQE, ISTQB, PMI, CMMi and ITIL.
� Important activity in R+D projects:
� TTCN-3 Tool - Exhaustif
� Fault injection tool (SWIFI techniques)
� Wireless Sensor Network
MTP Delivery Centers
� Providing the best mix of local and global delivery
International International Projects
� France� Germany� UK� Mexico� USA� Dominican Republic� Sweden� Portugal
Centers
� Spain (HQ) (250 Resources)
� Canaries(50 Resources)
� Mexico(90 Resources)
� Brasil(100 Resources)
Testing Services
� Requirement Engineering
� Verifying Business, systems and
software requirements
� Code Quality Assurance
� Deployment of code and monitoring of
code degradation, regulations and
standards
Verification ServicesValidation Services
� Testing during the development lifecycle� Functionality, Load, Stress, Capacity and
Stability, Security and Vulnerability Analysis, Usability, Portability and Compatibility, Exploitability, Regression Testing Automation
�
� Reliability and Security
� Preventing defects in early
development stages
� Simulation of protocol, interface, or
network system independently of the
platform used.
� Migration and modification of test cases
� Software Product Evaluation and Certification
� Evaluations based on the ISO/IEC 9126
standard
Our TTCN-3 Services
� Types of TTCN Development services offered:
� Test Environment Development
� Test Case Development
� Broad and deep knowledge on TTCN-3 standards
� Large experience with all TTCN-3 tools :
� Titan, TTWorkbench, HP-Telelogic…
� Deep knowledge of different technologies, protocols & nodes:
� GSM/GPRS, IMS, UMTS…
Our TTCN-3 Operational Approaches
Onsite
CLIENTService
Manager
Operator
Operator
Operator
Onsite-Nearshoring
CLIENTService
Manager
Operator
Operator
Operator
Nearshoring-Offshoring
Operator
CLIENTService
Manager
Operator
Operator
Operator
Operator
Operator
0
20
40
60
80
100
120
140
On-site Out-sourcing
Testing Services
Other Services
Service
Manager
Operator
MTP Site
MTP Site
MTP Site
Offshore Service
Our Model for an Offshore TTCN-3 Testing Centre
� Model based in processes
� Processes that provide value to the client
� Processes in line with ITIL best practices
TTCN-3 Transition Methodology/Model
Factory Service
DESIGN /PROVISION TRANSITION OPERATION TRANSFERENCE
Factory Service (Offshore)
Design/Provision Phase
To design a service solution to fulfil the requirements outlined in thecommercial offer, considering efficiency parameters
DESIGN/PROVISION TRANSITION OPERATION TRANSFERENCE
DE
SIN
G
This phase enables the industrialization of the service to become aTTCN-3 centre:
� Gathering initial information
� Road map of the service becoming a TTCN-3 offshore centre
To provide the necessary infrastructure and tools defined in thedesign phase
� To setup the HW & SW infrastructure
� To allocate consultancy resources and a training plan
DE
SIN
GP
RO
VIS
ION
� Road map of the service becoming a TTCN-3 offshore centre
� Definition of processes, procedures, indicators, tools, etc.
Design/Provision Phase
� ESTABLISH PROCESSES
� Deliverables: Test Specification, Test Scripts, Execution Logs
� Processes to control deliverables (continuous checks to early detect errors):
Weekly or monthly deliverables
� Communication workflow: Client & Internal relationships
� Service Level Agreement (SLA)
� TTCN-3 Framework
� TTCN-3 Style Guide and TTCN-3 Best practices
� INFRASTRUCTURE
� Information Repository : Wiki
� Version control: CVS, ClearCase
� Incidence management tool: Mantis, ClearQuest
� Execution environment: licenses, adapters, etc
� TEAMS
� TTCN-3 Adapters Skills
� Functional Protocols Skills
� TTCN-3 Advanced & Protocols Skills
To setup and start up the operation of the service that guarantees success within the estimated costs, quality anddeadlines
DESIGN/PROVISION TRANSITION OPERATION TRANSFERENCE
Transition Phase
� Development of TTCN-3 Framework
TR
AN
SIT
ION
� Development of initial TTCN-3 testcases to test Framework
� Agreement of Transition plan with the client, evaluating risks:
� Deployment Phases
� Transition Monitoring
� Closing of agreements and services with the client
� Agreement of milestones of deliverables (price based on deliverables)
TR
AN
SIT
ION
TTCN-3 Project & Framework
� There are three parts to the development of TTCN-3 test cases
� Framework based on reusable modules arranged by functionality and message type
� Advantages:
� Framework modules are used by any or all TTCN-3 Test cases
� Makes easier to maintain TTCN-3 for future changes
� Reduces the development time of TTCN-3 testcases
TTCN-3 PROJECT
Description Team
TTCN-3 TEST CASES TTCN-3 Test Cases Functional TTCN-3 (protocols & nodes)
FUNCTIONS TTCN-3 Modules TTCN-3 Advanced Knowledge
MESSAGES TTCN-3 Modules TTCN-3 Advanced Knowledge
PORTS & ADAPTERS TTCN-3 SA & PA TTCN-3 Adapters & SW Developers
Framework
Reduces the development time of TTCN-3 testcases
To perform on a daily basis the full set of activities defined on previous phases
� Internal activities
� Management of Internal Demand:
minimum & agreed internal productivity
DESIGN/PROVISION TRANSITION OPERATION TRANSFERENCE
Operation Phase
OP
ER
AT
ION
minimum & agreed internal productivity
� Operation Service Management:
� Localization and autonomy of the teams involved:i.e. Madrid, Brazil
� Availability: Time-Zone difference
� Services incident Management: Mantis, ClearQuest
� External activities
� Management of Service Demand: productivity
� Management of Service Quality: SLA & KPIs
OP
ER
AT
ION
Estr
atr
eg
ical
Fu
ncti
on
al
Project Leader Client
Project Leader MTP
Project Manager Project Manager
DESIGN/PROVISION TRANSITION OPERATION TRANSFERENCE
Operation Phase
Relationship Model
Fu
ncti
on
al
Op
era
tio
nal
Project Manager Client
Project ManagerMTP
Operational Team
PROJECT TEAM
To minimize the level of burden from the client's perspective
DESIGn/PROVISION TRANSITION OPERATION TRANSFERENCE
Operation Phase
Baseline Management
� Production capacity based on an estimated production baseline: FTEs fulltime equivalents
� Baseline established using historical data, experience on previous projects
Debit
€
� Credits and Debits are accumulated separately
� The excess is invoiced separately, applying previously agreed rates for each activity
� Revisions agreed with the client & a new baseline can be agreed as necessary
Base Line
Base Line +5%
Base Line -5%
Exces.Excess Credit Credit
t
Activities to transfer the TTCN-3 service back to the client
� Training Activities: TTCN-3 scripts & framework
DESIGN/PROVISION TRANSITION OPERATION TRANSFERENCE
Transfer Phase
TR
AN
SF
ER
EN
CE � Training Activities: TTCN-3 scripts & framework
� Closing activities:
� Security: i.e. passwords
� Documentation Delivery
TR
AN
SF
ER
EN
CE
OperadorCLIENT
Service
Manager
Operador
Exclusive dialogue with the
service manager:
No resources management
Make use of KPIs y SLAs
Higher quality control, time and costs
Process Industrialization:
Costs Reduction
Greater control over work
done:
Follow up meetings Control Panel
Advantages of Outsourcing TTCN-3 Projects
Operador
Flexible working teams:
Able to cope with workload peaks
Availability of resources:
Expertise in TTCN-3, technology
(Protocols & Nodes)
The client can concentrate on
its own business:
To delegate support tasks
OUTSOURCED TTCN-3 PROJECTS CAN BRING GREATER EFFICIENCY AT COMPETITIVE COSTS
Issues to consider when outsourcing
� CLEARLY DEFINED� Clear requirements defined by the client� Support available from the client to the TTCN-3 team offshore
� CONTROLLED AND MONITORED
� Indicators are part of the contract� KPIs, SLA, Process Based, Relationship model
The TTCN-3 offshore service has to be:
� KPIs, SLA, Process Based, Relationship model
� EFFICIENT� Able to cope with agreed overload� Flexible Team Structure & Specialized Personnel
Miguel RamosACCOUNT MANAGER
Any Questions?