Software Testing Process, Testing Automation and Software Testing Trends

  • View
    2.533

  • Download
    9

Embed Size (px)

DESCRIPTION

This is the slide deck that KMS Technology's experts shared useful information about latest and greatest achievements of software testing field with lecturers of HCMC University of Industry.

Text of Software Testing Process, Testing Automation and Software Testing Trends

  • 2012 KMS Technology

  • SOFTWARE TESTING PROCESS, TECHNOLOGY & TREND

    April 2013

    KMS Technology - http://kms-technology.com

    QA Symphony - http://www.qasymphony.com

  • AGENDA

    KMS Technology Overview 10

    Software Testing Process & Trends 50

    Software Testing Estimation 20

    Break 15

    Automation Testing & Tools 60

    Future of Software Testing 20

    Q&A 20

    3

  • 2012 KMS Technology

    KMS TECHNOLOGY OVERVIEW

    Vu Pham

  • KMS TECHNOLOGY OVERVIEW

    5

    US Company/Passionate Global Workforce 400 Resources & Growing in Vietnam and the US

    160 Testers ~ 50% Workforce Proven Leadership Team

    World Class Infrastructure Built for ISO 27001, Planned Certification in 2013

    Best-in-Class SDLC Practices CMMI and Agile focus QASymphony - Commercial Agile Testing Solutions

    recognized by Forrester with over 4,500 users

    Best Clients Raving Fans 100% Referenceable and Ecstatic 100% in long-term dedicated team

  • KMS SOFTWARE TESTING SERVICES

    Testing Tools

    Proprietary Tools

    Commercial Tools

    Open source Tools

    Automation &

    Performance

    Testing Frameworks

    Test Processes

    Process Assessment

    Best Practice

    Implementation

    Continuous Process

    Improvement

    Quality and Project

    Management Metrics

    KMS Testing Services

    Testing

    Consulting

    Services

    Life-cycle

    Testing

    Services

    Automation

    Testing

    Services

    Performance &

    Load Testing

    Services

    Mobile and

    Specialty Testing

    Services

    Flexible Staffing Option

    Streamlined Processes & Frameworks

    Tools & Automation Strategic Solution & Best Practices

    Test Planning & Estimation

    Test Design & Implementation

    Test Execution QA Metrics

    Driven Monitoring

    QA Metrics Driven Process Improvements

    6

  • OTHER KMS SERVICES

    7

    APPLICATION DEVELOPMENT

    J2EE and .NET expertise Full lifecycle Product Development Application modification and

    customization APPLICATION SUPPORT

    Perform defect resolution, on-going maintenance of existing applications

    APPLICATION REENGINEERING

    Re-engineer and migrate to a different technology and platform such as SaaS or Mobile

    DATA WAREHOUSE / BUSSINESS INTELLIGENCE

    Develop and Deploy Data Warehouse solutions

    Data migration services Report writing services

    MOBILE DEVELOPMENT

    Apple iOS, Android SDK, and Windows 8 Mobile gaming Enterprise mobile apps

  • 2012 KMS Technology

    SOFTWARE TESTING PROCESS & TRENDS

    Vu Pham

  • AGENDA

    Testing Process Evolution

    Fundamental Testing Process

    Components of Testing Process Framework

    Best Practices in Testing

    9

  • DEVELOPMENT PROCESS EVOLUTION

    60s: Waterfall 80s: RUP 00s: Agile 70s: V-Model

    10

  • DEVELOPMENT PROCESS EVOLUTION (CONT.)

    11

    Client Advantages Disadvantages

    Simple model and easy to manage Applicable for small software

    Big Design Up Front Defect detected at late phases High amounts of risk and uncertain

    Early testing involvement Clear relationship between test phases

    development phases

    Still possess limitation of sequential model Require high amount of documentation Duplication of testing effort

    Risk and uncertain are managed Testing activities and process are

    managed

    Heavy documentation Late customer involvement only at UAT

    Adaptable to changes Early client involvement - Avoid

    unrealistic requirements Avoid spending time on useless

    activities

    Require high-capable people Need representative from client Problem scaling up the architecture

  • SO HOW TESTING IS CHANGED?

    Black-box testing System testing Functional testing Part-time tester

    Grey-box testing System/Integration

    testing Functional testing Full-time tester

    White-box testing System-system Non-functional testing Fit-for-Use Professional tester

    12

    60 80: Nice To Have 90: Should Have 00: Must Have

  • AGENDA

    Testing Process Evolution

    Fundamental Testing Process

    Components of Testing Process Framework

    Best Practices in Testing

    13

  • PHASES IN TESTING PROCESS

    14

  • COMPONENTS OF TESTING PROCESS

    Guidelines

    TM - Test Plan Template

    TM - Test Strategy Template

    TM - Test Case Template

    TM - Test Estimation Template

    TM - Test Metrics Dashboard Template

    TM - Defect Tracking Report Template

    TM - Requirement to Test TM Template

    TM - Test Daily / Weekly / Summary Report Template

    Templates Checklist CK - Test Readiness Checklist

    CK - Test Plan Review Checklist

    CK - Test Case Review Checklist

    CK - User Acceptance Test Checklist

    GD - Defect Tracking Guidelines

    GD - Test Metrics Guidelines

    GD - KPI Metrics Guidelines

    GD - Test Estimation Guidelines

    GD - User Acceptance Test Guidelines

    PR Testing Process (Detail)

    PR - Testing Process Diagram (Xmind)

    Process

    15

  • Testing

    Implementation

    Requirement

    Design

    Deployment

    Software Quality Assurance

    Risk Management

    Project Management

    RELATIONSHIP WITH OTHER PROCESSES

    CM

    16

  • AGENDA

    Testing Process Evolution

    Fundamental Testing Process

    Components of Testing Process Framework

    Best Practices in Testing

    17

  • WHAT ELSE WE NEED FOR PROCESS?

    Plan Test

    Design Test

    Execute Test

    Close Test

    18

    Actual testing needs more than just fundamental process:

    Solutions

    Best Practices

    Standards

    Tools

    And more to become Test Center of Excellence

  • TESTING CENTER OF EXCELLENCE

    Test Solutions

    Automation Testing

    Performance Testing

    Mobile Testing

    Specialty Testing

    Best Practices

    Process Assessment

    Testing Estimation

    Continuous Process

    Improvement

    Exploratory/Risk-

    based Testing

    Quality

    Policy

    Guidelines &

    Templates

    Fundamental

    Testing Process

    Quality Metrics &

    Standards

    Plan Test

    Design Test

    Execute Test

    Close Test

    19

    TCoE = Processes + Practices + Solutions

  • WHY TEST SOLUTIONS?

    20

    About the Client Clearleap was the first company providing data streaming solution to offer a complete platform that allows TV everywhere possible

    Business Challenges

    Simulate high volume of concurrent

    users 100,000+ Complete within a tight schedule Limited budget for tool

    KMSs Solutions

    Tool Evaluation: Execute a proof of concept to evaluate both commercial and open source tools

    Planning: Determine a test strategy, approaches

    Test Design and Development: Design and develop scalable load testing architecture

    Execution and Reporting: Perform load testing and analyzing/reporting test results

    Achievements

    Developed a scalable solution based on Jmeter

    Extremely reduced the cost of testing and tremendously increased ROI

    Found critical performance issues

  • WHY TEST SOLUTIONS? (CONT.)

    It takes months to build up solution from beginning

    Cost of commercial tools v.s open source tools

    Effective solutions differentiates us from other vendors

    Typical Testing Solutions:

    Automation testing (web, desktop, mobile)

    Performance/Load Testing

    Security Testing

    Database/ETL Testing

    21

  • WHY BEST PRACTICES?

    22

    About the Client Global company supporting clinical trials in 67 countries. The Client offers services which include behavioral science, information technology, and clinical research

    Business Challenges 100% on time delivery with zero critical

    bugs Complicated paper process following

    FDA regulations Various testing platforms for both mobile

    devices and desktop

    KMSs Solution Process Establishment: Identify gaps in

    current process; Leverage start-of the-art practices

    Process Improvement: Define and measure performance /quality metrics

    Lifecycle Testing: Perform all lifecycle testing activities

    Test Automation: Develop an automation framework to shorten test cycle

    Achievements New process helps reducing 60% testing

    effort No critical defects identified during 1 year

    of engagement Moved paper work process to test

    management system open new trend in clinical trial industrial

  • WHY BEST PRACTICES? (CONT.)

    23

    Best practice improves outcome of activities

    Best practice has been proved of it effectiveness

    The more practices we use the higher maturity we are

    Typical Testing Best Practice:

    Review and Lesson-Learnt

    Root Cause Analysis

    Risk-based/Exploratory Testing

    Estimation Method, ROI Model

    Quality Metric Dashboard

  • AGENDA

    Testing Process Evolution

    Fundamental Testing Process