© Polycom, Inc. All rights reserved. From “No need for QA” to “Cannot Live without QA” in...

© Polycom, Inc. All rights reserved.

From “No need for QA” to “Cannot Live without QA” in 100 daysWaisman Guy, Polycom inc, SQA Team leader

© Polycom, Inc. All rights reserved. 2

Introduction to Polycom

Industry leader in conferencing and collaboration

© Polycom, Inc. All rights reserved. 3

SVC is …

• Scalable Video Codec

• New generation of video compression

• Multiple Scalabilities in a single video stream

© Polycom, Inc. All rights reserved.

Starting point

© Polycom, Inc. All rights reserved. 5

Engineering team: 2 R&D teams (~20 developers) Single SQA Engineer (Defined role: Bug tracking, Administration)

Product: Application to replace current compression methods, Integrated within

large vendor media client

Complexity levels ~ 40,000 permutations of use cases…and counting

© Polycom, Inc. All rights reserved. 6

First Vendor Drop

© Polycom, Inc. All rights reserved. 7

SQA Get Into Action – Road to Quality

© Polycom, Inc. All rights reserved. 8

Phase 1 – Foundation

Quality Foundation – Grey Box

© Polycom, Inc. All rights reserved. 9

Quality Foundation

© Polycom, Inc. All rights reserved. 10

Main test Application

© Polycom, Inc. All rights reserved. 11

Dashboard

© Polycom, Inc. All rights reserved. 12

Results Analysis

© Polycom, Inc. All rights reserved. 13

Phase 2 – Taking Quality to the Next Level

Quality Foundation – Grey Box

Next level of quality - White Box

© Polycom, Inc. All rights reserved. 14

Next Level of Quality

© Polycom, Inc. All rights reserved. 15

• Improved main testing tool:

• Automation suite:

© Polycom, Inc. All rights reserved. 16

Phase 3 – Back to Basics

Back to basic – Black box

Next level of quality - White Box

Quality Foundation – Grey Box

© Polycom, Inc. All rights reserved. 17

Back to Basics - Black Box Testing

© Polycom, Inc. All rights reserved. 18

Subjective Quality Measurement

© Polycom, Inc. All rights reserved. 19

Quality Foundation – Grey Box

Back to basic – Black box

Next level of quality - White Box

End to End Quality

Phase 4 – End to End

© Polycom, Inc. All rights reserved. 20

End to End Quality

SQA Delivery package :

KPIQ suite

© Polycom, Inc. All rights reserved. 21

SQA achievements

© Polycom, Inc. All rights reserved. 22

Lessons learned

© Polycom, Inc. All rights reserved. 23

Q&A

© Polycom, Inc. All rights reserved. 24

ENV Setup

© Polycom, Inc. All rights reserved. 25

References

POLYCOMhttp://www.polycom.com/index.html?ss=false

SVC:http://cdn.intechopen.com/pdfs/15138/InTech-A_tutorial_on_h_264_svc_scalable_video_coding_and_its_tradeoff_between_quality_coding_efficiency_and_performance.pdf

Testing tools:www.testcocoon.org

http://softwaretopic.informer.com/vega-h264-analyzer-download-free/

http://www.klocwork.com/?gclid=CKzDkoXw9bACFcFeTAodqzan8g

http://software.intel.com/sites/products/documentation/hpc/inspectorxe/en-us/lin/start/getting_started_inspector_xe_linux.pdf

HW & SW:http://pandaboard.org/

http://www.ubuntu.com/

© Polycom, Inc. All rights reserved.

Thank YouWaisman Guy : Guy.waisman@polycom.co.il