20
1 Software Quality Assurance (SQA) A Real Challenge in Level 2 Journey !!! Mark Wintle Rajendra Prasad Dr.Gargi Keeni

Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

1

Software Quality Assurance (SQA) A Real Challenge in Level 2 Journey !!!

Mark Wintle Rajendra PrasadDr.Gargi Keeni

Page 2: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

2

Session Outline1. Introduction to Software Quality Assurance (SQA)

2. SQA Challenges

3. Software Process Improvement (SPI) Cycle: SEPG and SQA

4. SEPG and SQA Hand in Hand

5. Key SQA Activities

6. What is Software Process Audit?

7. Management of Auditing

8. Steps in Typical Audit Cycle

9. Performing Audit

10. Auditing Skills

11. SQA on SQA Group

12. Sample SQA Metrics

Page 3: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

3

Introduction to SQA

Software Quality Assurance involves reviewing and auditing the

software products and activities to verify that they comply with

the applicable procedures and standards and providing the

software project and other appropriate managers with the results

of these reviews and audits. (SW-CMM ®)

Software Quality

Page 4: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

4

Quality Control

Quality Assurance

Quality control is an activity which verifies whether or not the product produced meets standards.

Quality assurance is an activity which establishes and evaluates the processes which produce the products.

Are there defects?

Product

Is there a process?

Process

Introduction to SQA

Page 5: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

5

SQA Challenges

SQA Manager is Process Police

Need to deliver product – No time for SQA

“I Talked to my manager …no SQA review for my project”

Resource crunch –Stop SQA and Just do Development !

Page 6: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

6

SEPG

Definition

SEPG /SQA

De

plo

yme

nt

Verification

SQA

Fe

ed

ba

ckSQA /SEPG

ContinuousProcess

Improvement

SPI Cycle - SEPG and SQA

Page 7: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

7

SEPG

SQA

ProcessDeployment

ProcessMentoring

ProcessDefinition

ProcessImprovement

Process AssetsMaintenance

Charter SPI

Governance

Audit

Reviews

Facilitation

ProcessAssessment

Training

SEPG and SQA Hand-in-Hand

Page 8: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

8

SQA GroupProcess

Mentoring

Audit

Facilitation

Coordinating withSEPG

Training

Reviews

ProcessDeployment

Communications

Key SQA Activities

Page 9: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

9

What is Software Process Audit?

A systematic and independent examination to determine:• Whether quality activities and related results comply with defined processes• Processes are implemented effectively• Processes are suitable to achieve desired objectives.

Independent Verification

Verification Against Defined Processes and Standards

Defined Periodicity

Page 10: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

10

Management of Auditing

Page 11: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

11

Preparation for the audit

Conducting the audit

Reporting the findings

Tracking of non-compliances

Audit cycle opening meeting

Audit cycle closing meeting

Steps in typical Audit Cycle

Page 12: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

12

The SQA Auditor while conducting audit should ensure that

!The entire scope of the audit is covered

!All discrepancies are based on sound, objective evidence

!Audit is conducted within given time

!Clear and precise Non-compliances are recorded

Recommended Audit trails

!Project Plan

!Previous audit reports, if applicable

!Project Management Review reports

!Project Status reports

Performing Audit

Page 13: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

13

While recording process Non-Compliance (NC) follow rule of three

The Non-compliance exists

Non-compliance adds value to the project

The Non-compliance can be tracked to closure

Qualifies for

Non-compliance

Rule of 3 : for Non-compliance

Page 14: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

14

Audit Swim LanesOrg. Quality

Head

SQA Lead

Audit Team

SQA Analyst

Project Team

Prepare AuditPlan

Approve AuditPlan

Conduct Opening Meeting

Brief Audit Team

Prepare Audit Summary

Prepare forAudit

Conduct Audit

Record Non-compliance

UpdateAudit Records

AnalyzeNon-compliances

TrackNon-compliance

Take correctiveAction on Non-compliances

Review Audit Summary

Initiate process Change (if needed)

Page 15: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

15

" Don’t rely only on paper based evidence

" Do not use an audit checklist alone to collect information

" Conduct the audit in a collaborative manner

" Interview the team members and project leaders separately with open ended questions

" Check for understanding of the process

" Increase buy-in toward standard process from the auditees

Auditing Skills

FACTS

Page 16: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

16

Rules of Communication

" Seek to clear your ideas before communicating them

" Examine the true purpose of your communication

" Consult with others, where appropriate, before communicating

" Be aware of your actions or expression, and any overtones, in addition to your basic message

" Convey something of merit to the receiver

" Check that your communication has been understood

" Remember the long term effects of your communication, as well as the immediate requirement

" Be a good listener

Auditing Skills

Page 17: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

17

SQA on SQA

Verification 3 of SQA Key Process Area in SW-CMM®

Experts independent of the SQA group periodically review the activities and software work products of the projects SQA group.

SQA ProcessSQA Plan

SQA Activities

SQA

Page 18: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

18

# Is there an SQA and Audit Plan?# Are non-compliances recorded and tracked to closure as defined in process? # Was there timely corrective action taken on non-compliances and were they effective?# Are the latest Audit checklists provided to Auditors? # Is an up-to-date list of members of part time audit pool maintained and used for assigning audits?# Are the audit checklists maintained? How often these are updated?# Is there a database maintained for tracking non-compliances?# Is periodic SQA status report sent to management?

SQA on SQA Checklist

Page 19: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

19

MetricsTrend Analysis on Non-compliance(NC)/KPA

2

4

7

1

3

6

23

1

34 4 4

0

5

2 2

0

5

1

12

5

2

15

2 2

00

2

4

6

8

10

12

14

16

SQA SPE SCM PR TP SPP SPTO RM IC

KPA

No

. o

f N

Cs

No of NCs - Nov 2002 No of NCs - Oct 2002 No of NCs - Till Sept 2002

No of Projects / Sept = 16

No of Projects / Oct = 7

No of Projects / Nov = 13

22

Page 20: Software Quality Assurance (SQA) A Real Challenge in Level ...yuezhao/cam4cmmi/204.pdf · Introduction to SQA Software Quality Assurance involves reviewing and auditing the software

20

Contact Information: Mark Wintle , e-mail: [email protected] Prasad, e-mail: [email protected]. Gargi Keeni, e-mail: [email protected]

Address : Tata Consultancy Services 111 Wood avenue south, 2nd floor Iselin, NJ 08830 Ph:732-491-0138