Error and Defect Managementin context of IFDK reference product

About this course material- This material if for general training for

Error and Defect Management- Material is more supportive in class

room - Material will be updated during courses- FreeNest Portable Project Platform is

used to demonstrate things only in practice. This is not limiting usage for material for other training environments (I hope )

About material

DefinitionsDefinitions

Failure -

Fault, Defect, Bug -

Incident, Failure, Error

Example forum thread: http://www.allinterview.com/showanswers/36257.html

ISTQB syllabus

Yläotsikko

Customer/BusinessRequirements

Sub SystemRequirements

ComponentRequirements

Component / UnitTesting

IntegrationTesting

System Testing

AcceptanceTesting

SystemRequirements

Architecture&Design&

Implementation

ProductVALIDATION

VERIFICATION

ErrorDatabaseError

Database

MAINTENANCE

Error Database & Management covers whole product life cycle

PRODUCT ENDtimeline

●TEST CASE ID XXXXX

●Step1●Step2●Step3.●Step4.

INCIDENTS

Bug/DefectReport Error Database

System UnderTest

EXECUTE TEST !

Test Engineer

Writes report and provides

evidences

What means error/defect reporting?

Yläotsikko

Collects

INCIDENTSINCIDENTS

Can lead to

Example Sources for error reportExample Sources for error report

CRM CRM

Field TestingField Testing

Testing ProcessTesting Process

CustomerFeedback /Customer

Feedback /

Error ReportError Report Change Request?Change

Request?

N x IncidentsN x Incidents

Yläotsikko

●Defect/Burg/Error ID●Reporter●Time●Founded where●Which way?●Test Case●Test Setup/Configuration●Describe scenario?●Attachements? Picture/Log/etc..

ErrorDatabase

Id1

Id2

Id1

Id3

Id1

Error/Bug/Defect ReportError/Bug/Defect Report

Id1

Id2

Id4Id3

Nature of bug?Nature of bug?

Location? Priority? Severity?

Where is the bug is found? Which one should fixed first? How fatal is the bug?

Id2Id2

Id2

Id2Id2

Id2

ID N

Target?

When the bug should be fixed and verified ?

Testing Levels and Error Management

UNIT TESTING – Developer's area

ImplementationImplementation Test FrameworkTest Framework

ErrorDatabaseError

Database

Integration Testing

ImplementationImplementation

Test FrameworkTest Framework

ErrorDatabaseError

Database

TestPlanTestPlan

ImplementationImplementation

Test FrameworkTest Framework

Component2Component2

System & Acceptace Testing

Implementation

Implementation

Test Framework

Test Framework Error

DatabaseError

DatabaseTestPlan

TestPlan

Implementation

Implementation

Test Framework

Test Framework

Component2Component2

TestPlanTestPlan

IFDK HARDWAREDESIGNIFDK HARDWAREDESIGN

IFDK HARDWAREPROTOTYPE VERIFICATEDIFDK HARDWAREPROTOTYPE VERIFICATED

Error/defect life cycle

Yläotsikko

Error fixing and release

Week 0Week 0 Week 26Week 26 Week 52Week 52

REL 0.1REL 0.1 REL 0.2REL 0.2 REL 0.5REL 0.5 REL 1.0REL 1.0

Defect Found

Defects Found

Defects FoundDefects FoundDefects

FoundDefects Found

Future ?

Hands On: Bugzilla Error Database

http://www.bugzilla.org/http://www.bugzilla.org/installation-list/

http://www.bugzilla.org/http://www.bugzilla.org/installation-list/

What is Bugzilla?

Bugzilla is a "Defect Tracking System" or "Bug-Tracking System". Defect Tracking Systems allow individual or groups of developers to keep track of outstanding bugs in their product effectively. Most commercial defect-tracking software vendors charge enormous licensing fees. Despite being "free", Bugzilla has many features its expensive counterparts lack. Consequently, Bugzilla has quickly become a favorite of thousands of organizations across the globe.

What is Bugzilla?

Bugzilla is a "Defect Tracking System" or "Bug-Tracking System". Defect Tracking Systems allow individual or groups of developers to keep track of outstanding bugs in their product effectively. Most commercial defect-tracking software vendors charge enormous licensing fees. Despite being "free", Bugzilla has many features its expensive counterparts lack. Consequently, Bugzilla has quickly become a favorite of thousands of organizations across the globe.

Reporting, Metrics and daily usage

BugzillaBugzilla

Yläotsikko

Other Defect Database Solutions

JIRA – Commercial

Requisite Pro – Commercial

Rational Synergy - Commercial

Mantis – Open Source

Testlink and Bugzilla

TestManagementDatabase

TestManagementDatabase

FeatureImplementationFeatureImplementation

TestCaseTestCase

Bug Report

ErrorDatabaseError

Database

PASSPASS

FAILFAIL

TestCaseTestCaseTestCaseTestCaseTestCaseTestCaseTestCaseTestCase

Test Plan/SuiteTest Plan/Suite

SourceCodeVersionControl

SourceCodeVersionControl

BUGZILLABUGZILLATESTLINKTESTLINKVC + ImplementationVC + Implementation

Feature or Bug?

That's a question!

Error and change managementError and change management

Yläotsikko

Change ManagementChange Management

Sometimes founded defect can lead to change

Bug?Bug?

Change Request?Change Request?Not ClearRequirementsNot Clear

Requirements

Feature ?Feature ?

Yläotsikko

Traditional SW Project vs Open Source ProjectTraditional SW Project vs Open Source Project

Open Source – Crowd Sourcing

SW Relase tested without coordination by group of volunteers

Release tested by customer

Field Testing

Test Group

Yläotsikko