A Quality Certification Model for Grid Research Projects the ETICS feasibility Study

www.eu-etics.org

INFSOM-RI-026753

A Quality Certification Model for A Quality Certification Model for Grid Research ProjectsGrid Research Projects

the ETICS feasibility Studythe ETICS feasibility Study

Adriano RippaAdriano Rippa(([email protected]@eng.it)) - Engineering Ingegneria Informatica s.p.a.- Engineering Ingegneria Informatica s.p.a.On behalf of ETICS ProjectOn behalf of ETICS Project

EGEE '07 Conference - Budapest 01-05/10/2007 2INFSOM-RI-026753

Summary

• Introduction to QA conceptsIntroduction to QA concepts

• The starting point of the present studyThe starting point of the present study

• The proposed The proposed Grid Quality Certification ModelGrid Quality Certification Model (GQCM) (GQCM)

• Comparing GQCM and other QA standardsComparing GQCM and other QA standards

• Using GQCM in Industries: the Engineering Using GQCM in Industries: the Engineering experimentationexperimentation

• ConclusionsConclusions


Quality Assurance refers to several concepts

• Quality of the implementation Quality of the implementation process process – High level steps of the software High level steps of the software

production cycle suggesting what production cycle suggesting what the organization must do (not how) the organization must do (not how) to have effective development to have effective development processes that “processes that “may leadmay lead” to good ” to good software.software.

• Quality of the requirements Quality of the requirements management management – Correct collection/management of Correct collection/management of

requirements and relation with the requirements and relation with the customer and stakeholders, to customer and stakeholders, to reduce the percentage of failures reduce the percentage of failures due to misinterpreted requirements.due to misinterpreted requirements.

• Quality of the service Quality of the service – Performances and correctness of Performances and correctness of

the service providethe service provide

• Finally quality of the software…Finally quality of the software…

QUALITY

Quality of Product

Quality of Process

GQCMGQCMCMMCMM

ITILITILISO – 900xISO – 900x


Some QA Terminology

• Measure: Measure: a value (number or category) assigned to an a value (number or category) assigned to an attribute of an entity (e.g. software component)attribute of an entity (e.g. software component)

• MeasurementMeasurement: : The act or process of assigning a The act or process of assigning a number or category to an entity to describe an attribute number or category to an entity to describe an attribute of that entity. of that entity.

• MetricMetric: : A function whose inputs are software measures A function whose inputs are software measures and whose output is a single numerical value that can and whose output is a single numerical value that can be interpreted as the degree to which software be interpreted as the degree to which software possesses a given attribute that affects its quality.possesses a given attribute that affects its quality.


Quality is a matter of measure!

• State-of-the-art provide hundreds of measuresState-of-the-art provide hundreds of measures– The most commonThe most common

– Cyclomatic complexityCyclomatic complexity– Lines of CodeLines of Code– Function PointsFunction Points– Mean Time Between(to) failureMean Time Between(to) failure– Bugs densityBugs density– ……

– Other approaches (Goal Question Metric - GQM) promote user Other approaches (Goal Question Metric - GQM) promote user defined metricsdefined metrics

– Anomalies distributionAnomalies distribution– Effort used to solve anomaliesEffort used to solve anomalies– Cost of not founded anomaliesCost of not founded anomalies– ……


Quality Standards

• There are There are many standardsmany standards to asses the quality of the to asses the quality of the processes of an organization processes of an organization – CMMCMM– ISO familyISO family– ITILITIL– AQAPAQAP

• But QA means initial investments and managing QA But QA means initial investments and managing QA means devote resources to it!means devote resources to it!

• Several studies show that lot of companies (e.g. many Several studies show that lot of companies (e.g. many Small/Medium Enterprises) Small/Medium Enterprises) can’t afford the initial effortcan’t afford the initial effort and don’t recognise the promised and don’t recognise the promised increase of valueincrease of value..


e.g. CMM-I

• CMM-I levels:CMM-I levels:– 1 Initial: Processes are low managed and controlled. There is a first 1 Initial: Processes are low managed and controlled. There is a first

tentative to look at the qualitytentative to look at the quality– 2 Managed: Processes are specific, controlled, applied, replicable2 Managed: Processes are specific, controlled, applied, replicable– 3 Defined: There is homogeneity in the processes between all the 3 Defined: There is homogeneity in the processes between all the

projects. They are defined by the organizationprojects. They are defined by the organization– 4 Quantitatively Managed: Processes are measured and controlled4 Quantitatively Managed: Processes are measured and controlled– 5 Optimising: Focus on the continuous improvement process5 Optimising: Focus on the continuous improvement process

• Only ~70 companies in the world are certified at level 5Only ~70 companies in the world are certified at level 5– 50 of them are in India50 of them are in India

• Only 25% of the companies in the world are level 2 or aboveOnly 25% of the companies in the world are level 2 or above


QA in research project is missing!

• Current quality assurance standards are useful Current quality assurance standards are useful butbut

– They are They are process orientedprocess oriented, the organisation need to be , the organisation need to be structured and certified. What for the short-live structured and certified. What for the short-live consortia?consortia?

– They They provide only theoretical guidelinesprovide only theoretical guidelines that need to be that need to be adapted and realisedadapted and realised

– It’s It’s hard to systematically verify goodnesshard to systematically verify goodness of results: of results: managing tools neededmanaging tools needed

– They They need resourcesneed resources to be devoted to. to be devoted to.– People need to be trainedPeople need to be trained and certification needs and certification needs

inspections and time to be achievedinspections and time to be achieved (usually about two (usually about two or three years depending on the organisation or three years depending on the organisation complexity).complexity).


QA in grids: our solution

• GQCM is aGQCM is a modelmodel forfor quality assurance that isquality assurance that is

– fully automatablefully automatable in measuring and verifying activities to in measuring and verifying activities to reduce investments and management effort,reduce investments and management effort,

– not subjectivenot subjective, to certify the object not the process nor the , to certify the object not the process nor the organization,organization,

– product orientedproduct oriented, not process oriented,, not process oriented,

• ……easily adoptable within grid Research Projectseasily adoptable within grid Research Projects


The timeline

FIRST BETA FIRST BETA

VERSIONVERSIONFINAL BETA FINAL BETA

VERSIONVERSION

OCTOBEROCTOBER

FIRST OFFICIALFIRST OFFICIAL

VERSIONVERSION

DECEMBERDECEMBER

ECHOGRID/EUChinagridECHOGRID/EUChinagrid

Conference 24-25 AprilConference 24-25 April

MAYMAYFEBRUARYFEBRUARY

OGF 20/EGEE UFOGF 20/EGEE UF

7-11 May7-11 May

Belief ConferenceBelief Conference

25-28 June25-28 June

OGF 21OGF 21

15-19 Oct15-19 Oct

QUALIPSO QUALIPSO ConferenceConference

16-17 Jan 200816-17 Jan 2008

NowNow

EGEE ’07EGEE ’07

1-5 Oct1-5 Oct

EELA 3° EELA 3° Conference 3-5 Conference 3-5

Dec 2007Dec 2007


Grid Quality Certification Model

• Some QA Standards areSome QA Standards are– Waterfall-likeWaterfall-like– BooleanBoolean

• GQCM could be seen as a GQCM could be seen as a model that looks at the model that looks at the quality by independent quality by independent points of view, tested points of view, tested separately to provide user-separately to provide user-friendly resultsfriendly results

AA

BB

CC

AA

BB

CC


GQCM: Preliminary remarks

• GQCM is GQCM is independentindependent from the ETICS tools from the ETICS tools

• Any GQCM implementation needs justAny GQCM implementation needs just “automation” “automation” !!

• GQCM has been developed and described according to GQCM has been developed and described according to several ISO standards (e.g. ISO/IEC 25000, 14598) and several ISO standards (e.g. ISO/IEC 25000, 14598) and will be experimented in a ISO/CMM certified will be experimented in a ISO/CMM certified organizationorganization


GQCM: Structure

• GQCM is structured in GQCM is structured in Evaluation Modules (EM)Evaluation Modules (EM)..

• The set of evaluation techniques are grouped in The set of evaluation techniques are grouped in families. Every family is an EMfamilies. Every family is an EM

• 5 EMs:5 EMs:

– EM: Static analysisEM: Static analysis– EM: Coding styleEM: Coding style– EM: Structural testingEM: Structural testing– EM: Functional testingEM: Functional testing– EM: Standards complianceEM: Standards compliance


Evaluation Modules 1/5

• EM Static analysisEM Static analysis– Quality characteristics:Quality characteristics:

– Reliability – maturityReliability – maturity– Maintainability – analysabilityMaintainability – analysability– Maintainability – changeabilityMaintainability – changeability– Maintainability – testabilityMaintainability – testability

– Technique:Technique: – Static analysis of classes. Statistics on measures are used as Static analysis of classes. Statistics on measures are used as

predictor of quality characteristics. This analysis is expected to be predictor of quality characteristics. This analysis is expected to be supported by an analysis tool.supported by an analysis tool.

– Applicability:Applicability:– Object oriented programming languages. Object oriented programming languages.

– Input:Input:– source code, each class of the code is analysed source code, each class of the code is analysed



• EM Coding styleEM Coding style– Quality characteristics:Quality characteristics:

– Maintainability – analysabilityMaintainability – analysability

– Technique: Technique: – Static analysis of the source code. This analysis is expected to be Static analysis of the source code. This analysis is expected to be

supported by an analysis tool.supported by an analysis tool.

– Applicability:Applicability:– Most programming languageMost programming language

– Input:Input:– source codesource code



• EM Structural testingEM Structural testing– Quality characteristics:Quality characteristics:

– Functionality – accuracyFunctionality – accuracy– Reliability – maturityReliability – maturity

– Technique:Technique:– Structural testing. The intention of this EM is to test specific classes Structural testing. The intention of this EM is to test specific classes

that are identified by static measures as being statistically more that are identified by static measures as being statistically more likely to have many errors. likely to have many errors.

– Applicability:Applicability:– Object oriented programming languagesObject oriented programming languages

– Input:Input:– source codesource code



• EM Functional testingEM Functional testing– Quality characteristics:Quality characteristics:

– Functionality – accuracyFunctionality – accuracy– Functionality – interoperabilityFunctionality – interoperability– Reliability – maturityReliability – maturity– Portability – adaptabilityPortability – adaptability– Portability - installabilityPortability - installability

– Technique:Technique:– Functional testingFunctional testing

– The purpose of this EM is both to check platform compliance and The purpose of this EM is both to check platform compliance and to check to functional abilities of the software product.to check to functional abilities of the software product.

– Applicability:Applicability:– GeneralGeneral

– Input:Input:– compiled codecompiled code– user documentationuser documentation



• EM Standards complianceEM Standards compliance– Quality characteristics:Quality characteristics:

– Functionality – standards complianceFunctionality – standards compliance

– Technique:Technique:– Functional testing Functional testing

– This EM has a good potential for automating the test. This EM has a good potential for automating the test.

– Applicability:Applicability:– Standard specificStandard specific

– Input:Input:– compiled codecompiled code


GQCM: EMs and QA points of view

• Testing results could be virtually grouped in three Testing results could be virtually grouped in three summarizing points of view to have a more direct summarizing points of view to have a more direct vision of what is evaluated :vision of what is evaluated :

– QualityQuality– PlatformsPlatforms– StandardsStandards

Quality

Platforms

Standards

Good quality

Medium quality

Poor quality

Window

s

UN

IX

Linux

OASIS: WS-I

OGF: OGSA-BES

MacO

S


GQCM: Final Score

• Final score should be provided according to the following Final score should be provided according to the following schema. The items which should be available for the users are:schema. The items which should be available for the users are:– A A table summarizing the resultstable summarizing the results– A A list of passed and non passed testslist of passed and non passed tests– All the All the important informationimportant information as: as:

– Software product (e.g. name, version, executable code, documentation..)Software product (e.g. name, version, executable code, documentation..)

– Platform (name, version, date)Platform (name, version, date)

– Quality characteristics (name, evaluation result, evaluation module Quality characteristics (name, evaluation result, evaluation module identification)identification)

– Standard compliance (for each standard: name, version, date)Standard compliance (for each standard: name, version, date)

– Identification of evaluation report (organization, report number, date)Identification of evaluation report (organization, report number, date)

– Identification of certification body (organization, contact information)Identification of certification body (organization, contact information)

– Certification data (dates, certification number)Certification data (dates, certification number)

– Electronic signature of certification record Electronic signature of certification record


Summarizing Table structure

EMStatic EM Coding EM Structural EM Functional EM Std compl.

Functionality X X

Accuracy X X

Interoperability X

Compliance (X)

Reliability X X X

Maturity X X X

Maintainability X X

Analyzability X X

Changeability X

Testability X

Portability X

Adaptability X

Installability X


GQCM: Summarizing Table example

Consolidated eval. result

EM Static

EM Coding

EM structural

EM Functional

EM Std compliance

EM eval. result M M G G G Y

Functionality G G G

Accuracy G G G

Interoperability G G

Compliance Y (Y)

Reliability M M G G

Maturity M M G G

Maintainability M M G

Analyzability M M G

Changeability M M

Testability M M

Portability G G

Adaptability G G

Installability G G

G = GoodM = MediumP = Poor


Do you see any cons?

• I can’t add any overhead to my projectI can’t add any overhead to my project– This model (and the capability of automate) will reduce the effort This model (and the capability of automate) will reduce the effort

in performing continuous build and test activities (e.g. coverage in performing continuous build and test activities (e.g. coverage tests) on different releasestests) on different releases

• How much costs adopting it?How much costs adopting it?– Nothing, the model will be discussed publicly and the final Nothing, the model will be discussed publicly and the final

version will be released under open license (e.g. Creative version will be released under open license (e.g. Creative Commons)Commons)

– The ETICS framework is provided as a service running on a The ETICS framework is provided as a service running on a dedicated infrastructure, free of charge for Research Project dedicated infrastructure, free of charge for Research Project

• My organisation is certified ISO/CMMi so I…?My organisation is certified ISO/CMMi so I…?– See next slides…See next slides…

• Other? Please criticise…Other? Please criticise…


GQCM integration in an ISO 9126 certified organization

• Facts:Facts:– ISO 9126 define quality attributes ISO 9126 define quality attributes – GQCM support the measure and evaluation of quality metricsGQCM support the measure and evaluation of quality metrics

• Hypothesis:Hypothesis:– ISO9126 Portability: adaptability, installabilityISO9126 Portability: adaptability, installability

– ISO9126 asks OS adaptability and installability for software of ISO9126 asks OS adaptability and installability for software of certified organizationscertified organizations

– GQCM may test deployment of SW on different platforms (HW+OS)GQCM may test deployment of SW on different platforms (HW+OS)

– ISO9126 Maintainability: all.ISO9126 Maintainability: all.– ISO9126 asks to develop a software that is easy to analyse, easy to ISO9126 asks to develop a software that is easy to analyse, easy to

modify, Stablemodify, Stable– GQCM metrics (such as the CK for OO or coding convetions GQCM metrics (such as the CK for OO or coding convetions

metrics) helps to verify in concrete these requirementsmetrics) helps to verify in concrete these requirements


GQCM integration in an ISO 9126 certified organization

• ISO9126 Functionality: accuracy.ISO9126 Functionality: accuracy.– ISO9126 asks that a software have to give results according with ISO9126 asks that a software have to give results according with

requirements.requirements.– GQCM certification can run functional test (or plug-in external test suits) GQCM certification can run functional test (or plug-in external test suits)

of declared compliances.of declared compliances.

• ISO9126 Functionality: adequacy.ISO9126 Functionality: adequacy.– ISO9126 asks for correct functions with specific goals.ISO9126 asks for correct functions with specific goals.– GQCM may check not dead functions.GQCM may check not dead functions.

• Our thesis:Our thesis:– Many ISO9126 quality metrics can be measured and evaluated based Many ISO9126 quality metrics can be measured and evaluated based

on GQCMon GQCM– Any tool implementing it and can be integrated as supporting ISO9126 Any tool implementing it and can be integrated as supporting ISO9126

adoptionadoption


GQCM integration in a CMMi certified organization

• FactsFacts– CMM is process oriented (it gives guidelines).CMM is process oriented (it gives guidelines).– GQCM is product oriented.GQCM is product oriented.

• Hypotesis:Hypotesis:– CMM2 CMM2

– asks to “control and value”asks to “control and value”– GQCM proposes the measures and metrics to be collected, hence GQCM proposes the measures and metrics to be collected, hence

controlling and evaluating specific sw related itemscontrolling and evaluating specific sw related items

– CMM3 CMM3 – asks to “use internal standards and have a reference model”asks to “use internal standards and have a reference model”– GQCM proposes code and implementation conventions (how to GQCM proposes code and implementation conventions (how to

organise and structure code, how to define tests, etc.)organise and structure code, how to define tests, etc.)


GQCM integration in a CMM certified organization

• CMM4 CMM4 – asks to “have measured and controlled processes using quantitative asks to “have measured and controlled processes using quantitative

and statistical techniques”and statistical techniques”– GQCM proposes the continuous collection of quality data to perform GQCM proposes the continuous collection of quality data to perform

trends analysis.trends analysis.

• CMM5 CMM5 – asks to have an “improvement process and quality based on asks to have an “improvement process and quality based on

measurement”measurement”– GQCM provides numerical reference to set the improvement GQCM provides numerical reference to set the improvement

processes.processes.

– Our ThesisOur Thesis– GQCM is not in contrast with CMMI and can be integrated in GQCM is not in contrast with CMMI and can be integrated in

organization as a tool to support CMMI adoptionorganization as a tool to support CMMI adoption


Engineering: Certifications 1/2

• All this work is born from internal needs ofAll this work is born from internal needs of– The research areaThe research area– The production areaThe production area

• Engineering is certified as follows:Engineering is certified as follows:– ISO 9001ISO 9001

– For all the ICT sector in which the organization is involvedFor all the ICT sector in which the organization is involved

– Since 1994 ( ISO9001:2000 from December 2002)Since 1994 ( ISO9001:2000 from December 2002)

– CMM 2 CMM 2 – Since February 2005Since February 2005

– For all production divisionsFor all production divisions

– NATO AQAP 2110/160NATO AQAP 2110/160– Since December 1996 (from 1996 to 2005 there were different rules)Since December 1996 (from 1996 to 2005 there were different rules)

• TThe company is managing the process to be certified at level 3he company is managing the process to be certified at level 3



• To reach the level 3 we are selecting tools for test and To reach the level 3 we are selecting tools for test and quality managementquality management

• Engineering is developing Spago4Q (Engineering is developing Spago4Q (www.spago4q.orgwww.spago4q.org) ) – integrated with other tools measure processes, performances integrated with other tools measure processes, performances

and bugs.and bugs.– Examples of calculated metrics:Examples of calculated metrics:

– Test CoverageTest Coverage– Anomalies distributionAnomalies distribution– Effort used to solve anomaliesEffort used to solve anomalies– Cost of not founded anomaliesCost of not founded anomalies– Metrics about requirementsMetrics about requirements– Metrics about risk managementMetrics about risk management– ……



• GQCM + ETICS b&t tool will help to measure the left GQCM + ETICS b&t tool will help to measure the left quality aspects as:quality aspects as:– The quality of the codeThe quality of the code– The compliance with standardsThe compliance with standards– The compliance with OSThe compliance with OS– ……


Engineering: objectives and QA

• EngineeringEngineering looks at:looks at:– Client satisfactionClient satisfaction– Company successCompany success– Monitoring of the previous pointsMonitoring of the previous points

• Client satisfaction is seen as a necessary assumption Client satisfaction is seen as a necessary assumption to confirm and enhance Engineering’s successto confirm and enhance Engineering’s success

• The way to obtain it is the supply of quality productsThe way to obtain it is the supply of quality products

• Engineering has a Quality Management System (QMS) defined Engineering has a Quality Management System (QMS) defined pursuing the following principles:pursuing the following principles:– Client-oriented attitudeClient-oriented attitude– Continuous improvementContinuous improvement– Focus on processFocus on process– Involvement of all human resourcesInvolvement of all human resources


The QMS model

Continuous Enhancing of Quality Management System

ManagementResponsibility

CL

IEN

T

RE

QU

IRE

ME

NT

S

SA

TIS

FA

CT

ION

CL

IEN

T

Pro

duct

/Ser

vice

Input Output

Measurement, Analisys, Enhancing

Resources Management

Product / ServiceRealization

based on UNI EN ISO 9001:2000 processesbased on UNI EN ISO 9001:2000 processes


QA and Engineering

• Engineering’s Quality Management System:Engineering’s Quality Management System:

– involves the entire organizational structureinvolves the entire organizational structure

– operates on processesoperates on processes

– adopts proceduresadopts procedures

– uses resourcesuses resources


Engineering: Quality in projects

• Activities to reach the qualityActivities to reach the quality

– identification, formalization, verification and filing of reference identification, formalization, verification and filing of reference documentation (contractual and technical)documentation (contractual and technical)

– drafting a Quality Plan, a document listing project requirements, drafting a Quality Plan, a document listing project requirements, the operational and management choices aiming at the the operational and management choices aiming at the implementation of requirementsimplementation of requirements

– development in conformity with outlined production processdevelopment in conformity with outlined production process

– verification of intermediate and final results (concerning in verification of intermediate and final results (concerning in particular the design, testing activities and documentation)particular the design, testing activities and documentation)

– evolution management, during the different job phases and evolution management, during the different job phases and releases, of software and documentation;releases, of software and documentation;

– check-ups of monthly work progress compared with the actual check-ups of monthly work progress compared with the actual project planning; project planning;

– formalization of project’s main events, through recurrent formalization of project’s main events, through recurrent technical and work in progress meetings with the Client.technical and work in progress meetings with the Client.


Engineering: Quality Plan 1/3

• At the beginning of the project, the Project Manager At the beginning of the project, the Project Manager should draft a “Quality Plan” that handle:should draft a “Quality Plan” that handle:

– Contractual documentation analysisContractual documentation analysis– must be clear that the Project Manager has understood and must be clear that the Project Manager has understood and

verified all aspects concerning the contractual relationship with the verified all aspects concerning the contractual relationship with the Client Client

– Project organizationProject organization– defined in terms of defined in terms of

– ResourcesResources

– RolesRoles

– ResponsibilitiesResponsibilities



– Product/service supply and project requirements Product/service supply and project requirements – description on:description on:

– product/service to be suppliedproduct/service to be supplied

– product/service’s requirementsproduct/service’s requirements

– resolutions in case of eventual vaguenessresolutions in case of eventual vagueness

– evidence of possible divergences compared to the contractual evidence of possible divergences compared to the contractual documentationdocumentation

– Projecting and Development Process Projecting and Development Process – the adopted process, used methodology, output, support toolsthe adopted process, used methodology, output, support tools

– Configuration Management Configuration Management – what it has been decided for check of work-status of product what it has been decided for check of work-status of product

components, for its back-up procedurescomponents, for its back-up procedures



– Suppliers’ Management (sub-contractors) and interactions with Suppliers’ Management (sub-contractors) and interactions with Third PartiesThird Parties

– only in presence of sub-supplies, even if internalonly in presence of sub-supplies, even if internal

– Materials to be delivered/activities to be carried out Materials to be delivered/activities to be carried out – all objects/materials to be delivered to Client or the activities to be all objects/materials to be delivered to Client or the activities to be

carried out for the Clientcarried out for the Client

– Verifications and validations modes. Verifications and validations modes. – projecting and development verification (functional and technical);projecting and development verification (functional and technical);– validation of function projecting and developmentvalidation of function projecting and development


Engineering: Quality Control 1/2

• Quality Assurance and Internal Auditing Division has Quality Assurance and Internal Auditing Division has the responsibility:the responsibility:– to verify the execution of targeted activities to eliminate possible to verify the execution of targeted activities to eliminate possible

anomalies arisenanomalies arisen– to identify, describe and execute corrective actions in order to to identify, describe and execute corrective actions in order to

eliminate anomalies’ causeseliminate anomalies’ causes– to identify, describe and carry out preventive actions in order to to identify, describe and carry out preventive actions in order to

eliminate possible anomalies’ causeseliminate possible anomalies’ causes– to undertake any initiative which could improve the effectiveness to undertake any initiative which could improve the effectiveness

and efficiency of the Quality Management Systemand efficiency of the Quality Management System


Engineering: Quality Control 2/2

• On an annual basis, this division drafts reports on On an annual basis, this division drafts reports on details gathered by the different corporate divisions, details gathered by the different corporate divisions, regarding the fulfilment of Quality goals set at the regarding the fulfilment of Quality goals set at the beginning of the year, allowing the identification of beginning of the year, allowing the identification of possible improvementspossible improvements

• Control activities, on a periodical basis, carried out the Control activities, on a periodical basis, carried out the Quality Assurance and Internal Audition Division within Quality Assurance and Internal Audition Division within an IT project are classifies as follows:an IT project are classifies as follows:– official check-upsofficial check-ups– content check-upscontent check-ups– work -in progress check-upswork -in progress check-ups– results’ validationresults’ validation


Conclusions

• GQCM is a certification modelGQCM is a certification model– AutomatableAutomatable– Not in contrast with classical standardsNot in contrast with classical standards– Ready to be integrated with classical standards Ready to be integrated with classical standards – FreeFree– Not limited to the ETICS build and test toolNot limited to the ETICS build and test tool– Not limited to research projectsNot limited to research projects

• GQCM require less human effort to be used because it GQCM require less human effort to be used because it is almost fully automatableis almost fully automatable

• ETICS tool is ready to implement GQCMETICS tool is ready to implement GQCM


E-mail addresses

• We want it to be as We want it to be as simple and effective as possible to simple and effective as possible to useuse. For this . For this we need your feedbackwe need your feedback::

[email protected]@cern.ch




Q&A

http://www.eu-etics.org• Acknowledgements:Acknowledgements:

• Many thanks for their contribution to Many thanks for their contribution to • Daniela VaghegginiDaniela Vagheggini• Gabriele RuffattiGabriele Ruffatti• Andrea ManieriAndrea Manieri

Documents

A Quality Certification Model for Grid Research Projects the ETICS feasibility Study