Quality Management in Localization Certification

1 This work by the Localization Institute is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.

In association with TAUS

Quality Management in Localization Certification

Informa(onal Webinar July 2, 2013


Quality Management in Translation and the

TAUS Dynamic Quality FrameworkSelf Study Component

Willem Stoeller PMP® in cooperation with TAUS

Contact information: [email protected]


Instructor: Willem Stoeller PMP®

Ø  22 years experience in translation, localization and internationalization of software products, marketing materials and web content

Ø  Previous senior management experience at two well-known Localization Services Providers and one Localization Tools Provider

Ø  Certified Project Management Professional and member of the Project Management Institute. Currently board member of the PMI® Chapter in Portland

Ø  Former visiting professor at the Monterey Institute of International Studies where he taught software localization for two years

Ø  Principal contributor to the localization project management certification program offered by the Localization Institute


Objectives

Ø  Upon completion of this program, you will be able to: –  Describe the issues related to managing translation quality –  Describe how the different quality management standards can contribute to managing translation quality

–  Place the Dynamic Quality Framework within the context of quality management models

–  Describe the three major components of the TAUS Labs DQF offering

–  Use the DQF facilities offered through TAUS Labs –  Determine how DQF could be used in your own organization to evaluate translation quality


Target Audience

Ø Anyone interested in translation quality – TSP project managers, quality managers and lead translators

– Translation buyer project managers, quality managers and lead translators

– Other translation professionals interested in translation quality using machine or human translation

– TAUS membership not required


Agenda Quality Management in Transla(on

and the TAUS Dynamic Quality Framework

Self Study

Introduc(on Quality

Management Standards

DQF Overview

Experience with DQF

Classroom

Hands-‐on with DQF

Cer(fica(on Test


Agenda Self Study

Introduc(on Quality

management standards

Current state of quality

management in transla(on

Where does DQF fit in?

DQF overview

DQF and the real world


What is Translation Quality and how can we influence it?

Ø Quality is defined as the degree to which the characteristics of a translation fulfill the requirements of the agreed-upon specifications (ASTM F2575-06 Standard Guide) –  Requirements depend on domain, content type and communication channel (e.g. business to consumer)

–  Characteristics are often described indirectly in the form of a weighted error typology



Ø Often quality is defined in less precise terms –  One single approach independent of content type or communication channel

–  Translation needs to comply with terminology and style guides

–  Quality is left to the discretion of the ICR reviewer –  It has to be perfect, flawless (And that means?) –  I know quality when I see it (holistic but not useful!)



Transla(on Quality

Source Content Quality

Transla(on Requirements

Translator experience, training and performance

Processes and Tools Used


Agenda Self Study

Introduc(on Quality





DQF overview



Quality Management Standards

Quality Management Standards

General Standards

ISO 9001:2008

PMBOK® Guide CMMI Six Sigma

Transla(on Specific Standards

EN15038 CAN CGSB 131.10

ASTM F2575-‐06 Standard Guide


Agenda Self Study

Introduc(on Quality





DQF overview



Current state of Quality Management in Localization

Ø Often weak, missing or not documented quality planning

Ø Often review without a formal quality evaluation such as J2450

Ø Quality assurance missing or only focused on completing all quality processes without asking: “Are these the right processes?”


Agenda Self Study

Introduc(on Quality





DQF overview



Where Does DQF fit in?

Quality managementin Localization

Select resources

Train resources

Define quality objectives

Provide feedback toresources

Select Quality evaluation techniques

Pass/fail criteria

Evaluate sourcecontent quality

Create functional& linguistic test plan

Evaluate targetcontent quality

Evaluate technical quality

Evaluate linguistic qualitySelect workflowand tools

QA of processes used

Client LSP relationship DQF


Agenda Self Study

Introduc(on Quality





DQF overview



DQF Overview

This will be addressed by the next presenter: Rahzeb Choudhury from

TAUS

18


Agenda Self Study

Introduc(on Quality





DQF overview



DQF and the Real World

Ø Case studies from: –  Intel – EMC – Pactera


Quality Management in Translation and the

TAUS Dynamic Quality Framework

Thank you for your attention! If this sample makes you thirst for more, see the Localization Institute Website

TAUS Dynamic Quality Framework Industry collabora/ve pla3orm for transla/on quality evalua/on

Rahzeb Choudhury TAUS

23 This work by the Localization Institute is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License. 23

Clients

MLV’s

In country offices/partners

Distributed translators/authors

4 to 30 vendors

10 to 40 languages

100’ to 1000’s translators/authors

Vendor Management Project Management

Quality Assurance TranslaGon Memory

Account Management

Resources Management

Quality Assurance

Project Management TranslaGon Memory

Resources Management

Quality Assurance

Project Management

TranslaGon Memory

Quality Assurance TranslaGon Memory

Cascaded Supply Chain

This slide may not be used or copied without permission from TAUS


Dynamic Quality Framework •  Need to go up and down in quality and the transla(on industry’s use

of quality evaluaGon models and metrics needed to reflect this, •  Need industry benchmarking to strengthen and improve the

credibility of quality assurance processes, •  Need to lower cost of quality assurance at buyers and providers. "   We aim to achieve this through an industry shared knowledge base, guidance on

QE model selecGon and shared tools for benchmarking.



Project Organiza(on

•  Ongoing ini(a(ve since January 2011

•  Bimonthly project management calls, primarily with TAUS members

•  TAUS DQF team – Nora Aranberri, Maxim Khalilov,

Sharon O’Brien, Jaap van der Meer, Rahzeb Choudhury

•  Development outsourced



DYNAMIC QUALITY FRAMEWORK THEORY


27 This work by the Localization Institute is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License. This slide may not be used or copied without permission from TAUS

28 This work by the Localization Institute is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License. This slide may not be used or copied without permission from TAUS

DYNAMIC QUALITY FRAMEWORK IN PRACTICE


DQF Content Profiling – From July 2012



DQF Content Profiling

•  Delinea(ng quality requirements

•  Shared approach to iden(fy best matching QE model(s) for content type and opera(ng model

•  Greater credibility to decisions

•  Based on feedback during QE Summit Dublin (March 2013), working on version 2

•  Available for scru(ny QE Summit San Jose, October 9



DQF Knowledgebase – From July 2012



DQF Knowledgebase



DQF Knowledgebase



DQF Knowledgebase



DQF Knowledgebase



Aier DQF KB

•  Leverage industry best prac(ces to create/refine quality programs

•  Central resource that can be systema(cally reviewed and improved to benefit all

•  Work together to standardize approaches, defini(ons and metrics

•  Following QE Summit Dublin held consulta(ons and published publicly available best prac(ces guidelines



DQF Best Prac(ce Guidelines – Since May 2013



DQF Best Prac(ce Guidelines



DQF Tools



DQF Tools

Undertake human evalua(on of MT output to: •  Rank MT engines

•  Produc(vity evalua(ons

•  Assess linguis(c quality using adequacy, fluency or error typology approaches



Aier DQF Tools

•  Apply best prac(ce approaches to MT evalua(ons •  Benchmarking data •  Vendor independent evalua(on •  Reduced evalua(on costs •  Industry evalua(on results provide data for fundamental

research

•  Now working on v2 based on user feedback

•  Go live August



Currently…

•  BP Prac(ces for Pricing MT PE Consulta(on now open

•  hmp://www.transla(onautoma(on.com/consulta(ons/consulta(ons

•  Transla(on Tools Adopt DQF Models

•  Preparing for TAUS QE Summit 9 October 2013

•  hmp://www.surveymonkey.com/s/BreakoutsQESummtSanJose



QE Summit San Jose


Thank you! Rahzeb Choudhury [email protected]


Online study begins September 9, 2013 Registration closes September 29, 2013 Workshop October 8, 2013 in Santa Clara, CA

Key Dates:

More informa(on can be found at hmp://bit.ly/12BiSUM Ques(ons? Please contact kris@localiza(onins(tute.com

Technology

Quality Management in Localization Certification