WEBINAR: TAUS Outlook 2013

TAUS Outlook 2013

5-6 pm CETTuesday,13 November 2012

TAUS Outlook 2013

Market Landscape and TAUS ActivityWebinar

Hosts

Jaap van der MeerDirector, TAUS

Rahzeb ChoudhuryOperations Director, TAUS

This slide may not be used or copied without permission from TAUS

What TAUS is about...

... not solving yesterday’s problems

BUT...

Helping global companies and entrepreneurs in the translation industry grow their business.

Thinking ahead of the curve

... not telling you what you already know

Researching the future of crosslingual communications

Helping the world communicate better.

Establishing a platform for industry-shared services


Who we are. How we work.


Industry Organization

Partner Structure

International team in AmsterdamOutsourced Development

What Inspires TAUS ...

Nature of demand - Translation as a UtilityTranslation will be a feature in every app and on every screen. The translation industry is reaching billions of ‘new customers’ all connected on the internet. For the first time the translation industry has the opportunity to scale up and become a large mature global industry offering a wider range of services and solutions.

Sharing data and knowledge - TAUS approachSharing data and knowledge on an industry-level brings us all to a higher level competence and intelligence. We will be competing on a level that really matters, making a giant leap forward as an industry.

Think of: the Human Genome Project: a $3.8 Billion investment in sharing data about the human

genome drove $796 Billion in economic impact, and spurred growth in the life sciences industry.


TAUS Overview: an Evolving Role

Think Tank (since 2005) Reports, Best Practices Research, Directories Events, User Forums Workshops

Pushing the industry agenda and sharing knowledge

Industry-Shared Services1. Technology: Promoting MT (since 2006)

2. Data: Sharing Translation Data (since 2008)

3. Interoperability: Translation API (since 2011)

4. Metrics: Dynamic Quality Framework (since 2011)

Reducing costs and driving innovation and efficiency for members

Rationale of Industry-Shared Services

Every sector needs agreement on practices, transactions and definitions of deliverables in order to build customer confidence and grow a mature industry.

TAUS focuses on four industry-shared service programs:1. Technology2. Data3. Metrics4. Interoperability

Think of IATA for the travel industry and SWIFT for the banking industry.


Why:

Opportunities are too great to ignore. Machine translation technology leads to innovation inside and outside the translation industry. Embracing the technology will allow companies to grow and reach many new customers with new services and solutions.

Mind you:

MT technology needs to improve continuously: from generic language translation to industry-specific, domain training and personalization.

Opportunities are too Great

Promoting Translation AutomationMarket Landscape


Promoting Translation AutomationTAUS Activity

What’s been done Research: a library of reports, use cases,

best practices, technology briefings Directory: TAUS Tracker with listings of

MT and translation and language technologies

MT Users Forum: monthly meeting and knowledge base (FAQ).

Moses Showcases: EC funded events sharing experiences of dozens of Moses users

Latest Report: Advancing Best Practices In MT Evaluation’ report (July 2012)

Focus 2013 - Shared Knowledge Report: Translation Technology

Landscape Research: test engines with TAUS Data

and share reports for benchmarking MT Showcase: events with MT providers

demonstrating the best and the latest Moses tutorial: online step-by-step

training for Moses implementors Developing talent: collaboration with

universities worldwide training test engines with TAUS Data

MT User Forum: developing the FAQ Forum

Want to get (more) involved Learn from reports and the MT FAQ Forum Take part in MT User Forums (buyers only) Take part in MT Showcases Take part in “Developing Talent” project (for academics)


Why:

Multiply the benefits of your translation memories. Give your data and get access to all the shared industry data to train MT engines and improve translation quality.

Mind you:

Most translations are published on the internet and used already for MT training (e.g. Google, Bing, Baidu, Yandex). The TAUS Data repository is the only legitimate industry-shared repository of trusted translation data.

Multiply your Benefits

Sharing Translation DataMarket Landscape


Sharing Translation DataTAUS Activity

What’s been done Search: Translators find terms, fuzzy

and full matches in data repository. (500K searches per month).

TM Upload and Download: 4 billion words uploaded and more than 20 billion words downloaded since 2009.

Matrix: increased the volume of down-loadable and searchable data from 4 Billion words in 370 language pairs to 50 Billion words in more than 2,000 language pairs.

API: Search integrated in 10 products.

Focus 2013 – Shared R&D Private Vaults: all the benefits of TAUS

Data without public sharing Data Collector: a supervised crawler

and data aligner, allowing users to collect parallel data from trusted sites and validate the aligned data before uploading to TAUS Data.

Term Extractor: an online feature allowing users to upload a file and retrieve all the matching terms and phrases from the TAUS Data repository.

Matching Scores: semantic clustering. Data Marketplace: users can ask for

bids for data. Want to get (more) involved Use TAUS Data to train new language engines or customize engines. Pool data (members can take 5 times their uploads) or buy credits. Use API to integrate TAUS Search and TM Upload and Download in your product or

web site. Participate in new Data Marketplace project (see separate presentation).


Problem:Quality evaluation (QE) in the translation industry is problematic: It’s static: one translation quality fits all purposes and all content types It’s subjective: it lacks industry-level agreed methods and metrics

The problem of QE aggravates with the introduction of MT technology and the growing need to translate new content types

Solution: TAUS proposes: A dynamic approach to QE An industry-shared QE platform for MT benchmarking

The TAUS Dynamic Quality Framework brings credibility and transparency to MT quality evaluation, solving bottlenecks, saving time and costs and increasing efficiency and performance of MT engines.

TAUS Dynamic Quality FrameworkMarket Landscape


Work Already DoneTAUS Activity

Dynamic Quality Framework Report (November 2011):Starting in Q1 2011 TAUS explored best practices in translation quality evaluation and researched new methodologies and metrics. In the report following this study TAUS presents a dynamic QE framework, which offers a more flexible approach to the common static QE models. The Dynamic QE framework is based on the three parameters of utility, time and sentiment (UTS). Download the 32 pages report.

DQF Knowledge Base (June 2012):In consultation with sixteen enterprise members TAUS developed a knowledge base providing a framework of the best fit translation quality evaluation models based on content types, intended usage, tools, processes and other variables. The DQF knowledge base describes seven different QE models: adequacy/fluency, community-based, customer feedback, error typology, readability, usability, adherence to regulatory markets. See DQF knowledge base. Content Profiling (June 2012):The participating enterprise members ranked their different content types using the UTS scoring method. Eight different content categories were defined based on this scoring. For each category the best suited QE model is assigned. New users can select one of the eight defined content categories to find recommendations for QE or they can go through an exercise of UTS scoring to map their content types to the agreed general categories. See content profiling.DQF Tools (Q3 2012):In July 2012 TAUS released two different quality evaluation tools for beta-testing by a select number of TAUS members: a productivity testing tool for machine translation output and a quality evaluation tool (adequacy-fluency and error typology). These tools will be released for general use by all TAUS members in the fourth quarter 2012.


http://www.translationautomation.com/best-practices/translation-quality-evaluation-is-catching-up-with-the-times.html

http://www.tauslabs.com/dynamic-quality/evaluation-models

http://www.tauslabs.com/dynamic-quality/knowledgebase

Plans Going ForwardTAUS Activity

Benchmarking (Q1 2013):In the first quarter of 2013 TAUS wants to release benchmarking services on the DQF platform that will allow users to evaluate and compare the quality of MT engines that they develop or use internally and to also benchmark their MT engines with those of other MT users and developers.

AttributesBenchmarking data collected are: language pair, industry sector, content category, sentence length, date, name of engine, company name. Users will be able to compare the performance of their MT engines against averages in selected groupings based on these attributes.

Evaluation Models and MetricsThe following evaluation models and metrics will be available: Productivity: time spent by 1,000 words and number of edits per 1,000 words,

compare productivity with no match Error typology: number of errors per category Adequacy: on a scale from 1 to 5 Fluency: on a scale from 1 to 5 Readability: on a scale from 1 to 5 Better – Worse: e.g. 5 (better) to 1 (worse)


Use Cases – KB and Content ProfilingTAUS Activity

Target usersThe Knowledge Base and Content Profiling services are aimed at all translation professionals.

Access to DQF Knowledge Base (June 2012Use case: User needs to identify best practice, templates, tools and metrics for new more dynamic quality evaluation models. The DQF Knowledge Base gives a good overview of the industry’s collective intelligence on translation quality evaluation.Benefits: reduced overhead costs for QE industry referencable best practices increase credibility and transparency of QE.

Content Profiling (June 2012)Use case: User needs to identify best matching QE model for content type and best matching content types for MT technology.Benefits: industry referencable best practices increase credibility and transparency for MT

usage..


Use Cases – MT Evaluation and BenchmarkingTAUS Activity

Target usersThe MT Evaluation and Benchmarking services are aimed at MT users and developers.

MT Internal Evaluation (October 2102)Use case: User needs to compare the quality and performance of different MT engines in order to select the best engine for their own use. S/he can upload the machine-translated files, fill in the attributes, assign evaluators/editors and retrieve metrics for comparison. Options are to do productivity testing, error typology, adequacy/fluency and better-worse evaluation.Benefits: industry-standard tools and metrics increase reliability of the evaluation scores vendor-independent evaluation increases flexibility and reliability reduced overhead costs for MT evaluation

MT Industry Benchmarking (January 2013)Use case: User needs to compare the quality and performance of their (best) MT engines for business analysis. Options are to benchmark productivity scores, error typology, adequacy/fluency and better-worse evaluation scores.Benefits: Benchmarking data are essential for translation strategies decisions Benchmarking data help to continuously improve the performance of MT engines Benchmarking data help to set referencable industry data for productivity


Why:Resources, files, jobs need to ‘travel’ frictionless between vendors and tool platforms for customers and users to be happy, grow their business and increase their translation volumes.

Mind you: Standards move very slowly. It is extremely complex to deal with numerous file formats and different interests from so many parties in the legacy translation industry.

Translation volumes are shifting from file-based to web-based: many small jobs and transactions on the internet rather than heavy doc sets.

TAUS now focusing on interoperability of web-based translation activities.

Translation InteroperabilityMarket Landscape


Translation Interoperability

What’s been done Technical Committees: TAUS

participates in TC’s for XLIFF and TMX standards.

Translation Technology Roundtable: TAUS organized a first meeting exclusive for translation technology providers.

Translation API: Defined and reviewed translation services API specifications with TAUS members.

Launched Translation API and validation service.

Focus 2013 Translation API: provide a self-help kit

to integrate translation API in workflows.

Translation Technology Roundtable: Bring industry players from supply side together in focused events.

Want to get (more) involved Implement and help enhance the Translation API. Join the Translation Technology Roundtable events (for technology providers). Contribute to Translation Technology Landscape Report.


http://blog.programmableweb.com/2012/05/22/6000-apis-its-business-its-social-and-its-happening-quickly/

Massive Growth in Business Use of APIs

TAUS Events

“Virtual Meetings”

MT User Forums Teleconference meeting for

MT Users, every last Thursday of even months

DQF User Forums Teleconference meeting for

DQF Users, every last Thursday of uneven months

Quarterly Member Webinar Once a quarter we invite all

members for a briefing webinar on industry-shared programs

Semi-Annual Webinar Twice a year we hold a

webinar for all candidate members to share updates on industry perspectives

Conference Program

TAUS QE Summit (March 14-15) Hosted by Microsoft in Dublin

TAUS Tokyo Executive Forum (April 11-12) Hosted by Oracle Japan

TAUS Asia Summit (September) Park Plaza Hotel, Beijing

TAUS European Summit (June 10-11) Westin Hotel, Dublin

TAUS User Conference (October 7-8) Governor Hotel, Portland (OR)

Your feedback

Which of the TAUS action lines is most relevant and useful for you:1. Promoting Translation Automation2. Sharing Translation Data3. Dynamic Quality Framework for Quality

Evaluation4. Translation Interoperability


Come to the TAUS events in 2013


For more information, contact us at: [email protected]


Thank you. We hope you found the session helpful.