Value&Beyond&ContentCreaon:& Introducing&ITS&2.0& · 2014. 10. 3. · Sasaki&–SOAP!&2014& Whatcontentauthors&can&do&with&mul

Sasaki – SOAP! 2014

Value Beyond Content Crea<on: Introducing ITS 2.0

Felix Sasaki DFKI / W3C Fellow

Slides at hLp://www.w3.org/Talks/2014/1003-‐soap-‐sasaki.pdf

1


If you want to have nice visualiza<on what ITS 2.0 is: go here J

“Linguini a la transla<on: An Introduc<on to ITS 2.0”

hLps://www.youtube.com/watch?v=5Goet3hX6Jo

2


What content authors normally do

•  Make money by crea<ng – Content – Layout – Apps

•  More and more difficult – Growing amount of content & apps – What is the differen<ator?

3


What content authors may do in the future

•  Make money by enriching content – Using automa<c tools with manual correc<on – Create the basis for further processes

•  Transla<on, search engine op<miza<on, contextualiza<on, personaliza<on, ..

– Authors become content curators J

•  Background: R&D projects and their results

4


Background 1: LIDER project hLp://lider-‐project.eu/

•  EU funded project – aims: – Demonstra<ng the value of mul<lingual linguis<c linked data sources

– Exploring usage scenarios & requirements in various domains

– Crea<ng an R&D roadmap around the topic

5


Background 2: ITS 2.0 hLp://www.w3.org/TR/its20/

•  W3C standard to foster mul<lingual content crea<on

•  Defines metadata (“data categories”) to support the mul<lingual content life cycle

•  A way to interlink Web content and mul<lingual linked data sources

6


ITS 2.0 data categories •  Translate •  Localiza<on Note •  Terminology •  Direc<onality •  Language Informa<on •  Elements Within Text •  Domain •  Text Analysis •  Locale Filter •  Provenance

•  External Resource •  Target Pointer •  ID Value •  Preserve Space •  Localiza<on Quality Issue •  Localiza<on Quality

Ra<ng •  MT Confidence •  Allowed Characters •  Storage Size

7


ITS 2.0: High level features

•  Can be applied to general XML content and to HTML5

•  Par<ally na<vely supported in HTML5 –  E.g. HTML5 “translate” aLribute

•  Applying data categories –  locally: ITS aLributes in content –  globally: CSS like selector mechanism, using XPath

•  Independent data categories: no need to support (as tool maker or user) everything J

8


Example: “Translate” local and global

9

The World Wide Web Consor<um is making the World Wide Web worldwide!

<its:rules xmlns:its="hLp://www.w3.org/2005/11/its" version="2.0"> <its:translateRule selector="//h:code" translate="no" xmlns:h="hLp://www.w3.org/1999/xhtml"/> </its:rules>


Example: “Localiza<on Note”

10

<data its:locNote="%1\$s is the original text's date in the format YYYY-‐MM-‐DD HH:MM always in GMT" …> <value>Translated from English content dated %1\$s GMT.</value> </data>


Example: “Elements within Text”

11

<text xmlns:its="hLp://www.w3.org/2005/11/its" its:version="2.0"> <body> <par>Text with <bold its:withinText="yes">bold</bold>.</par> </body> </text>


Example: “Locale Filter”

12

<book xmlns:its="hLp://www.w3.org/2005/11/its"> <info> <legalno<ce its:localeFilterList="en-‐CA, fr-‐CA"> <para>This legal no<ce is only for English and French Canadian locales.</para> </legalno<ce> </info> </book>


Example: “Allowed Characters”

13

Login names can only use leLers from A to Z (upper or lowercase) and the character underscore (_) and minus (-‐). For example: <code its-‐allowed-‐characters=[a-‐zA-‐Z_\-‐]>Huck_Finn</code>.


Example: “Terminology”

14

And he said: you need a new <quote its:term="yes" its:termInfoRef ="hLp://www.directron.com/motherboards1.html" its:termConfidence="0.5">motherboard</quote>


Example: “MT Confidence”

15

<body its-‐annotators-‐ref="mt-‐confidence|file:///tools.xml#T1"> Dublin is the capital of Ireland.


Example: “Provenance”

16

This paragraph was translated from the machine.


Example: “Localiza<on Quality Issue”

17

 <span data-‐mytool-‐qacode=named_en<ty_not_found its-‐loc-‐quality-‐issue-‐comment="Should be Thomas Cahill.” its-‐loc-‐quality-‐issue-‐profile-‐ref=hLp://example.org/qaMovel/v1 its-‐loc-‐quality-‐issue-‐severity=100 its-‐loc-‐quality-‐issue-‐type=inconsistent-‐en<<es> Chris<an Bale (1867–1934) conceived of an instrument … 


Example: “Text Analysis”

•  Iden<fy concepts in content, like named en<<es – persons, places, events, …

•  Store iden<fiers in (Web) content •  Provide a link to mul<lingual linked data sources – a basis for content cura<on

18


Example: “Text Analysis”

19

Dublin is the capital of Ireland.


What content authors can do with mul<lingual linked data sources and ITS 2.0

•  Add value to content beyond the content itself •  Curate content: provide iden<fiers, context, cross lingual informa<on

•  Tool examples: 1)  Genera<on of ITS 2.0 “Text Analysis” for ePub, and

Schema.org markup 2)  Genera<on of transla<on sugges<ons 3)  Working with linked data in the browser – without

understanding details

20


TOOLING 1): GENERATION OF ITS 2.0 “TEXT ANALYSIS” AND SCHEMA.ORG MARKUP FOR EPUB

21


Setup

•  oXygen XML editor, modified for ePub / XHTML5 author mode

•  Input: ePub or XHTML5 documents •  Output: documents enriched with Schema.org structured informa<on

•  User does informa<on genera<on in a WYSIYWG mode

22


Process

1.  Automa<c genera<on of en<ty annota<on, using DBpedia spotlight, producing DBpedia iden<fiers

2.  Access to DBpedia informa<on with pre-‐defined linked data queries

3.  Genera<on of Schema.org markup

23


1. Automa<c genera<on of en<ty annota<on

•  Input: Welcome to Dublin in Ireland, the home of Samuel BeckeL.

24



•  Output, stored with ITS 2.0 “Text Analysis” markup:

Welcome to Dublin in Ireland, the home of Samuel BeckeL.

25


2. Access to DBpedia informa<on

•  Using DBpedia iden<fiers from previous steps in linked data query templates. Example query (part of the query), checking whether en<ty is a person:

SELECT ?birthPlace ... WHERE{ <hLp://dbpedia.org/resource/Samuel_BeckeL> rdf:type foaf:Person. ... }

26


3. Genera<on of Schema.org structured informa<on

•  Using output of previous step (query result) •  Genera<ng Schema.org structured informa<on – Taking types derived from DBpedia into account, currently •  hLp://schema.org/Person •  hLp://schema.org/Place

27



•  Input: linked data query result and marked-‐up document


28



•  Output: marked-‐up document with Schema.org structured informa<on

Welcome to <a itemprop="url" href=" hLp://en.wikipedia.org/wiki/Dublin">Dublin</a>…

29



•  Output: auto-‐genera<ng markup + text ... Samuel BeckeL ... (born in <a itemprop="url" href="hLp://en.wikipedia.org/wiki/Foxrock"> Foxrock</a>)

30


Checking output with Structured Data Tes<ng Tool

31


Broad review: a view of schema.org types that may work well

Book (dbpedia-‐owl:Book) City (dbpedia-‐owl:City) Country (dbpedia-‐owl:Country) Event (dbpedia-‐owl:Event) Hotel (dbpedia-‐owl:Hotel) Library (dbpedia-‐owl:Library) Movie (dbpedia-‐owl:Film) Person (foaf:Person) Place (dbpedia-‐owl:Place) Organiza<on (dbpedia-‐owl:Organiza<on)

32


TOOLING 2): GENERATION OF TRANSLATION SUGGESTIONS

33


Genera<ng transla<on sugges<ons

•  Input: like before •  Steps:

1.  En<ty annota<ons (again) 2.  Access to DBpedia and Wikidata to get

transla<on sugges<ons 3.  Storing the results as a localiza<on note

34



•  Output, stored with ITS 2.0 “Text Analysis” markup:


35


2. Access to DBpedia and Wikidata to get transla<on sugges<ons

•  Get transla<on sugges<on from Dbpedia

SELECT ?o WHERE { <hLp://dbpedia.org/resource/Samuel_BeckeL> rdfs:label ?o }

36


2. Access to DBpedia and Wikidata to get transla<on sugges<ons

•  Get transla<on sugges<on from Wikidata

hLp://www.wikidata.org/w/api.php?ac<on= wbgeten<<es& sites=itwiki& <tles=Samuel%20BeckeL

37


3. Storing the results as ITS 2.0 localiza<on note

•  Input: DBpedia + Wikidata query result and marked-‐up document

… the home of Samuel BeckeL.

38


3. Storing the results as localiza<on note

•  Output: Transla<on sugges<ons stored as localiza<on note

… the home of Samuel BeckeL.

39


TOOLING 3: WORKING WITH LINKED DATA IN THE BROWSER – WITHOUT UNDERSTANDING DETAILS

40


MLOD4CON

•  Working with links to external mul<lingual data sources

•  Under the hood: lot’ of technology –  ITS 2.0, RDF, SPARQL, JavaScript, …

•  Good news: the user does not need to know about these J

Demo at hLp://www.w3.org/People/fsasaki/mlod4con/

41


EVERYTHING DONE?

42


Issues

•  Learn from communi<es what they want to do with ITS 2.0 and linked data sources – Content creators and content architects, translators, XML / Web tool makers, researchers in the data and language technology area, …

•  Provide adequate tooling •  Look carefully into requirements: “Too much informa<on is no informa<on!”

43


What next for you? •  ITS 2.0 Tooling hLps://www.w3.org/Interna<onal/its/wiki/ITS_Implementa<ons

•  Videos explaining ITS 2.0 usage hLps://www.youtube.com/user/W3CITS20/videos •  Linked Data for Language Technology Community Group: discuss use cases and requirements for mul<lingual linked data

hLp://www.w3.org/community/ld4lt/ •  ITS Interest Group: Join the community of ITS 2.0 users and implementers

hLps://www.w3.org/Interna<onal/its/ig/

44


Value Beyond Content Crea<on: Introducing ITS 2.0

Felix Sasaki DFKI / W3C Fellow

Slides at hLp://www.w3.org/Talks/2014/1003-‐soap-‐sasaki.pdf

45

Documents

Value&Beyond&ContentCreaon:& Introducing&ITS&2.0& · 2014. 10. 3. · Sasaki&–SOAP!&2014& Whatcontentauthors&can&do&with&mul