Automatically extracted abbreviated data with DBpedia

S

Automatically extracted abbreviated data with Dbpedia

Steven R. Loomis IBM Global Foundations Technology Team

whoami

S  IBM GFTT

S Unicode ULI-TC

S Unicode UTC

S Unicode CLDR

S  ICU

S Node.js Intl/TSC

S Bluemix Globalization

ibm.biz/srloomis • © 2015 IBM 2

Localization Interoperability uli.unicode.org

S  English: Hello World

S  Spanish: ¡Hola, Mundo!

S  French: Salut tout le monde

S  Maltese: Merħba Id-Dinja

S  …


Sentence Problem

S  Of these, and also his commission, it pleased him to let the Governor here take a copy. He gave them notice of his arrival by letter, but before they could visit him, he went eastward with the ship he came in; but a storm got up, and as they lacked a good pilot to harbour them there, they bore up for this harbour. He and his men were kindly entertained here, and stayed fourteen days. In the meantime Mr. Weston arrived with his small ship, which he had now recovered. Captain Gorges, who in- formed the Governor here that one purpose of his going east was to meet with Mr. Weston, took this opportunity to call him to account for some abuses he had to lay to his charge. Whereupon he called Weston before him and some other of his assistants, with the Governor of this place; and charged him first with the ill carriage of his men in Massachusetts, by which means the peace of the country had been disturbed, and he himself and the people he had brought over to settle there were much prejudiced. To this Mr. Weston easily answered, that what had been done, was in his absence, and might have befallen anyone; he left them sufficiently provided, and supposed they would be well governed; for any error committed he had sufficiently smarted. This particular charge was passed by. The second charge was of a wrong done towards his father, Sir Ferdinand Gorges, and to the State.

S è Separate Sentences


Abbreviations: L

S  In the meantime Mr.

S  Weston arrived with his small ship, which he had now recovered.


Abbreviations: J

S  In the meantime Mr. Weston arrived with his small ship, which he had now recovered.


Abbreviation data


DBPedia source


CLDR suppression data

S  <suppressions type="standard">

S  <suppression>L.P.</suppression>

S  <suppression>Alt.</suppression>

S  <suppression>Approx.</suppression>

S  <suppression>E.G.</suppression>


Future Direction

S  Exporting CLDR locale data in RDF form S  http://unicode.org/cldr/trac/ticket/7138

S  Using DBPedia abstracts to improve data collection S  Sudanese vs Sundanese

S  Ex Vietnam: Tiếng Sudan vs Tiếng Sunda

S  Language of Indonesia vs people of Northern Africa

S  http://unicode.org/cldr/trac/ticket/8802


Thanks!

S  ibm.biz/srloomis

S  @srl295
