44
10 years Agricultural Ontology Initiative: Building Blocks for a Linked Data Infrastructure Dr. Johannes Keizer FAO of the United Nations Office of Knowledge Exchange, Research and Extension Team Leader “Knowledge Standards and Services”

Aos china keizer-2010-10-30

Embed Size (px)

DESCRIPTION

Presentation at the Chinese AOS workshop, Beijing, 2010, October 30-31

Citation preview

Page 1: Aos china keizer-2010-10-30

10 years Agricultural Ontology Initiative: Building Blocks for a Linked Data Infrastructure

Dr. Johannes Keizer

FAO of the United Nations

Office of Knowledge Exchange, Research and Extension

Team Leader “Knowledge Standards and Services”

Page 2: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Internet!

Page 3: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 4: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Aggregation States of Knowledge

Page 5: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Data Flows and Repositories in Research

Page 6: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

“... FAO’s principle task is to work to ensure that the world’s knowledge of food and

agriculture is available to those who need it when they need it and in a form which they can

access and use ...”

Page 7: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AOS Vision in 2001

Page 8: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

..from thesaurus to Ontologies….

Page 9: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Our push of AGROVOC to the Semantic Web had enormous positive effects, among others

From 4 to 20 language versions

Defacto standard for indexing in many areas

More than 2000 downloads only in 2009

SKOS incorporated all our requirements

For many purposes we need semantics on a lower level than of a fully elaborated ontology – but we need them urgently

The development of specific Ontologies should be always application driven – a demand economy

Lessons Learned

Page 10: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AOS - TodaySemanticsTools

Linked DataCommunity

Page 11: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Community

Page 12: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The AOS Community

Page 13: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://aims.fao.org/community/home

Page 14: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Better Semantics

Page 15: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

around 30,000 concepts

600000 labels in around 20 languages.

one-stop shop for terminological knowledge related to agriculture in general

a knowledge base of related concepts organized in ontological relationships (hierarchical, associative, equivalence)

Is a concept/term/string based system

Concepts may be organized in multiple categories.

AGROVOC concept scheme

Page 16: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Further schemes in FAO

skos:broader

:bar

has_synonymhas_translation

skos:literalForm “maize”:foomaïs (fr)

:foo

has_synonymskos:literalForm “corn”

:bar

8171

1474

skosxl:altLabel

skosxl:prefLabel

skos:broader

has_synonym

SKOS Label

The AGROVOC concept scheme

SKOSConcept

rdf:type

rdf:type

6211

skos:broader

AGROVOCConceptScheme

skos:topConceptOf

skos:inScheme

Another scheme in FAO

Other scheme in FAO

skos:inScheme

12332

Page 17: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Work Expression Manifestation Item

Subjects

Corporate Bodies

Conferences Journals

Series

FAO Projects

FAO FRBR Model & Authority Data

Page 18: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Journal(URI–Concept)

CorporateBody (URI)

SpellingVariant

City

Geopoliti cal Ontology (URI)

isSpatiallyIncludedIn

isPublishedByISSN

ISSN-L

isOtherLanguageEditionOf

isFollowedBy/Follows

Label

Journal(URI–Concept)

Other URIs…

EXAMPLE: JOURNAL CONTENT MODEL

Page 19: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

A Model to create Linked Data

Rich set of relationships Easier implementation of concept-based thesauri and authority data

FAO OAFRBR

RDFLLD

Page 20: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Geopolitical Ontology

OEKM FAO of the UN 20

Page 21: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Fishery Ontologies

Page 22: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

What Partners have done…..

Rice Knowledge Models

Rice Production Ontology

ASFA Thesaurus

VIVO Ontologies

Look to the many presentations on this workshop

Page 23: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Tools

Page 24: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Concept Scheme Work Bench

Page 25: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Drupal

AgriDrupal is a “suite of solutions” for agricultural information management and dissemination, built on the Drupal CMS by different

Institutions and individuals who are now sharing their experiences in the AgriDrupal community

Drupal, a semantic web enabled CMS General purpose CMS necessary

Drupal has flexibility to manage all information types

Drupal has a strong user community

Version 7 natively with RDF backbone, but semantic applications already possible with version 6

Drupal can be a producer and consumer of Linked Data

Page 26: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Drupal Query run on a Drupal website from a Virtuoso test environment at http://demo.openlinksw.com/sparql_demo/

SPARQL endpoint

RDF triples

Drupal website

Page 27: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

• Objectives:• Assure quality in metadata creation • Sharing information in a standardized manner • Use of common semantics and interoperable

syntaxes• Use of more sophisticated and specialized

metadata • Use of controlled, multilingual vocabularies

• Requirements:• AGRIS AP compliancy• AGROVOC

AgriOcean Dspace – a tool for Repositories

Page 28: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AgriOceanDspace – Thesaurus plug in

• Developed by Kasetsart University (Bangkok, Thailand)

• Thesaurus plug-ino Web services: use local or remote version of AGROVOC

thesaurus/SKOS

Page 29: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Linking Data

Page 30: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The Linked Data Universe: http://www.linkeddata.org (july 2010)

Page 31: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://agris.fao.org/agris-search/search/display.do?f=2004/ZA/ZA04002.xml;ZA2004000049

Page 32: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AGROVOC EUROVOC UNBIS Relationship

http://aims.fao.org/aos/agrovoc/c_207

http://eurovoc.europa.eu/219055

agroforestry skos:exactMatch/ owl:sameAs

http://aims.fao.org/aos/agrovoc/c_4826

http://eurovoc.europa.eu/220018

MILK skos:exactMatch/ owl:sameAs

http://aims.fao.org/aos/agrovoc/c_12332

http://eurovoc.europa.eu/219871

MAIZE skos:exactMatch/ owl:sameAs

Linking vocabularies

Page 33: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://aims.fao.org/aos/agrovoc/c_7825

http://eurovoc.europa.eu/218754

Page 34: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

http://eurovoc.europa.eu/219871

Maize

skosxl: literalForm

Maize

http://aims.fao.org/aos/agrovoc/c_12332

AGROVOC

skosxl: literalFormMaize

http://aims.fao.org/aos/agrovoc/c_12332 owl:sameAs http://eurovoc.europa.eu/219871

owl:sameAs/exactMatch

http://agris.fao.org/agris-search/search/display.do?f=1996/TR/TR96001.xml;TR9600026

Linking data through common URIs

skosxl: literalForm

owl:sameAs/exactMatch

http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:202:0011:0015:EN:PDF

http://unbisnet.un.org:8080/ipac20/ipac.jsp?session=128F308557F34.283092&profile=bib&uri=full=3100001~!685149~!1&ri=1&aspect=subtab124&menu=search&source=~!horizon

Maize

Eurovoc

UNBIS

Page 35: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

What are we doing with unstructured data?

• We have enormous amounts of unstructured material

• Still most of the documents that we are producing are mostly semantically unstructured

• Human work to catalogue and index is becoming always more rare

• We need machines to do automatic semantic mark ups of text

• If machines are trained and based on concept schemes, ther are able to do so

Page 36: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 37: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

• Does Concept identification in unstructured texts

• Uses Agrovoc as a controlled vocabulary

• Prototype under testing with excellent results (entire repository of ICARDA indexed)

• Will produce in future Structured RDF files that can be used to link data like “open Calais”

AgroTagger

Page 38: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 39: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 40: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Page 41: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

Life Demo: Semantic mark ups:

http://viewer.opencalais.com/

http://agropedialabs.iitk.ac.in/Tagger/Agrotagger_text.php

Page 42: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

The CIARD RING

Page 43: Aos china keizer-2010-10-30

dr johannes keizer - FAO of the United Nations - knowledge and capacity for development

Chinese Agricultural Ontology Service WS, Beijing 2010-10-30

AGRIS Linked Data

Page 44: Aos china keizer-2010-10-30

Thank You!http://www.ciard.nethttp://ring.ciard.nethttp://aims.fao.orghttp://agris.fao.org