Download pptx - Talk at Mann Library, Cornell University Ithaca, NY 2011-05-06

agricultural information management standards and services - dr. johannes keizerCIARD – Linked Open Data Infrastructure, Ithaca 2011, May 12

Talk at Mann Library, Cornell UniversityIthaca, NY 2011-05-06

Dr. Johannes KeizerOffice of Knowledge Exchange, Research and ExtensionFood and Agriculture Organization of the UN

The CIARD (Coherence in Information for Agricultural Research for development) initiative and a global infrastructure for linked open data (LOD)


We will promote research for food and agriculture, including research to

adapt to, and mitigate climate change, and access to research results and

technologies at national, regional and international levels.

We will reinvigorate national research systems and will share information

and best practices. We will improve access to knowledge.

world food summit 2009



AOS/AGMES

Agris Consultations

Coherence in Information for Agricultural Research for Development

agricultural information management standards and services

…since then


http://www.ciard.net


Involving Institutions into CIARDBenefits:increased national/international

visibility and use of their research output and content services

increased exchange of information content between their system(s) and others

increased awareness of other research outputs through information content and services

increased access to specialised expertise and knowledge and other partners’ proven solutions

• Contributions• promote and implement the CIARD

vision and objectives

• register products and services on research outputs through the CIARD RING

• adopt/promote international standards related to digital research outputs

• register institutional profile on Checklist

• share lessons learned and experiences


2nd IISAST Consultation

CIARD Initiative launched

(15 founding partners)

Regional Consultations

70 countries 150 info prof.

1 st IISAST Consultation

TASK FORCES

CIARD endorsed (GCARD and FARA)

+112 partners and growing…

20092007 20082005

Coherence in Information for Agricultural Research for Development

A new global movement to provide a platform for coherence between information-related initiatives

to make public domain agricultural research information and knowledge truly accessible to all

e-Consultation & Beijing Consultation

+ Regional Workshops

GCARD 2012

2010 20122011


Advocacy Task Force

Capacity Building Task Force

Content Management Task Force


http://aims.fao.org


The AIMS Community


…. and now to the technical stuff


Information Infrastructure for Agricultural Research and Innovation


Distributed Repositories• stats• gene banks• gis data• blogs, • journals• open archives• raw data• technologies• learning objects• ………..



Example: BBC Wildlife Finder


Humboldt Squid page, pulled together from a diversity of Linked Data sources

Animal Diversity Web:Nocturnal way of life

BBC TV Documentary

BBC News item

Wikipedia


..to talk about now Vocabularies and Linked Open Data An Idea about an Infrastructure Elements for the Infrastructure

AGROVOC and the VocBench AgroTagger and OpenCalais LODE-BD Tools The RING

Implementation Example: AGRIS


Vocabularies and Linked Open Data



http://aims.fao.org/aos/agrovoc/c_7825




http://eurovoc.europa.eu/218754











http://agclass.nal.usda.gov/nalt/2011.xml#1780







AGROVOC

http://aims.fao.org/aos/agrovoc/c_12332 owl:sameAs http://eurovoc.europa.eu/219871 skos: exact match UNBIS: Toxic Substances

http://agris.fao.org/agris-search/search/display.do?f=1996/TR/TR96001.xml;TR9600026

Linking data through common URIs

http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:202:0011:0015:EN:PDF

http://unbisnet.un.org:8080/ipac20/ipac.jsp?session=128F308557F34.283092&profile=bib&uri=full=3100001~!685149~!1&ri=1&aspect=subtab124&menu=search&source=~!horizon


Eurovoc TOXIC SUBSTANCES

UNBIS

http://agclass.nal.usda.gov/nalt/2011.xml#1780

NALThttp://www.agnic.org/search/CAT85822953








If all institutions, which publish about toxic wastes would:- - Index their publications with URIs

from AGROVOC,GEMET, NALT, LCSH or EUROVOC

- (many do – low hanging fruit!)- - Publish their metadata as LOD- (quite easy to do, bibData map well to

RDFThenEveryone who knows to write Sparql Qeries could get all these publications with one shot for a new website on toxic wastes


Vocabularies and LOD Simply publishing your data as RDF

does not link them to other data sets Creating this links by humans is

interesting in detail, but unrealistic as mass processing

Linking 2 standard vocabularies can link 200 datasets which use these standard vocabularies


…just out of the pipele-----Original Message-----From: Antoine Isaac [mailto:[email protected]] Sent: Thursday, May 12, 2011 7:19 PMTo: UDC SummaryCc: Anibaldi, Stefano (OEKC); Dan BrickleySubject: Re: AGRIS Journals and UDC URIs/ checking

Aida, Stefano,…..Of course the first hints re. URIs is to keep it short. www.udcc.org/udcclass_631.1/50900 seems a bit long.Then it might be interesting to use "class" somewhere, if you're going to release entities with a different type one day.

On the most difficult issue, class numbers vs. DB identifiers. Probably you will have to create both, if you want to intercept these cases where concepts have changed class number.…………

https://faohqmail.fao.org/owa/redir.aspx?C=44c85a924a5348e790f846326fdcac97&URL=mailto:[email protected]

https://faohqmail.fao.org/owa/redir.aspx?C=44c85a924a5348e790f846326fdcac97&URL=http://www.udcc.org/udcclass_631.1/50900


RING

routemap to information nodes

and gateways

ToolsLOD

enabled software

VocBench

concepts and entities reference triples

LOD Generator

triplifier, concept and entity

identifier

Data Services

Webservices + APIs to triple stores

Cloudstorage for RDF

data triples

agINFRA - the elements


….views into the construction site

VocBench AGROVOC LOD on VocBench 1.1

LOD Generator Do you know openCalais? AgroTagger Testing Site LODE-BD

The RING: http://ring.ciard.net Tools

AgriDrupal AgriOceanDspace : http://193.190.8.15/agri3/

http://ring.ciard.net/

https://faohqmail.fao.org/owa/redir.aspx?C=44c85a924a5348e790f846326fdcac97&URL=http://193.190.8.15/agri3/

Thank You!http://www.ciard.nethttp://ring.ciard.nethttp://aims.fao.orghttp://agris.fao.org

http://www.ciard.net/

http://ring.ciard.net/

http://aims.fao.org/

http://agris.fao.org/

AGROVOC


AGROVOC A multilingual agricultural vocabulary

organized as concept scheme in 20 languages

Covers agriculture, forestry, fisheries and related themes (food security, land use, environment, etc.)

Organized in sub-vocabularies, e.g. chemicals, fisheries terms, scientific/common names of organisms

Maintained by a global community (e.g. librarians, terminologists, information managers) using VocBench


AGROVOC - Statistics Total terms 580,239 Concepts ca. 40,000Top concepts 25English concepts / terms ca. 32,000 concepts / 40,737

termsFrench terms 38,395Spanish terms 41,745Terms in Arabic, Chinese, Czech, German, Hindi, Hungarian, Italian, Japanese, Korean, Lao, Persian (Farsi), Polish, Portuguese, Russian, Slovak, Thai

456,952


AGROVOC - Restructuring Goal: Transform AGROVOC from a traditional

thesaurus into a concept scheme with distinction between conceptual level and terminological level

Overall revision done by FAO in collaboration with KSI (Knowledge Sharing and Innovation) team at ICRISAT, Hyderabad, India

Top concepts reduced from 918 to 25 Around 85,000 term relations revised Non-hierarchical relationships refined by semantic

relations Ca. 4,000 non-preferred terms changed to

preferred terms


Top concepts


Relationships (examples)






AGROVOC

EUROVOC

RAMEAU

LCSH

NALT

GEMET

STW

18000 outlinks

2000 inlinks

Thesauri into the AGROVOC LOD Cloud


AGROVOC Links after 3 weeks LOD

Outlinks:

GEMET-AGROVOC 1,198

RAMEAU-AGROVOC :700

Total Outlinks: 1898

Inlinks:

AGROVOC-EUROVOC:1,297

AGROVOC-GEMET:1,198

AGROVOC-LCSH :1,093

AGROVOC-NAL: 13,390

AGROVOC-STW:1136

AGROVOC-RAMEAU:700

Total Inlinks:18,814


The VocBench


The VocBench VocBench

concepts and entities triples


VocBench Features Domain independentStructure independent (i.e. thesauri, Glossaries,

etc)Supports RDF (SKOS, SKOS-XL), OWLSupports collaborative editing Supports editorial workflow, with user roles Simple and advanced search Supports data export: SKOS, Relational format

(MySQL)



LODE - BD


..what it means Guidelines how to produce data that

easily can be transformed into LOD


LODE-BD Recommendations 1.1.

What entities and relationships?

What properties?


And….

What metadata terms?

dcdcterms

biboaglsags

eprintmarcrel

What metadata standards?


Decision TreesSubject


AgroTaggerAndOpenCalais



• Does Concept identification in unstructured texts

• Uses Agrovoc as a controlled vocabulary

• Prototype under testing with excellent results (entire repository of ICARDA indexed)

• Will produce in future Structured RDF files that can be used to link data like “open Calais”

•

AgroTagger





AgriDrupalAndAgriOceanDSpaceAnd other tools


TOOLS ToolsLOD

enabled software


The R.I.N.G


RING - Charts and numbers


RING – Numbers

Number of documents potentially reachable through the services registered in the RING.

Types of service considered: document repositories and bibliographic databases.

http://ring.ciard.net/totals

http://ring.ciard.net/totals


RING – latest enhancements A Tutorials section has been started on the RING

website, including for the moment a tutorial on OAI-PMH and a tutorial on how to consume feeds with Drupal: http://ring.ciard.net/tutorials

RDF The RING is now available as a triple store: RDF

representations of nodes can be obtained by adding a suffix to the node ID and the whole store can be queried using a SPARQL endpoint.

Improvements have to be made to implement URIs in a coherent manner and to refer to external URIs.

http://ring.ciard.net/tutorials