119
Under the hood Richard Wallis Talis @rjw Linked Data #talisldod

Linked Data Under the Hood

Embed Size (px)

DESCRIPTION

Presented at the Talis Linked Data Open Day in San Francisco on 1st June 2011 by Richard Wallis

Citation preview

Page 1: Linked Data Under the Hood

Under the hoodRichard WallisTalis@rjw

Linked Data

#talisldod

Page 2: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 3: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 4: Linked Data Under the Hood

Identifying things

Page 5: Linked Data Under the Hood

Identifying things

Page 6: Linked Data Under the Hood

Identifying things

1969-059A

Page 7: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

1969-059A

Page 8: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

Page 9: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

Page 10: Linked Data Under the Hood

Identifying things

spacecraft/1969-059A

nasa.dataincubator.org/spacecraft/1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

1969-059A

with URIs

Page 11: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 12: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Page 13: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Columbia

Page 14: Linked Data Under the Hood

Things have attributeshttp://nasa.dataincubator.org/spacecraft/1969-059A

28801.0kg

Columbia

Apollo 11 CSM

CSM-107

United States

Cape Canaveral

Saturn 5

Page 15: Linked Data Under the Hood

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 16: Linked Data Under the Hood

.../1969-059A

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 17: Linked Data Under the Hood

.../1969-059Ahttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 18: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 19: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

Apollo 11 CSM⤵name

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 20: Linked Data Under the Hood

.../1969-059A

⤵mass

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 21: Linked Data Under the Hood

.../1969-059A

⤵⤵

mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launchhttp://nasa.dataincubator.org/spacecraft/1969-059A

Page 22: Linked Data Under the Hood

.../1969-059A

⤵⤵

mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 23: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 24: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

N 28° 27' 31''⤵lat

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 25: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 26: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site<../1969-059A> mass 28801.0 .<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” .<../1969-059A> launch <../launch/1969-059> .<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> .<..site/capecanaveral> lat “N 28° 27' 31''” .<..site/capecanaveral> long “W 80° 31' 59''” .

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 27: Linked Data Under the Hood

.../1969-059A

⤵Cape

Canaveral

⤵mass

../launch:1969-059

28801.0

Apollo 11 CSM⤵ Columbia⤵name name

launch

16 July 1969⤵date

⤵site<../1969-059A> mass 28801.0 .<../1969-059A> name “Apollo 11 CSM” .<../1969-059A> name “Columbia” .<../1969-059A> launch <../launch/1969-059> .<../launch/1969-059> date 1969-07-16 .<../launch/1969-059> site <..site/capecanaveral> .<..site/capecanaveral> lat “N 28° 27' 31''” .<..site/capecanaveral> long “W 80° 31' 59''” .

RDF

N 28° 27' 31''

W 80° 31' 59''

⤵⤵lat

long

http://nasa.dataincubator.org/spacecraft/1969-059A

Page 28: Linked Data Under the Hood
Page 29: Linked Data Under the Hood
Page 30: Linked Data Under the Hood

RDF Triple

Page 31: Linked Data Under the Hood

RDF Triple

Thing attribute value

Page 32: Linked Data Under the Hood

RDF Triple

Thing valueproperty

Page 33: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

Page 34: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/A

Page 35: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/A hasParent

Page 36: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B../person/A hasParent

Page 37: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B

../person/B

../person/A hasParent

Page 38: Linked Data Under the Hood

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Page 39: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Page 40: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

../person/B

name../person/B

../person/A hasParent

Merging

Page 41: Linked Data Under the Hood

“Eric”

RDF Triple

Thing value

Thing property Thing

property

name../person/B../person/A hasParent

Merging

Page 42: Linked Data Under the Hood

RDF TripleMerging

Page 43: Linked Data Under the Hood

RDF TripleMerging

The same identifier in a different place is still the same thing

Page 44: Linked Data Under the Hood
Page 45: Linked Data Under the Hood

A Property is a Thing too!

Page 46: Linked Data Under the Hood

A Property is a Thing too!

name

Page 47: Linked Data Under the Hood

A Property is a Thing too!

name

http://xmlns.com/foaf/0.1/name

Page 48: Linked Data Under the Hood

A Property is a Thing too!

name

foaf:name

http://xmlns.com/foaf/0.1/name

Page 49: Linked Data Under the Hood

A Property is a Thing too!

name

foaf:name

http://xmlns.com/foaf/0.1/name

“Eric”foaf:name../person/B

Page 50: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Page 51: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Page 52: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API

Page 53: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

Page 54: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

All different!

Page 55: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

The key to access Linked Data

All different!

Page 56: Linked Data Under the Hood

http://www.flickr.com/photos/jwilde/3499946512

Opening up access to data

Data API}All have APIs

Web StandardsThe key to access

Linked Data

All different!

Page 57: Linked Data Under the Hood

Web Standards

Page 58: Linked Data Under the Hood

The power of the link

Page 59: Linked Data Under the Hood

The power of the link

Page 60: Linked Data Under the Hood

The power of the link

Page 61: Linked Data Under the Hood

The power of the link

Page 62: Linked Data Under the Hood

The power of the link

Page 63: Linked Data Under the Hood

The power of the link

Page 64: Linked Data Under the Hood

The power of the link

Page 65: Linked Data Under the Hood

The power of the link

Page 66: Linked Data Under the Hood
Page 67: Linked Data Under the Hood

RDF in many forms

Page 68: Linked Data Under the Hood

RDF in many forms

• RDF/XML

Page 69: Linked Data Under the Hood

RDF in many forms

• RDF/XML Machine to machine

Page 70: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

Machine to machine

Page 71: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

Machine to machine

Processing

Page 72: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

Machine to machine

Processing

Page 73: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

Machine to machine

Processing

Human readable

Page 74: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Page 75: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Html embedded

Page 76: Linked Data Under the Hood

RDF in many forms

• RDF/XML

• N-Triples

• Turtle

• RDFa

Machine to machine

Processing

Human readable

Html embedded

All valid RDFCape Canaveral

../launch:1969-059

16 July 1969⤵date

⤵site

Page 77: Linked Data Under the Hood

RDF creation

Page 78: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

Page 79: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

Page 80: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

Page 81: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

Page 82: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

Page 83: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

- Facet analysis

Page 84: Linked Data Under the Hood

RDF creation

• Database / spreadsheet export

- Script/program convert

• Pull content from sites

- Content-negotiation to RDF/XML

• Google Refine

- Facet analysis

- Reconciliation API

Page 85: Linked Data Under the Hood

Modelling aids

Page 86: Linked Data Under the Hood

Modelling aids

• prefix.cc

Page 87: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

Page 88: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

Page 89: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

Page 90: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

Page 91: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

Page 92: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

• Kasabi

Page 93: Linked Data Under the Hood

Modelling aids

• prefix.cc

- namespace lookup

• schemapedia.com

- vocabulary search

• sindice.com ckan.net LOD Diagram

- identify data sets to link with

• Kasabi

- Linked Data Marketplace

Page 94: Linked Data Under the Hood

The process

Page 95: Linked Data Under the Hood

The process

Model

Page 96: Linked Data Under the Hood

The process

NameModel

Page 97: Linked Data Under the Hood

The process

DescribeNameModel

Page 98: Linked Data Under the Hood

The process

ConvertDescribeNameModel

Page 99: Linked Data Under the Hood

Publish

The process

ConvertDescribeNameModel

Page 100: Linked Data Under the Hood

SPARQL

Page 101: Linked Data Under the Hood

RDF Query LanguageSPARQL

Page 102: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

Page 103: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

Page 104: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

Page 105: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

Page 106: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

Page 107: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

- Hosted

Page 108: Linked Data Under the Hood

RDF Query LanguageSPARQL

• Triple pattern matching

- uses Turtle

• Requires a SPARQL-endpoint

• Backed by a Triple Store

- Local hosted

- Hosted

- Managed Service - Talis

Page 109: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Page 110: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs

Page 111: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

Page 112: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

Page 113: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

Page 114: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API

Page 115: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

Page 116: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

Page 117: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

Page 118: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

• SPARQL endpoints for query

Page 119: Linked Data Under the Hood

http://www.flickr.com/photos/ferretsunlimited/499495786

Linked Data

Identifying Things with URIs• Things have attributes/properties

- Properties are Things too!

• URIs Merge - wherever

• Linked Data is the API- Web Standards - http, RDF, ...

• Many open data/tools

• Model➞Name➞Describe➞Convert➞Publish

• SPARQL endpoints for query

• Managed Hosting