20
Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES Networking Session 2015 19 th October 2015

Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

Discovering relationships

between artefacts using 3D

and semantic data

Stephen C. Phillips

IT Innovation Centre

RICHES Networking Session 2015

19th October 2015

Page 2: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

https://www.flickr.com/photos/lunamodule/

Page 3: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Page 4: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Page 5: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Page 6: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Front Back

Faded

Cracked

Eroded

Page 7: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

British Museum Cyprus Museum

Ashmolean Museum Fitzwilliam Museum

Page 8: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Jigsaw

in 3D

most pieces missing

all the edges worn off

many puzzles jumbled together

pieces spread across many countries

Page 9: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Re-Assembly

Re-Unification

Re-Association

Page 10: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Re-Assemblyyou have some (eroded) pieces

the computer fits them together

Hard!

Re-Unification

Re-Association

Page 11: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Re-Unification

Head in the British

Museum

Statue in the Cyprus

Museum

Page 12: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

Re-unify 3D models of the

statue

3D print copies for re-

unification

Re-unify statue in virtual tour

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Re-Unification

Page 13: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

Re-Association

Semantic Description

Material, decoration, size, shape, period, style, glaze,

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Data in another museum catalogue

Page 14: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

Re-Association

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Page 15: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

How?

Page 16: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Geometric data, material data

Point cloud, mesh

Photos

Shape, geometry reassembly

Curvature

Colour(s) UV light, pigments

Pattern

Texture markings front & back

manufacturing methods

Chemical composition x-ray fluorescence

Microscopic composition clay matrix, porosity

Page 17: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Semantic data, natural language data

CIDOC-CRM (“conceptual reference model”)

ISO 21127:2006

Object type, place, date, material, style, people, institution,

bibliography, dimensions, school, production technique, …

Object hasNote “…lots of free-form text added by the

curator”

Natural Language Processing (NLP) required to extract further

information

The CRM harmonises knowledge to support discovery and

enables knowledge collaboration

The British Museum has 2.5M objects described in CRM

provides definitions and a formal structure for describing the

implicit and explicit concepts and relationships used in cultural

heritage documentation.

Page 18: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

And…

Search

Date

Colour

Size

Origin

Find similar

items

Page 19: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

Further work?

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015

Page 20: Discovering relationships between artefacts using 3D and ... · Discovering relationships between artefacts using 3D and semantic data Stephen C. Phillips IT Innovation Centre RICHES

GRAVITATE-PROJECT.EU

Stephen C Phillips

[email protected]

© Copyright University of Southampton IT Innovation Centre and other GRAVITATE partners, 2015