32
Digital Restoration Using high-res 3D: MARCO CALLIERI

Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Digital Restoration

Using high-res 3D:

MARCO CALLIERI

Page 2: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

[digital] Anastylosis / Restoration

When working on digital 3D mdoels, there is oftenconfusion between the two…

Digital anastylosis:

Placement of digital models of fragments in the correct position in space, to obtaint he original shape of an artefact

Digital restoration:

Actual modification of sampled 3D data to recreate the originalappearance/structure/functionality of an artefact

Page 3: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Pietranico’s Madonna

Page 4: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Pietranico’s Madonna

Page 5: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Problems / drawbacks

3D measured data is a SCIENTIFIC data, modify it has to be done in a SCIENTIFIC, ARTISTIC and HISTORICAL correct way

Keep close to original data

Keep an expert at an arm’s length

But, remember that what happens in the digital world, remains in the digital world…

Page 6: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

D I G I T I Z E

S C U L P T

V I S U A L I Z E

An Helm in a Tomb

Page 7: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Background

Didactic video describing a now-lost Aetruscan tomb, to be used in museum

3D scanning of remaining artefacts

3D Modelling of missing objects and environment, based on archaeological data

The helm…

Page 8: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

3D assets

Page 9: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

3D assets

Page 10: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

3D model - Helm

3D scanned (0.5mm), color mapped from photos

Page 11: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Virtual Restoration

The Helm is the most iconic piece of the tomb, in order to appreciate its importance we wanted to show it as it WAS…

Symmetry (global and local scale)

Drawings/annotations of archeologists, work done under the supervision of an archeologist

Analogies with similar

Measured data

Page 12: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Straightening

Restore global symmetry,

Bridge the gap

Rough filling of the missing area for latersculpting

Page 13: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Sculpting

“digital sculpting” on the high-resolution model using a specifc tool(Zbrush).

Smoothing of oxidizedareas.

Bring out details of the decoration.

Completely missing areasfilled by copy-past of simmetric parts.

Page 14: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Virutal restoration

The change is indeed impressive, and may appear too extreme

BUT

It is still based on the principle of minimum intervention, relyon the direct use of the sampled data, is based on comparisonwith similar artefacts, follows the excavation and archivalinfo/drawings of the helm, and has been guided by experts

Page 15: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Risultati

Page 16: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Rendering

For the video, we rendered the helm using a gold shader(the bronze was originally gilded), using placeholders for the totally missing elements (plume and cheekpieces)…

Page 17: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Rednering

Page 18: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Interactive 3D online

Before-after state, high-res geometry (5+5 millions of triangles), with bookmarks.

Page 19: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

D I G I T I Z E

R E C O N S T R U C T

PA I N T

Bringing back the color

Page 20: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

The Luni statues

A series of terracotta statue from the pediment of the Great Temple of Luni. We have the 3D models for the full group, and one of the things we tried on it was to repaint them

Page 21: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Surface Painting

There is a description of the original color (at the time of the excavation), and a 3D model can be “painted”… but where to get the color information?

Page 22: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

From example…

Extract color and its variations from calibrated photos.

Yes, it is not colorimetric, but it is almost impossible to get

a clear measure out of

these spots…

Page 23: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Surface Painting

Page 24: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Pietranico’s Madonna

Years later, we did a similar test on a different object…

We had better 3D mdoel, better painting tools, we tried perfecting the way we measured/painted color

Page 25: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Pietranico’s Madonna

Texture synthesis based on cropped photos of the residual color areas

Page 26: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Pietranico’s Madonna

Page 27: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Ulpia Domina Sarcophagus

Recently, we tried again (yes, we are stubborn), but with a more scientific orientation towards the identification of pigments and paints.

Page 28: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Ulpia Domina Sarcophagus

A series of studies carried out to determine layers of paint, pigments used, colors and patterns

Calibrated photos

Microphotography

Micro-section stratigraphy

Chemical analysis

Near-visible lighting

Page 29: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Ulpia Domina Sarcophagus

Page 30: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Ulpia Domina Sarcophagus

In Blender, we tried describing the layering of paints using a specific material for each paint, and a shader cascade (to simulate the superimposition of paints)…

it works, as a proof of concept, but we still need a measured physically-based shader for each paint

Page 31: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

Layering

The different layers of paint, visualized oneafter another, for an area of the sarcophagus

Page 32: Digital Restoration - CNRvcg.isti.cnr.it/.../Slides_2016/10c_restoration.pdf · 2016-04-27 · [digital] Anastylosis / Restoration When working on digital 3D mdoels, there is often

T H A N K S F O R Y O U R AT T E N T I O N …

Question Time

? ! ??? ! ?? !

[email protected]