Quality Management of 3D Cultural Heritage Replicas with ......production of virtual models for dissemination • creation of 3D models for virtual restoration • 3D printed replicas

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

  • Quality Management of 3D Cultural Heritage Replicas

    with CIDOC-CRM Nicola Amico, Paola Ronzino, Achille Felicetti, Franco Niccolucci

  • • 3D models are increasingly used in Cultural Heritage, thanks to the diffusion of technologies like laser scanning and photogrammetry that make 3D model widely available methodology.

    • Nowadays it is being adopted for mass acquisition of artifacts and monuments, and 3D datasets are stored in an increasing number of openly accessible digital libraries.

    3D Digital Heritage

    e.g.: Europeana started to populate with 3D models of European art and to create tools for the creation of collections of digital replicas of cultural objects.

  • How can we verify the quality of a 3D model and its reliability?

    • Documentation is crucial to assess trustworthiness and suitability for purpose and thus enable re-use.

    CIDOC-CRM can help to this purpose?

    • This research proposes to use CIDOC-CRM and its extension CRMdig to document the planning and execution of 3D models of cultural artifacts in order to manage the quality of the replicas

    Project Aim

  • Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-Processing

    Laser Scanner Project Workflow

  • Aim Definition

    • Aim Definition: define the purpose of the digitization • modeling for cultural documentation

    • production of virtual models for dissemination

    • creation of 3D models for virtual restoration

    • 3D printed replicas for dissemination (e.g. museum exibitions) and for research purposes

    • The definition of the aim is strictly connected to the Technology Definition

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • Aim Definition

    Aim_DefinitionE65_Creation

    P94_has_createdAim_DescriptionE31_Document

    Digitization_Purpose_DefinitionE7_Activity

    P70i_is_documented_in

    Laser_Scanning_ProjectD28_Digital-Documentation_Project

    P9_consists_of

    P17i_motivated

    UserE39_Actor

    P11i_partecipated_in

    Purpose_TypeE55_Type

    P2_has_type

    Technology_DefinitionE7_Activity

    P15i_influenced

  • Location Survey • Location Survey concerns the inspection of

    • Environmental conditions • Lighting, temperature, presence of dust (indoor and outdoor) …

    • Object feature and size related to the surrounding scene • Location of monument or museum object (e.g. space available for scanning)

    • This stage will support • In defining best time to collect the data

    • In identifying the presence of high reflective surfaces, obstructions and obstacles that may voids artifacts

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • Location Survey

    Technology_DefinitionE7_Activity

    P15i_influenced

    Object_InspectionE65_Creation

    Location_SurveyE7_Activity

    P9_consists_of

    Laser_Scanning_ProjectD28_Digital-Documentation_Project

    P9_consists_of

    Condition_AssessmentE13_Attribute_Assignment

    P9_consists_of

    Site_Inspection_Documentation_Creation

    E65_Creation

    P9_consists_of

    Object_Inspection_DocumentationE31_Document

    P94_has_createdDocumentation_Type

    E55_TypeP2_has_type

    Assessment_TypeE55_TypeP2_has_type

    ConditionE3_Condition_State

    P141_assigned

    Site_LocationE53_Place

    P7_took_place_at

    Environmental_ReportE62_String

    P3_has_note

    Site_Inspection DocumentationE31_Document

    P94_has_createdDocumentation_Type

    E55_TypeP2_has_type

    SceneE19_Physical_Object

    P54_has_current_permanent_location

    P44_has_conditon

    Condition_TypeE55_Type

    P2_has_type

    P70_is_documented_in

    SceneE19_Physical_Object

    P46_is_composed_of

  • Repository Creation

    • Repository design and creation: design the repository according to the project needs • The project may use an existing repository, if the work concerns models added to a

    previously existing one

    • Define correct file formats in order to save space and to guarantee interoperability

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • Repository_CreationE65_Creation

    RepositoryD13_Digital_Information_Carrier

    Laser_Scanning_ProjectD28_Digital_Documentation_Project

    P9_consists_of

    Digital_ModelD15_Repository_Object

    P2_has_type

    L19_stores

    P94_has_created

    Object_TypeFormat_TypePurpose_TypeE55_Type

    P2_has_type

    Repository TypeE55_Type

    Repository Creation

  • Technology Definition

    • The Technology Definition step concerns • Device features according to the location survey outcomes

    • Environment

    • Object material

    • Object shape

    • Object size

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • Location_SurveyE7_Activity

    P15i_influenced

    Digital_Camera_DefinitionE7_Activity

    Technology_DefinitionE7_Activity

    P9_consists_of

    Laser_Scanning_ProjectD28_Digital-Documentation_Project

    P9_consists_of

    Other_Device_DefinitionE7_Activity

    P9_consists_of

    3D_Scanner_DefinitionE7_Activity

    P9_consists_of

    Data_Capture_DesigningE65_Creation

    P20_had_specific_purpose

    Scanning_Process_DefinitionE7_Activity

    P9_consists_of

    Digitization_PlanE29_Design_or_Procedure

    P94_has_created

    Technology Definition

  • Field Operations

    • The Field Operation step defines • Device features according to the

    location survey outcomes and to the object/scene to be scanned (FOV, level of detail)

    • Number of scan position (orientation angle)

    • Number and position of targets

    • Total station and GPS

    • Internal/external camera

    • Set-up of lighting system (e.g. caves, museums)

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • Scanner Settings

    3D_Scanner_SettingsD1_Digital_Object

    3D_Data_CaptureD7_Digital_Machine_Event

    L13_used_parameters3D_Scanner_DefinitionE7_Activity

    P20_had_specific_purpose

    3D_ScannerD8_Digital_DeviceL12_happened_on_device

    3D_Scanner_TypeE55_Type

    P2_has_type

    3D_Scanner_Settings_ValuesE54_Dimension

    P43_has_dimension

    3D_Scanner_Setting_TypeE55_Type

    3D_Scanner_Setting_UnitE58_Measurement_Unit

    3D_Scanner_Setting_ValueE60_Number

    P2_has_type

    P91_has_unit

    P90_has_value

  • RGB Capture

    Camera_SettingsD1_Digital_Object

    RGB_CaptureD7_Digital_Machine_Event

    L13_used_parameters

    Digital_Camera_DefinitionE7_Activity

    P20_had_specific_purpose

    Digital_CameraD8_Digital_DeviceL12_happened_on_device

    Camera_TypeE55_Type

    LensesE22_Man-Made_Object

    P2_has_type

    P46_is_composed_of

    Camera_TypeE55_Type

    P2_has_type

    Camera_Settings_ValuesE54_Dimension

    P43_has_dimension

    Camera_Setting_TypeE55_Type

    Camera_Setting_UnitE58_Measurement_Unit

    Camera_Setting_ValueE60_Number

    P2_has_type

    P91_has_unit

    P90_has_value

  • Field Operations

    Total Station

    Marker

    Laser Scanner

  • Field Operations

    Mark_DefinitionE7_Activity

    Field_OperationE7_Activity

    P9_consists_of

    Laser_scanning_ProjectD28_Digital_Documentation_Process

    P9_consists_of

    Mark_GeoreferencingE16_Measurement

    L12_happened_on_device

    Mark_CoordinatesE47_Spatial_Coordinates

    P39_measured

    Scanning_ProcedureE29_Design_or_Procedure

    P17_was_motivated_by

    3D_ScannerD8_Digital_Device

    Scanning_ExecutionD2_Digitization_Process

    P2_has_type

    P33i_was_used_by

    Mark_PositioningE9_Move

    P9_consists_of

    Scanner_FOVE55_Type

    P17_was_motivated_by

    MarkE19_Physical_Object

    P25_moved TypeE55_Type

    P2_has_type

    Mark_PositionE55_Type

    P25_moved

    P87i_identifies

  • 3D Data Registration

    • The 3D Data Registration consists of merging multiple scans with each other in correct, relative 3D geometry within a single coordinate system. It includes:

    • Scanner position

    • Ground Control Points (GCPs) or identifiable features

    • Pre-registration cleaning: remove noisy data, which could affect the final result.

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-Processing

  • 3D Data Registration

    Pre-Registration_Model_CleaningD3_Formal_Derivation

    Complete_RegistrationD7_Digital_Machine_Event

    P9_consists_of

    Laser_Scanning_ProjectD28_Digital_Documentation_Process

    P9_consists_of

    RegistrationD10_Software_Execution

    P9_consists_of

    Registration_TypeE55_Type

    ModelD15_Repository_Object

    P2_has_type

    L13_used_parameters

    Registration_ParametersD1_Digital_Object

    L11_had_output

    Cleaning_Parameters_ValuesE54_Dimension

    L13_used_parameters

    Cleaning_Setting_TypeE55_Type

    Cleaning_Setting_UnitE58_Measurement_Unit

    Cleaning_Setting_ValueE60_Number

    P2_has_type

    P91_has_unit

    P90_has_value

    L22_created_derivative

    L21_used_as_derivation_source

    L10_had_input

    Model_Cleaning_ParametersD1_Digital_Object

    P43_has_dimension

    Registration_Parameters_Values

    E54_Dimension

    Registration_Parameter_Type

    E55_Type

    Registration_Parameter_Unit

    E58_Measurement_Unit

    Registration_Parameter_Value

    E60_Number

    P2_has_type

    P91_has_unit

    P90_has_value

    P43_has_dimension

  • D15_Repository_Object

    Pre-Registration Model Cleaning

    D3_Formal Derivation

    Model Cleaning Parameters

    D1_Digital_Object

    • Cleaning vertices and faces on the boundary

    Cleaning Parameters Values

    E54_Dimension

    Cleaning Setting Type

    E55_Type

    • boundary

    Cleaning Setting Unit

    E58_Measurement Unit

    • faces or vertices

    Cleaning Setting Value

    E60_Number

    • 2

    Pre-Registration Cleaning

    L3_used_parameters P43_has_dimension

    P2_has_type

    P91_has_unit

    P90_has_value

    L21_used_as_ Derivation_source

    L22_created_derivative

  • 3D Dataset Post-Processing

    • The Post-Processing step includes • Polygonal mesh generation

    • Cleaning processes

    • Resampling and decimation

    Aim Definition

    Location Survey

    Repository Creation

    Technology Definition

    Field Operation

    3D Data Registration

    3D Data Post-

    Processing

  • 3D Dataset Post-Processing

    Post-processing_TypeE55_Type

    3D_Data_Post-processingD3_Formal_Derivation

    P2_has_type

    Laser_Scanning_ProjectD28_Digital_Documentation_Process

    P9_consists_of

    Post-processing_SoftwareD1_Digital_Object

    L22_created_derivative

    L13_used_parameters

    PP_Software_Parameter_ValuesE54_Dimension

    PP_Software_Parameter_TypeE55_Type

    PP_Software_Parameter_UnitE58_Measurement_Unit

    PP_Software_Parameter_ValueE60_Number

    P2_has_type

    P91_has_unit

    P90_has_value

    ModelD15_Repository_Object

    L23_used_software_or_firmware

    P43_has_dimensionPP_Software_Parameters

    D1_Digital_ObjectL21_used_as_derivation_source

  • Conclusions and Future Works

    • This research illustrates how CRM may support Quality Management of 3D Cultural Heritage documentation

    • It is being extended to other methodologies like photogrammetry/SfM,

    videogrammetry

    • It may need refinements and revisions dictated by practice

    • Implementation will need tools to simplify the input

    • The procedure is being tested within a 3D digital library project

  • ARIADNE is a project funded by the European Commission under the Community’s Seventh Framework Programme, contract no. FP7-INFRASTRUCTURES-2012-1-313193. The views and opinions expressed in this presentation are the sole responsibility of the authors and do not necessarily reflect

    the views of the European Commission.

    Thank you for your attention