Digitization Workflow Management System for Massive Digitization Projects

  • View
    30

  • Download
    2

Embed Size (px)

DESCRIPTION

Digitization Workflow Management System for Massive Digitization Projects. The 2 nd International Conference on Universal Digital Library 2006 (ICUDL 2006) Mohamed Yakout Noha Adly Magdy Nagi mohamed.yakout@bibalex.org noha.adly@bibalex.org magdy.nagi@bibalex.org. - PowerPoint PPT Presentation

Text of Digitization Workflow Management System for Massive Digitization Projects

  • Digitization Workflow Management System for Massive Digitization ProjectsBibliotheca Alexandrina

    November 19, 2006The 2nd International Conference on Universal Digital Library 2006 (ICUDL 2006)

    Mohamed Yakout Noha Adly Magdy Nagimohamed.yakout@bibalex.org noha.adly@bibalex.org magdy.nagi@bibalex.org

  • GoalsAutomate, track and manage the digitization workflow.Flexibility in defining digitization workflow Phases.Support dynamic evolution and deviations with a history tracking.Flexibility integration with the LIS and Library Digital Repository.Accept external partially digitized Jobs to start in the proper Phase within the digitization workflow Simultaneous management of multiple projects with a diversity of materials (books, journals, manuscripts, audio, video, slides, etc)

  • Related WorkManual workflow management using several software packages (MS Excel, MS SharePoint, MS Project)Simple tracking workflow system with limited capabilitiesSeveral integrated digitization activities (digital capturing, image processing, OCRing, ) in one softwareDOCWorks from CCS.BookRestorer from i2s.OUPSLimitations:Tightly coupled with certain tools and do not allow easily other tools to be integrated.No Resources Management (e.g. Workstations and users)Lack of projects and collections management. Manual files handling between the storage server and clients.Lack of handling workflow exceptions, dynamic evolution and deviations except through manual intervention.

  • System Data Model

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelThe object being digitized Book for Naguib MahfouzPhotos for an eventMap for AlexandriaMusic sheet for Omar Khayrat

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelAll types of materials in the systemBookManuscriptsMapJournalsAudioVideo

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelA task that should be applied within the digitization process ScanningProcessingOCRingEncodingPublishingZipping for archiving

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelThe system users with several rolesDigital lab operatorsShift operatorsAdministrator

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelRepresents logical grouping for the JobsNasserAlexMedAMEEL

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Data ModelThe computer used to perform the Phase

    text

    Phase

    Job

    Job Type

    Collection

    Workstation

    User

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System HandlersXML Phases Definition HandlerPre-Phase and Post-PhasePhysical sectionDatabase sectionReflection Call

    . .

    . .

  • System HandlersXML Phases Definition HandlerPre-Phase and Post-PhasePhysical sectionDatabase sectionReflection Call

    . .

    . .

  • System HandlersXML Phases Definition HandlerPre-Phase and Post-PhasePhysical sectionDatabase sectionReflection Call

    . .

    . .

  • System HandlersXML Phases Definition HandlerPre-Phase and Post-PhasePhysical sectionDatabase sectionReflection Call

    . .

    . .

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Type A

    Phase A1

    Phase A2

    Phase AN

    Phase B1

    Phase B2

    Phase BN

    XML Phases Definition Handler

    File Handler

    Database Handler

    DAF

    DatabaseStored Procedures

    LIS Server

    LIS

    File Server

    Authentication and Authorization Handler

    ReportingModule

    Check-InModule

    Phase Manager

    Administration Module

    Check-OutToDigital Documents Repository

    Archiving Module

    Off-line Storage

  • System ModulesCheck-InPlug-in based for integration.Creates the Job in the systemAssign the Job to any Phase

    Check-OutJava Reflection Call section of the XML Phases DefinitionIngest the Jobs digital objects into the repository

    Cluster

    Data

    DWMS

    VirtuaPlug-in

    MODS FilePlug-in

    MARC FilePlug-in

    DigiArabPlug-in

    Check-in Plug-in

    ....

    DAR

    Check-out Plug-ins

    DARPlug-in

    FedoraPlug-in

    DSpacePlug-in

    ....

    aDORePlug-in

    Fedora

    DSpace

    aDORe

  • System Architecture

    Cluster

    Data

    Phase C1

    Phase C2

    Phase CN

    Jobs in the System

    PrePhase CX

    PostPhase CX

    Phase CX

    Phase CX

    Job Type C

    Job Type B

    Job Typ