Digital Archive. Bojan Kosi, Mediateka

Mediateka

Digital archive

Bojan Kosi

01. 05. 2023 Mediateka RTV Slovenija

RTV Slovenia

2

• three national radio channels

• three national TV channels

• radio and TV channels for the Italian and Hungarian minorities

• radio and TV channels for Slovenian minorities in Italy and Hungary

• radio an TV programmes for Romany community

• radio channel for foreign audience

• teletext, internet and mobile

• symphony orchestra, big band, choirs

• label company


Archive in 2012

3

carriers/meters hours % hours1 2 3 4=(2*3)

Audio tape Rtv Slo 200.000 150.000 100 % 150.000 CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000 DAT Rtv Slo 10.000 15.000 100 % 15.000 files Rtv Slo 80.000 50.000 100 % 50.000

Total 360.000 270.000 248.000

Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850 Videotape Digital Betacam Rtv Slo 620 720 100 % 720 Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800 DVC Pro Rtv Slo 2.380 4.500 100 % 4.500 Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300

Total 88.000 121.120 102.170

Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700 Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500 Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900

Total 26.830.000 39.100 39.100

for digitization

Video

Audio

Media type Carrier type ProductionArchive content

Film

01. 05. 2023

Mediateka - Digital archive

4Mediateka RTV Slovenija

Management and development:- workflow management and system development

Ingest:- digitizing, ingesting and archiving

Catalogue:- virtual segmentation and metadata annotating

Restoration:- physical carrier restoration

01. 05. 2023

MediatekaDigital archive

Physical archives

Production systems

New relations

5Mediateka RTV Slovenija

Archive system(Ingest & MAM & storage)

Ljubljana

Koper Ljubljana Maribor Lendavaolddatabase

Koper

migration ingest ingestingestingest

exchange

Lendava

exchangeexchange

Maribor

01. 05. 2023 Mediateka RTV Slovenija 6

Archive MAMdiffers from

production MAM.


… and workflows are the key solution…

7


Workflows are the key solution…

8

Usually over 3.000 flows are managed simultaneously from Archive MAM:

• digitizing / ingesting contents from physical carriers

• daily created digital content ingesting,

• cataloguing

• ordering and distribution

• meta data extraction

• informing the users


Audio


Audio digitization project… DONE!

10

• 2002-2004 Searching the solution, preparing the project

• 2005 Ingest system tender

• 2006 Archive MAM system tender

• 2007 Configuring and testing the system and workflows

• 2008-2014 Massive digitization phase

carriers hours % hours1 2 3 4=(2*3)

Audio tape Rtv Slo 200.000 150.000 100 % 150.000 CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000 DAT Rtv Slo 10.000 15.000 100 % 15.000 files Rtv Slo 80.000 50.000 100 % 50.000

Total 360.000 270.000 248.000

for digitization

Audio



Videotape


Videotape digitization project

12

• 2013 Searching the solution, preparing the project

• 2014 Ingest & MAM system upgrade

• 2015 Configuring and testing the workflows

• 2015-2021 Massive digitization phase

carriers hours % hours1 2 3 4=(2*3)

Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850 Videotape Digital Betacam Rtv Slo 620 720 100 % 720 Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800 DVC Pro Rtv Slo 2.380 4.500 100 % 4.500 Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300

Total 88.000 121.120 102.170

for digitization

Video


Videotape – general flow

01. 05. 2023 13Mediateka RTV Slovenija

Mediateka – Digital archiveTV archive

Cleaning &

checking

Selecting &

preparing tapes

QC

Virtual segmentation

& Cataloguing

Digitizing &

Ingesting


Videotape – Ingest

14


Videotape – Ingest flow

15


Videotape – Long term archive format… FFV1

16

• open source and available under GNU LGPL,

• hardware independent,

• able to support the 4:3, 16:9 and other picture format,

• able to support SD, HD, 2K and other resolutions,

• able to map all current colorspaces, including subsampling options,

• mathematically lossless (when encoding),

• playable with standard player, without extra payable decoders

• …


Ingest & MAM & storage

17


Film


Film restoration & digitization project

19

• 2013 Searching the solution, preparing the project

• 2014 Film scanner tender, Ingest & MAM system

upgrade

• 2015 Configuring and testing the workflows

• 2015-2040 Restoration & digitization phase (25 years)

Estimated labour cost: 7.000.000 EUR (~180 EUR per hour)

meters hours % hours1 2 3 4=(2*3)

Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700 Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500 Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900

Total 26.830.000 39.100 39.100

for digitization

Film



Film

20


Film – Vinegar syndrom

21

Film – general flow


MediatekaTV Arhiv

Restoration & cleaning

(film)

Restoration(perfo)

Selecting &

preparing the

material

Digitization (film)

Cataloguing

Picture QC

Digitization(perfo)

Audio QC


Film – restoration

23


Film – restoration & jumbo role

24


Film – jumbo role

25


Film –jumbo role

26


Film – jumbo role types

27


Film – jumbo role types

28

B&W films

ORIGINALS1 REVERSAL - MUTE2 REVERSAL - SEPMAG3 REVERSAL - COMMAG rare4 NEGATIVE - MUTE5 NEGATIVE - SEPMAG rare

PRINTS6 PRINTS - MUTE7 PRINTS - COMOPT8 PRINTS - SEPMAG9 PRINTS - COMMAG rare

PERFORATED MAGNETIC TAPES

COLOR films

ORIGINALS1 REVERSAL - MUTE2 REVERSAL - SEPMAG3 REVERSAL - COMMAG rare4 NEGATIVE - MUTE5 NEGATIVE - SEPMAG rare

PRINTS6 PRINTS - MUTE7 PRINTS - COMOPT8 PRINTS - SEPMAG9 PRINTS - COMMAG rare

PRINTS (ORANGE MASK)10 PRINTS - MUTE12 PRINTS - SEPMAG


Film – scanning

29

• DPX

• 2K

• 10bit log

• QC

• segmentation (EDL)

• making TAR packages (automated)

• no digital restoration

• no color correction (no grading)


Film – file ingest flow (MAM)

30

• extracting DPX from TAR package

• checking timecode and frame number

• encoding mezzanine video & merging audio

• analysing & keyframes

• Human QC

• Encoding FFV1 & proxy

• Sending to the storage (DPX & FFV1 & proxy)


Film – MediaFormats example

31


Storage (audio & video & film)

32

• HSM (online – nearline – offline)

• LTO6, up to 30 PB in 25 years


Access

33

Metadata objects

Serie

Programme


Project

Playout slot

Schedule

Carrier

Playout slot

Spored

Entity

Entity

Avtor

Izvajalec

Contract

Data & Analytics

Digital Archive. Bojan Kosi, Mediateka