MUSCLE WP9 E-Team

Integration of structural and semantic models for multimedia metadata

management

Aims: •(Semi-)automatic MM metadata specification process•Information extraction techniques•Intelligent approaches•Semantic Web and multimedia content analysis•Multimedia data indexing

Participants: BILKENT, CEA, CNR, IBAI

E-Team “Integration of structural and semantic models for multimedia metadata management”

Partners Contributions

BILKENT video database system

CEA LIST Text analysis and XML metadata extraction and collection

CNR-ISTI design and development of an Infrastructure forMultiMedia Metadata Management (4M) for MUSCLE integration

IBAI data preparation of web log files

Study, design and implementation of anStudy, design and implementation of an

Infrastructure forInfrastructure for MultiMedia MetaData MultiMedia MetaData ManagementManagement

- 4M -- 4M -

E-Team “Integration of structural and semantic models for multimedia metadata management”

Multimedia Metadata

 

Background• Multimedia data coming from different fields• Metadata production, storing, retrieve,

elaboration

Key tools: • MPEG-7 provides detailed and multimedia specific

metadata descriptors.

• Semantic Web technologies (RDF, OWL, etc), promoted by the W3C, enable large scale interoperability of structured knowledge repositories.

 

RDF

4M Infrastructure

XML DB

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

Annotations A

network

4M Infrastructure

BILKENT•XML metadata (video annotation; salient object extraction from video key frames; spatio-temporal, semantic and low-level features on video data)

•Direct links to local resources (e.g., BilVideo)

XML DB

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

Annotations A

network

4M Infrastructure

XML DB

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

Annotations A CEA•XML metadata (text analysis)

•Web-Searching (XML DB)

network

4M Infrastructure

XML DB

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

Annotations A

CNR•System software•Database development•Features extraction from audio/images•Ontology for image analysis

network

4M Infrastructure

XML DB

AlgorithmsOntology

Integration

X

O

<?xml version=“1.0” ?><mpeg-7>. . .</mpeg-7>

MPEG-7feature

processing

M

I

Annotations A

network

IBAI•XML metadata (semantic transformation of Log Files, features discretization)

•Web Server interaction