Indexing of Multimedia Database

:

:

62.01.09

. ) (DBMS . . . query . . - shot based Motion based TV-tree R-tree... - .

:

..................................................................................................................................... ........................................................................................................................................... 3 ........................................................................................... 4 ....................................................................................................................... 6 .................................................................................................................. 6 11 ........................................................................................................................ R-Tree ................................................................................ 81 ................................................................................................................. 72 ....................................................................................................... 82 ................................................................................................................... 03 31 .................................................................................................... Motion-based 35 .................................................................... shot-based 36 ......................................................... ........shot ................................................................................................................................83 .......................................................... ......................................................... .......................83

1. . )(DBMS . . - . ) ( . : ) ( ) ( . .]1[ web . . ]8[. . query . . query .]2[ . query .]8[

2. . . . navigate browse - query . text-based : . . . . . " " . . . . . content-based .]1[ - . . : visual browsing

. .]2[

3. a the of . stop word . stop word . . Stemming retrieval retrieving retrieved retrieve retrieve . : school work learning study reading study .]1[

4. . . . . .

DBMS . . . query . / . . . : : - . query Boolean. query . . - . . . man child woman query human being . . . shape texture . :shape shape . shape .

shape : 1. shape ) ( . 2. Shape . shape. shape Counter- base .Region-base counter-base . Region-base shape shape . shape CBIR : 1. )(FD 2. )(GD

: . . 3 . RGB . m . n bin ) .(n=m 61 6904 bin . ) H(M ) (h1,h2,,hj,,hn hj

M bin j . . query . . . d I,H : =)d(I,H1

il hl bin L I H.

3 8*8 pixel 8 1 c 8 c . 8 8 7 1 c 4 c 9 5 c 8 c. 2 1 c 2 c 01 3 c 8 c. : )8,8,8,8,8,8,8,8(=1H )9,9,9,9,7,7,7,7(=2H )01,01,01,01,01,01,2,2(=3H :

8=1+1+1+1+1+1+1+1=)2d(H1,H 42=2+2+2+2+2+2+6+6=)3d(H1,H 02=1+1+1+1+3+3+5+5=)3d(H2,H

. : texture . . . texture - : 1. :Coarseness texture texture coarseness. coarseness . . 2. :Contrast . .a . .b .c .d 3. :Directionality -. shape . texture

. 4. :Line likeness shape texture. shape . 5. :Regularity . texture . shape .

6. : Roughness rough texture smooth . coarseness contrast . 6 texture . texture QBIC contrast coarseness directionality . . ]1[

. 1.4. R-Tree R-tree R*-tree R+-tree . R-tree ) ( . 2 . . ) R-tree :R-tree (R -+R

1.

tree ) tree( . . R-tree ) ( ) ( - )(

. ) ( )( . R+-tree R-Tree . 1 2 R-tree . R-tree ) ( . . R-tree . . . : . . R-tree .

)(a

)(b 1. R-tree

2. : . . ) (MBR . ) MBR ( MBR . )( MBR . . . . . )( . .

. . . MBR . MBR . . . 3. : )( K . . . K . R-tree . . . ) ( . ) (R-tree .

. ) (. 4. )( :R-tree R-tree . R-tree . R-tree . R-tree . . 21- r 1 1 R6 R5 R4 R3 R2 R 1 R 2 R . R-tree . . R-tree R-tree . 5. R-tree :VAMsplit R-tree R+tree R-tree R-tree .

R-tree . R-tree R-tree . R+-tree

R-tree . 1. R+-tree . 2. . 3. . . R-tree

1 2 . R-tree 1 1 R 2 R 7 R 11) r ( 21 r 11 r 5 R 7 R . R-tree . 21 r 2 R . R-tree R-tree ) ( .

2

6. S-tree :SS+-tree -* R+- R R-tree R-tree. R-tree . )SS-tree( SS+-Tree R-tree. )( SS-Tree . SS-Tree )( . . ss+-tree ss-tree .

SS+-tree . SS SS+-tree ]81 02[ . 1.1.4. ) TV-tree ( TV-tree R-tree . . ) . . . TV-tree . TV-tree . . . . TV-tree .]4[

2.4. . . query

. . . query . query . query

. . . .

query . . . . . . . . .

query . . 1.2.4. : query . : 1. . . . . 2. ... . .

. . : 1. . 2. . . SCM . . . . .

. - object . object - . . . . KLT . PGA KLT .

. . KLT . . PDF object . . object . . .

2.2.4. Photo Book

.

. . . 04 . . . . . . . 2 3 .

.a . 3 . . 3b-e . 3c . " " .3d: . 3e . . 4 .

3

4

eigenface . . 5 eigenface . . . 99% .]3[

5

5. . . . . query . query " audio audio " query . content-based audio retrieval . content-based audio retrieval : 1. Audio audio music speech . 2. audio . speech speech speech . 3. Query audio . 4. audio query . : 1. 2. sample-based

1.5.

effect sound: sound effect . MIDI . 4- MPEG audio sound . sound . . . query . . sample-based music

sample-based music . .a : query model . .b : .]1[

6. . ) ( play . .]1[ . shot .]7[ browsing-searching-navigating viewing. Navigating . Navigation

. Searching query. browsing . viewing .]5[ : : Metadata- Based . : Text-Based :information retroviral) IR . IR query query ( . : Audio-Based speech audio IR . : Content-Based . . . shot-based video indexing.

: .]1[

1.6. Motion-Base . . . : 1.1.6. : Feature-Based - . 7 MPEG . 2.1.6. : Trajectory-Based . 3.1.6. : Image-Based . image-based ) (MAM . : ) :(MAM . image-based . MAM

MAM . MAM .

optical . . - . . . . . . . MAM grid . . . ) X ( t ,t0,t1,t2,,tk . :)X (t) = v (i, j, t (i, j) A )V x (i, j, t = )V (i, j, t )V y (i, j, t (i, j) A

) V x (i, j, t ) V y (i, j, t x y (i , j) grid grid A . ) X(t :

= )M(i, j

)) f(v(i, j, t ) grid(i , j grid A . M 1 measure: Agrid 6 .

0

))f(v(i, j, t

MAM image-based MAM. MAM . MAM. MAM MAM . MAM . MAM . MAM . MAM 6 - .

6. MAM

MAM. MAM. - . MAM MAM.

MAM . MAM . MAM. MAM region-based . MAM MAM . MAM . region-based .MAM MAM 7 .

7. MAM

. MAM MAM -

. MAM - MAM region-based .]6[ 2.6. shot-based video indexing and retrieval . . shot. shot : . . / ... . .

8

Shot-based video indexing and retrieval :

1. shot ) ( 2. ) shot shot(. . 3. query video shot shot ) 2 (. shot shot query . shot ) (r frame. query r frame . 3.6. video shot . shot. shot . texture shape color query - . . query shot . : . .]7[

shot . shot . r frame . r frame shot r frame shot . r frame : 1. r frame .shot shot . 2. r frame shot r frame shot . . shot .3. shot sub shot . r frame sub shot

. sub shot . . r frame shot . r frame : 1. r frame track zoom . . 2. .

r frame . 3. . r frame . . . back ground for ground back

ground . .]1[

7. . query . .

8.

[1] Mais M. Fatayer, Multimedia Databases and Content-Based Retrieval, Department of .Computer Science ]2[ Jian-Kang ,Wu Content-Based Indexing of Multimedia ,Databases IEEE

, .TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL. , NO . NOVEMBER/DECEMBER

[3]

Alex

Pentland,

Content-based

indexing

of

images

and

video,

TheMedia

Laboratory,Massachusetts Institute ofTechnology, Ames Street, Cambridge, MA,USA.

[4] Guojun Lu , Techniques and Data Structures for Efficient Multimedia Retrieval Based on Similarity, IEEE TRANSACTIONS ON MULTIMEDIA, VOL. , NO. , SEPTEMBER [5] Oya Kalipsiz, Multimedia Databases, Yildiz Technical University, Computer Science Department, EEE.

[6] Wei Zeng, Wen Gao, Debin Zhao, VIDEO INDEXING BY MOTION ACTIVITY MAPS, Department of Computer Science and Engineering, Hdin Institute of Technology, Hahim, China *Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China. [7] Hyun Sung Chang Member IEEE, Sanghoon Sull Member IEEE, Sang Uk Lee Senior Member IEEE , Efficient Video Indexing Scheme for Content-Based Retrieval, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. , NO. , DECEMBER . [8] Partha Kr. Mukherjee, Mita Nasipuri, D.K Basu and M.Kundu, Indexing and Searching in Multimedia Database Management System, INDIAN INSTITUTE OFTECHNOLOOY. KHARAGPUR . DECEMBER -.. [] Kasturi Chatterjee and Shu-Ching Chen Florida International University, Affinity Hybrid Tree: An Indexing Technique for Content-Based Image Retrieval in Multimedia Databases, Distributed Multimedia Information System Laboratory School of Computing and Information Sciences Miami, FL , USA. [] John R. Smith, Milind Naphade, Apostol (Paul) Natsev, MILTIMEDIA

SEMANTIC INDEXING USING MODEL VECTORS, IBM T.J. Watson Research Center Saw Mill River Road Hawthorne, NY USA.