TV2Web ：メタデータ付きビデオのWeb　　　　　　　コンテンツへの自動変換Mahendren Munisamy ，角谷和俊，田中克

己京都大学　情報学研究科

社会情報学専攻

制御• 映像とメタデータから Web を生成

– ズーム操作で映像と Web コンテンツの切り替え• 映像データの画面サイズの変化

– フォーカス操作で指定範囲の中心点を移動

Zoom out

Zoom in

Focus

メタデータと画像データの格納

• 与えられたデータ– ビデオ映像

• ショット，シーン，セグメントに分割• 各区間から適切な映像データの抽出

– タイムコード付きメタデータ• ビデオ映像におけるショットレベルの字幕データ

– 下位層の字幕を結合上位層のメタデータを生成

ショット区間

シーン区間

セグメント区間

画像とメタデータデータの生成

SegmentSceneShot

ビデオ映像の分割

映像データ(1) ショット： 30fps(2) シーン :15fps(3) セグメント :5fps

メタデータ(1) 番組タイトル　　　 ex:CNN Headline News(2) セグメントタイトル　　　 ex: 天気，スポーツ……(3) ショットの字幕データ　　　 ex: 0-4: Not many singers are nominated

アプローチ

Not many singers are nominated for a Grammy for their very first

What’s so great about you is that you’re no different from the

What’s so great about you is that you’re no different from the

ブロック

セル

映像データ

メタデータ

•各区間 ( ショット，シーン，セグメント ) をブロック構造に変換•ブロックはセルから構成

ex: ショットのブロックにおいてあるセルは一つのショットを代表•セルは映像データとメタデータを格納

ビデオ映像

ブロック構造の性質• ブロックの観察範囲

– ブロック内のコンテンツに限定ブロックから出ている領域の観察が不可能

•複数のブロックの可視状態–ディスプレー上によるブロック重複の解決

表示中のブロック

他のブロック 非常時

ブラウジング機能Shot

•Zoom-In- 映像データ：面積が増加- メタデータ : LOD が低下

•Zoom-Out- 映像データ：面積が低下- メタデータ : LOD が増加

•Focus

- 指定範囲の中心点の移動

FocusZoom

outZoom

out

SegmentScene Zoom-Out

Zoom in

FocusFocus

指定区間

Zoom-Out 機能面積の下界

新たな面積の上界

新たな面積の下界

（１）観察中のブロックにおいて全てのセルの映像データの縦と横の長さを一定の値で低下

(2) メタデータのフォントサイズを一定の値で増加

（３）セルの映像データの縦或いは横の長さはある値域値より小さくなると上位層のブロックを表示

Zoom-In 機能面積の上界

新たな面積の上界

新たな面積の下界

（１）観察中のブロックにおいて全てのセルの映像データの縦と横の長さを一定の値で増加

(2) メタデータのフォントサイズを一定の値で低下

（３）セルの映像データの縦或いは横の長さはある値域値より大きくなると下位層のブロックを表示

Focus 機能

Not many singers are nominated for a Gramy

What’s so great about you is that you’re no

C: Yeah, this is my third album, it’s called

It’s incredible because to be nominated for a

ブロック

セル

Focus

Not many singers are nominated for a Gramy

What’s so great about you is that you’re no

C: Yeah, this is my third album, it’s called

It’s incredible because to be nominated for a

Not many singers are nominated for a Gramy

What’s so great about you is that you’re no

C: Yeah, this is my third album, it’s called

It’s incredible because to be nominated for a

Focus

Focus 操作で指定範囲の中心点を移動 centering

ズームアウト

CNN Headline News

Not many singers are

CNN Headline News

Not many singers are

ズームアウト

CNN Headline News

CNN Headline News

ズームアウト

ズームアウト

CNN Headline News

ズームアウト

CNN Headline News

ズームアウト

ズームアウト

CNN Headline News

ズームアウト

Interview with Billy Gillman

A: Not many singers are nominated for a Grammy for their very first record but Billy Gillman did it before he was old enough to drive. Laura Bolter reports.  B: What’s so great about you is that you’re no different from the first time I met you before you’d sold over a million albums, this is your third album C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house

ズームアウト

CNN Headline News

ズームアウト

Interview with Billy Gillman

A: Not many singers are nominated for a Grammy for their very first record but Billy Gillman did it before he was old enough to drive. Laura Bolter reports.  B: What’s so great about you is that you’re no different from the first time I met you before you’d sold over a million albums, this is your third album C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house

Focus

C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house and they just made song after song after song and we just picked 12 of them from a 50 album best. She’s my girl is really funny because it’s not an acting concept like voice video was when Oklahoma was released. I’m not staring, I don’t have to concentrate so much. It’s a concert so we’re just having fun being my video self, just having fun with the audience.  B: So you’re nominated for a Grammy this year.  C: YesB: Some people wait an entire lifetime for it.  C: It’s incredible because to be nominated for a Grammy is the pinnacle. Like I said, it’s such a privilege, I’m at such an age where I love everything minute of it just incase it ends. There’s nothing like the feeling of having the audience smiling and listening to you. It gives you the most uplifting feeling you can imagine.

C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house and they just made song after song after song and we just picked 12 of them from a 50 album best. She’s my girl is really funny because it’s not an acting concept like voice video was when Oklahoma was released. I’m not staring, I don’t have to concentrate so much. It’s a concert so we’re just having fun being my video self, just having fun with the audience.  B: So you’re nominated for a Grammy this year.  C: YesB: Some people wait an entire lifetime for it.  C: It’s incredible because to be nominated for a Grammy is the pinnacle. Like I said, it’s such a privilege, I’m at such an age where I love everything minute of it just incase it ends. There’s nothing like the feeling of having the audience smiling and listening to you. It gives you the most uplifting feeling you can imagine.

Focus

ズームアウト

CNN Headline News

ズームアウト

Interview with Billy Gillman

A: Not many singers are nominated for a Grammy for their very first record but Billy Gillman did it before he was old enough to drive. Laura Bolter reports.  B: What’s so great about you is that you’re no different from the first time I met you before you’d sold over a million albums, this is your third album C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house

ズームアウト

CNN Headline News

ズームアウト

Interview with Billy Gillman

A: Not many singers are nominated for a Grammy for their very first record but Billy Gillman did it before he was old enough to drive. Laura Bolter reports.  B: What’s so great about you is that you’re no different from the first time I met you before you’d sold over a million albums, this is your third album C: Yeah, this is my third album, it’s called daily dreaming. It’s just been released in May 8 and I’m really proud of it. Making this album was so much easier because I know what to do, I know what to say, if I wanted to change something, I’d change it one weekend before we started recording. Like every songwriter in Nashville got together in my producers house. And they all got together in my producers house

ズームイン

ズームアウト

CNN Headline News

ズームアウト

CNN Headline News

ズームイン

CNN Headline News

CNN Headline News

ズームイン

CNN Headline News

Not many singers are

CNN Headline News

Not many singers are

ズームイン