6
GAYAITP P * * F F H H , , 2 2 & & # # ! ! Śǧ Ğã āǧ Ʊ ß ăČ ŅNjĴ&,ȈÌľ*ªŴ<%;çIJ+f\FƚŇ+ªŴŰĝ>vOödžŽ*å¼% '&;C~VxI[Biq\BAPR[p"GAYAIT">ĬŌ;ȉPR[p+į,v O+»> Web Gqx&ÆĒ%ƸȉPR[p+f\FƚŇ'%qYTQf\F>ŵá ÊȈÌľªŴ%;'*,ǵǔ+}C}CHtHt'ŰĝȈvOį*8"%# +f\FƚŇ>Ǣĥ;' +qYTQţ."%ƨ%;ȉŘÔP~+f\F ƚŇ>ŵáÊ*,Ȉ¦Ó+ÊÔÊé'É +űÔűé>ödžŽ*®:ł%Ő4'È ƫ&;ȉGAYAIT , 'ƥƷ+¨ð'+Ƅľ+®:ł>Ő4'&;PR[p&;ȉ GAYAIT : An Interactive Media System with Individual and Whole characters SHINJI MIZUNO RYOSUKE HIRANO YUKIHIKO TSUTSUMI In this paper, we propose "GAYAIT": an interactive media system in which the user can interactively control a large number of video clips played simultaneously. The user's motion is taken by a webcam and used to control the system. As using video clips in which a person is talking some messages, the system synthesizes an atmosphere like a crowd by playing each video clip simultaneously, and when the user picks up one of the video clips, the saying of the clip becomes clear and could be distinguished. As using video clips in which a person is singing a song, the user can enjoy a vocal solo of each people and their chorus interactively. The user can experience circumstances and a change of individual and whole characters in the system. 1. ǖĂ+L~guV7aY]}I+ģƹ+ŻǠ* ȈŸ¢«ųģƹȈǼä«ųģƹȈ|lY]ģƹ) (>ŵq\BAA]ſ?*)"%;ȉů* vO+»*ö%yAzVCp*ÄĖ;C~V xI[Biq\BA,ȈĄÏî7Lou`KPw ~Zz'%+ŢŵşĬŌ<%:Ȉ33 Šƀ>Ť.%%; 1),2),3) ȉ &ŅƇƒ&,ȈĶC~VxI[Biq\B A>óŲ;ļ¢ǼäĬƈPR[p"GAYAIT">ĬŌ GAYAIT ,ƾIJ+f\FƚŇ>Ìľ*Æ:Ģ )9ļ¢'Ǽä>vO*Ĭƈ;ȉf\FƚŇ >Ìľ*Ģq\BAA]'%,Ȉf\FA] +¤ȄƧ&;_pQu~dCIŻƺȈç + TV r`V>0%ļ¢>Ìľ*ªŴ;Ò 4) 7ȈťĿr`V&²IyRnRZy>ú ƈ"AQUOS Experience in the Grand Central 2008") (Ɔ9<%;ȆÙ 1ȇȉGAYAIT ,<9+Ò *C~VxI[BiŽ)ƿƚ>¸q\BAA] '6ǃ;ȉ GAYAIT &,#+\BRj{C©&IJ½Ņ+f \FƚŇªŴ<;ȉǚĀ+Űĝ&,Ȉ¦%+ļ¢ 'Ǽä,Ì8)è&Ìľ*ªŴ<%:Ȉ ¦&#&":ǵǔ&":;ȉȈ vO+»*Ė%\BRj{C+#+f\F ƚŇǢĥ<;'Ȉ+ļ¢7ǼäĊNJ<%Î 3<; Ęţ."%;ȉ+8*Ȉ GAYAIT , 'ƥƷ+¨ð'Ƅľ+®:ł>ödž Ž*ȅ&;PR[p&;ȉŅƐ&, GAYAIT +óŲķş7Ėŵ>ƈȉ 0 01 AQUOS Experience in the Grand Central 2008. ěƆÿŏèñęàƋñǤ Faculty of Information Science, Aichi Institute of Technology ŋćƉFhBRI{YPE~^ Office Crescendo Inc. 情報処理学会 インタラクション 2012 IPSJ Interaction 2012 2012-Interaction 2012/3/15 211

GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

GAYAIT

"GAYAIT"Web

GAYAIT

GAYAIT : An Interactive Media System with Individual and Whole characters

SHINJI MIZUNO† RYOSUKE HIRANO† YUKIHIKO TSUTSUMI‡

In this paper, we propose "GAYAIT": an interactive media system in which the user can interactively control a large number of video clips played simultaneously. The user's motion is taken by a webcam and used to control the system. As using video clips in which a person is talking some messages, the system synthesizes an atmosphere like a crowd by playing each video clip simultaneously, and when the user picks up one of the video clips, the saying of the clip becomes clear and could be distinguished. As using video clips in which a person is singing a song, the user can enjoy a vocal solo of each people and their chorus interactively. The user can experience circumstances and a change of individual and whole characters in the system.

1.

1),2),3)

"GAYAIT"GAYAIT

TV4)

"AQUOS Experience in the Grand Central 2008"1 GAYAIT

GAYAIT

GAYAITGAYAIT

1 AQUOS Experience in the Grand Central 2008.

Faculty of Information Science, Aichi Institute of Technology

Office Crescendo Inc.

情報処理学会 インタラクション 2012 IPSJ Interaction 2012

2012-Interaction 2012/3/15

211

Page 2: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

2. GAYAIT

GAYAITWeb

WebCG CG

Web 2GAYAIT

2 GAYAIT

CGCG

25 50

3 GAYAIT

3 GAYAIT

Web

CG

CG

4

4

CG

GAYAIT

3. GAYAIT

GAYAIT CG WebWeb

C++

3.1 CG GAYAIT CG

CG

Web

212

Page 3: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

CG

3.2 Web

GAYAIT

Web

Web RGBHSV

5

5

6

6

7

7

n

0n/2

GAYAIT8

8

0 1 2

3

n!1 n!2

n!3

n/2!1 n/2 n/2!2 n/2+1

213

Page 4: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

3.3

GAYAIT

GAYAIT

9

9

4.

GAYAIT 2

MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBC++

160 12048KHz10 /

56

300 Web10

10 GAYAIT

4.1

85 5615 7

GAYAIT

11

11

214

Page 5: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

Web

12

12

GAYAIT

GAYAIT

10 60 50GAYAIT 23

13

13

4.2

25 23

2Happy Birthday to You

302

GAYAIT

14 GAYAIT

14 GAYAIT

5.

GAYAIT

GAYAIT

215

Page 6: GAYAIT : An Interactive Media System with Individual and ... · ,MacBook Pro OS 10.6.8 Core i7 2.8GHz 8GBq ry & PR[p,C++> u % í { f\ F G\ V,

GAYAIT 5)

6.

"GAYAIT"

GAYAIT

Kinect

23500139

1) , , , : TableTalkPlus:

, , Vol. 11,

No. 1, pp. 105-114 (2009). 2) , :

AR , , Vol. 19, No. 4, pp. 2-9(2002).

3) Google Chrome Music Mixer: http://www.morewithgoogle.jp/musicmixer/

4) : (1)

13, 13-18 (2007). 5) hanare: http://kin2hanare.jp/.

216