4
15 (2010 9 ) 3D A study of 3-dimensional sound field reproduction technique based on the reflective audio spot 1) 1) 1) 1) 1) 1) Yutaro Sugibayashi Sota Kurimoto Masanori Morise Takanobu Nishiura Fumihisa Shibata and Hideyuki Tamura 1) 525-8577 1-1-1 Abstract : We have constructed a audio-visual mixed reality (MR) system with headphones In this paper, we try to construct a new 3-dimensional sound field reproduction technique, named ”acoustic planetarium” with several parametric loudspeakers. Parametric loudspeaker can emit the acoustic sound wave to a particular area. Furthermore, acoustic sound image is perceived on the wall, provided that the emitted sound wave arrives at listeners through the wall. Utilizing proposed technique, the users can experience 3-dimensional sound fields without headphones. We carried out evaluation experiments for the proposed technique. And we confirmed the effectiveness of the proposed technique. Key Words: Mixed Reality, 3-Dimensional Sound Field Reproduction, Parametric Loudspeaker 1. (Mixed Reality; MR) MR MR [1] MR MR [2][3] (Head-Related Transfer Function; HRTF)[4] 3D HRTF 3D HRTF HRTF 3D 3D HRTF 3D MR [5] HRTF 3D 3D 2. 2.1 2.2 ( ) 1 204

IL M G#*9]CHrQ - 立命館大学 loudspeaker MITSUBISHI$MSP-50E Microphone NEUMANN$KU 100 Loudspeaker amp. YAMAHA$P2500S Microphone amp. audio-technica$AT-MA2 D/A converter Roland$UA-101

Embed Size (px)

Citation preview

Page 1: IL M G#*9]CHrQ - 立命館大学 loudspeaker MITSUBISHI$MSP-50E Microphone NEUMANN$KU 100 Loudspeaker amp. YAMAHA$P2500S Microphone amp. audio-technica$AT-MA2 D/A converter Roland$UA-101

h 15s|\P<Ackj"jF#Xqgq@88 (2010/ 9n)

IL?M?*<G#*9]CHrQ$?

bWl63D;ls(j!N!$

A study of 3-dimensional sound field reproduction technique based on the reflective audio spot

yS5@: 1)$*5m@ 1)$9*-m 1)$>:I. 1)$FDKW 1)$D< (T 1)

Yutaro Sugibayashi$Sota Kurimoto$Masanori Morise$

Takanobu Nishiura$Fumihisa Shibata$and Hideyuki Tamura

1) )?[gXgX! })X&fJ

J) 525-8577 "l)pETn)l 1-1-1K

Abstract : We have constructed a audio-visual mixed reality (MR) system with headphones%In

this paper, we try to construct a new 3-dimensional sound field reproduction technique, named

”acoustic planetarium” with several parametric loudspeakers. Parametric loudspeaker can emit the

acoustic sound wave to a particular area. Furthermore, acoustic sound image is perceived on the

wall, provided that the emitted sound wave arrives at listeners through the wall. Utilizing proposed

technique, the users can experience 3-dimensional sound fields without headphones. We carried

out evaluation experiments for the proposed technique. And we confirmed the effectiveness of the

proposed technique.

Key Words: Mixed Reality, 3-Dimensional Sound Field Reproduction, Parametric Loudspeaker

1. O8aK

a/$=BuVH>[uVr;g9k#g=B6 (Mixed

Reality; MR) O$h/K&f,TolF*j$N3TKW

~6r?(kpss(;QH7Fm\raSF$k%5i

K$0PpsrC(?kP*MRO>hNkP*MRhj

b$W~6r?(k3H,D=G"k?a$0Ppsb^

a?&fbTolF$k [1]%3l^GKf9O$=BuV

N;O>\0h7>[uVN;O+|?XCI[srQ$

Fs(9k0P*MR Ns(}0V+|?;H)s(}0W

rQ$F$v?X*0g-r#.7?k0P;Q?MR7

9F`rB=KD$F!$7F-? [2][3]%

>0N79F`K*1kV+|?;H)s(}0WGO+|

?XCI[srQ$$,tA#Xt (Head-Related Transfer

Function; HRTF)[4]rxQ7CjNN3TK>[uVN 3D

;lrs(7F$?%HRTFOD9N,td*NAuKh

kDM9,g-/$5NJ 3D;lNs(KOD9NHRTF

rW,9k,W,"j$?gJ~VrW9k%=N?a>0

N79F`GOJW*K{KW,5l?>TN HRTFrx

Q7F$?%7+7$s(9k 3D;lNjL6ODM9,

g-/$5NJ 3D;lNB=KOB&,"C?%fGb$

N3TO0}~N;|re}~KmjL7$e}~N;|

O0}~KmjL9kH$&jLN0emjN/8,2x

G"C?%XCI[sH HRTFrQ$k3HJ/CjNN

3TKP7jL6NI%J>[uVN 3D ;ls(,D=

HJlP$==ONb$0P*MRN#.,|TG-k%

=3G\FGO$6;H9T<+ [5] KhkIL?M?

*<G#*9]CHrxQ7$XCI[sH HRTFrQ$

:KV;|WiM?j&`}0WKhk>[uVN 3D;l

s(rn_k%\;|s(}0N!$H7F$u0LVK

hj[Jk 3D;lN8.r\*H9k%

2. IL?M?*<G#*9]CH

2.1 6;H9T<+

LoN9T<++i|M5lk;HOH69kNKP7$

6;H9T<+O$wN9]CHi$HNh&KCjNNh

N_KD0;Hrs(7*<G#*9]CHr=[9k3

H,D=G"k%^?$?M;rxQ7?IL?M?*<

G#*9]CHrxQ9k3HG$?MILeK;|r=

[D=G"k%

2.2 6;H9T<+N6}

6;HOD0;HHfYFsoKT$X~- (6X~-)

r-7$6;H9T<+O$6;HN6X~-rxQ7?

9T<+G"k%6;H9T<+N6}r^ 1 K(9%6

;Hr-cj"HH7FD0;Hr6}Q47$6}Q4

Hr8.9k%3N6}Q4HO$-cj"~HtH=N&

HSG=.5lk%3N6}Q4HruVK|M9kH6

204

Page 2: IL M G#*9]CHrQ - 立命館大学 loudspeaker MITSUBISHI$MSP-50E Microphone NEUMANN$KU 100 Loudspeaker amp. YAMAHA$P2500S Microphone amp. audio-technica$AT-MA2 D/A converter Roland$UA-101

X~-rbD*<G#*9]CHrnjP7$u$Ns~

A-KhCF*<G#*9]CHbK9;,/89k%-c

j"HH&HSN9;OD0;HNHAHlW7$D0;

HH7FF85lk%

2.3 IL?M?*<G#*9]CH

^ 2KIL?M?*<G#*9]CHN$a<8r(9%

6;H9T<++i|M5lk;rIL$7fd2K?M

5;kH$?ML,?LG"klg$6X~-r]ADD

?M9k%3NH-?M;rxQ7Fu0TK*<G#*

9]CHrs(9kH$>\;Ou0TKAoi:?M;

N_,Aok?a$?MILeK;|,=[5l$"?+

b;,?MIL+i|M5lF$kh&Ku0TKNP5

;k3H,D=G"k%^?$jV7?6;H9T<+N

|M}~NQ=N_G$UNILLVK;|r=[9k3

H,D=G"k%

3. ;|WiM?j&`}0

3.1 5W

33GO$IL?M?*<G#*9]CHrxQ7? 3D

;ls(}0V;|WiM?j&`}0WKhk 3D;l8

.KD$F(9%\}0GOwNWiM?j&`N6}N

h&K$#tN6;H9T<+r8s7?fKCH+i|

M5lk;rIL$2$7fyK?M5;$$UN}~K

;|r=[9k%\}0NxQKhj$N3TO>h79

F`GQ$il?XCI[srue;:K+3JLVGb

Wl6 3D;lrN39k3H,D=G"kHM(ilk%

^?$;r?M5;BuVK;|r=[9k?a$HRTF

Ndj@G"kjLN0emjrsrD=@HM(ilk%

\FGO$\;|s(}0N!$H7F$^ 3 Nh&Ku

^ 1: 6;H9T<+N6}

^ 2: IL?M?*<G#*9]CHN$a<8

0LVKhj[Jk 3D;lN8.r\*H9k%*<G#

*9]CHrQ$k3HG$XCI[srQ$:K#tN

N3TKP7$1~K[JC? 3D;lNs(,D=G"k

HM(ilk%

3.2 =.

6;H9T<+r8s7?fKCHr^ 4(a)K(9%f

KCHKO6;H9T<+r 10f_V9k%fKCHK_

V7?6;H9T<+O|MQYr409k3H,D=G

"k%?M*NrQ$?IL?M?*<G#*9]CHr

xQ7$?M*NeK;|r=[9k%?M*NKO$^

4(b) K(9"/jkD (500mm _ 500mm _ 5mm) rQ

$k%3N?M*NNQYr?M;,N3TLVK~h9

kh&K409k%3lKhCF#tNN3TKP71~

K[JC? 3D;ls(rB=9k,$=N?aKOfKC

HH?MDN[VKD$F!$9k,W,"k%

4. >AB3

sFj!N-z-r>A9k?a$>AB3rT&%B

3ror= 1$B3[Vr^ 5K(9%\FGO$5fN6

;H9T<+rQ$^ 5 Nh&K 5 DN*<G#*9]C

HNQ9G 5 }~K;|rjL5;k%u0LVKhj[

Jk 3D;l8.r[j7$2DNu0LV A$BG>Ar

T&%^:$sFj!N;|jL6r>A9k?aKu0L

V AGO;|jLB3rT&%!K$u0LVKhj[J

k 3D;lrs(9k?a$u0LV AK~h9kFQ9

N;Nu0LVVN;5lYk9r>A9k?aK;5l

^ 3: ;|WiM?j&`}0N$a<8

^ 4: ;|WiM?j&`N=.

205

Page 3: IL M G#*9]CHrQ - 立命館大学 loudspeaker MITSUBISHI$MSP-50E Microphone NEUMANN$KU 100 Loudspeaker amp. YAMAHA$P2500S Microphone amp. audio-technica$AT-MA2 D/A converter Roland$UA-101

YkNW,B3H$u0LV BK*$F;5lYkNgQ

>AB3rT&%

4.1 u0LVAGN;|jLB3

u0LV AK*$F$o3TKO 5}~+i=l>l 2

s:Dis@`JgxGIc;rs(9k%Ic;O 5C

VN[o$HN$:G"k%;|NjL}~ (5}~)rs

z5;k%o3TO5oJ0Or}DX8 8>G"k%

4.2 u0LVAK~h9kFQ9N;Nu0LVVN;

5lYk9N>AB3

4.2.1 W,B3

^:$;5lYkW,B3GO$Fu0LVK*$Fu

0LV AK~h9k 5DNQ9N;N$sQk9~zrW

,9k%=N$sQk9~z+i=liN;5lYkrW

,7$u0LVVN;5lYk9r;P9k%J*$u0

LV AG 5DNQ9N;N;5lYk,5M18KJkh

&KQ9Nw%H;;N6}r409k%

^ 5: B3[V

= 1: B3ro

Parametric loudspeaker MITSUBISHI$MSP-50E

Microphone NEUMANN$KU 100

Loudspeaker amp. YAMAHA$P2500S

Microphone amp. audio-technica$AT-MA2

D/A converter Roland$UA-101

A/D converter SONY$PCM-D1

Recording condition 96.0kHz, 16bit

Ambient noise lebel 29.2dBA

4.2.2 gQ>AB3

!K$u0LV BK*$F$<-N 5J,N>A\Y+

iu0LV AX~h9kFQ9N;N;5lYkr>A5

;k%o3TO5oJ0Or}DX8 8 >G"k%B30

KOu0LV A K*$FFQ9NIc;r 5 CVs(7$

=N;5lYkr 5H9k%o3TKOu0LV BG 5N

Ic;HfS7F;5lYkr>A5;k%FQ9N;r

=l>l 2 s:Dis@`JgxGIc;rs(9k%I

c;O 5 CVN[o$HN$:G"k%B3D-,E{;

N_NuVr 1H9k%3N>ANgWro3TtG?Q

9k3HGMOSM (Mean Opinion Score)raak%

1.4/93(J$

2."^j93(J$$^?O$93(k$,9k

3./793(k$^?O$93(k,.5$

4.93(k

5.h/93(k

4.3 u0LVAGN;|jLB3NkLHM!

;|jLB3NkLr^ 6 K(9%#4Os(}~$D

4Osz}~$_Ng-5OszMtr=9%kLhj$s

(}~Hsz}~,5MlW75z(, 97.5%G"k3H

,N'G-k%^?$HRTFGdjHJCF$?jLN0

emjN/8,J$3HbN'G-k%IL?M?*<G#

*9]CHrxQ7BuVK;|r=[9k3HG$mj

L,c:G-jL6,I%J 3D ;lr8.G-?HM(

ilk%7?,CF$IL?M?*<G#*9]CHrxQ

7? 3D ;ls(j!N-z-r(;?%J*$#sO6

;H9T<+ 5frHCF 5}~N_K;|r=[7?,$

fKCHK_V7? 10f4FrH(P 10}~+iN;|

r=[D=G"j$7fd2K?M5;k3HGDQ}~

Kb;|r=[D=G"k%^?$6;H9T<+N|M

}~r0*K)f9k3HG"ifk$UN}~K;|r

=[D=G"j$\0;|b=[D=G"kHM(il$3

liKD$FO#ehjH`}KG"k%

4.4 u0LVAK~h9kFQ9N;Nu0LVVN;

5lYk9>AB3kLHM!

u0LV AK~h9kFQ9N;Nu0LV A$BGN

;5lYkNW,B3kLr^ 7$8K(9%^?$=li

NgQ>AB3kLr^ 9K(9%=l>lN#4Ou0L

^ 6: u0LV AGN;|jLB3NkL

206

Page 4: IL M G#*9]CHrQ - 立命館大学 loudspeaker MITSUBISHI$MSP-50E Microphone NEUMANN$KU 100 Loudspeaker amp. YAMAHA$P2500S Microphone amp. audio-technica$AT-MA2 D/A converter Roland$UA-101

V AK~h9k 5DNQ9N;N~hQYG"k%^ 7$8

ND4Ou0LVA$BGN=liN;5lYkG"k%^

9ND4Ou0LV BGNMOSMG"j$^fND~OW

i9^$J9N8`P9r=9%^ 7$8hj$?Q 20.0dB$

Gg 34.2dB N;5lYk9,N'G-k%^ 7$8$9 h

j$u0LV BGO;5lYk,.5$[I;,"^j9

3(J$Ho3TONP7?3H,N'G-$MOSMO?

Q 3.1$G. 2.3G"C?%6;H9T<+rQ$?3HG

u0LV AH BGg-J;5lYk9ND-r=[7$o

3Tb=N9r=,KNP7?H@(k%7?,CF*<

G#*9]CHrxQ7?sFj!N-z-rN'7?%7

+7$180deg.NQ9N;O;5lYk9, 4.6dB$MOS

M, 4.1 G"C?%3lOu0LV AK~h9k 180deg.

NQ9Nd9~eKu0LV B,"k3H+i$u0LV

ArLa7u0LV BK^G;,~h7?3H,6xHM

^ 7: u0LVAK~h9kFQ9N;Nu0LVAGN

;5lYkW,kL

^ 8: u0LVAK~h9kFQ9N;Nu0LVBGN

;5lYkW,kL

^ 9: u0LVAK~h9kFQ9N;Nu0LVBGN

;5lYkNgQ>AB3kL

(ilk%hCF$;|WiM?j&`}0GO$"ku

0LVrLa7LNu0LVK^G~h9kQ9N;Or

1F 2 !J_N?M;rxQ7;|r=[9k3H$>N

6;H9T<+rQ$F^59k3H$tO=lr-zh

Q9k3Hy,rhvH7Fs2ilk%

5. `9S

\FGOXCI[sH HRTFrxQ7J$ 3D;ls(

j!j!H7F$IL?M?*<G#*9]CHrxQ7

?$V;|WiM?j&`}0WKhk 3D;l8.rn_$

\;|s(}0N!$H7F$u0LVKhj[Jk 3D;

lN8.r\X7?%=NkL$XCI[srQ$:K$5

z( 97.5%NI%JjL6rN'7?%^?$u0LV A

H BGg-J;5lYk9ND-r=[7$o3Tb=N

9r=,KNP7?%7?,CF\;|s(}0N-z-

r(;?%7+7$"ku0LVK~h9kQ9N;,L

Nu0LVK^G~h9kdj,8_7$u0LVKhj

[Jk 3D;l8.N?aKO$=NdjOsr7F 3D;

lr=[9Y-G"k3HbN'7?%#eO$\;|s

(}0r5iK/85;$f9,B=7?>0Nk0PN

B8OrlW5;kj!r'17$kP*MRH$\;|

s(}0Khk0P*MRr7bJ/#.7$hjWl6

Nb$MRuVN=[r\X9%

U- \&fNltO$J&q&pW&f AVk0P;Q

#g=BuVN==O~eKX9k&fWKhk%

2M8%

[1] J.Sodnik$et al.'H Spatial sound localization in an

augmented reality environmentI, Proc%OZCHI 2006$

pp%111 - 117$2006%

[2] fE3@$>'HkP&0PN=BH>[r;g9k 2

_ 2}0#g=B679F`NB=I$|\P<Ack

j"jF#Xq@8o$Vol. 13$No. 2$pp. 227 - 237$

2008.

[3] Hn-#$>'HkP&0Pr;Q7?#g=B679

F`N+/ (4) ] #g=BuVGN;N?M&WGN

B=]I$1Xqh 13 sgq@88$pp. 556 - 559$

2008.

[4] J%Kawaura$et al.'HSound localization in headphone

reproduction by simulating transfer functions from

the sound source to the external earI$J%Acoust%

Soc%Jpn (E)$12$pp. 203 - 216$ 1991.

[5] yR'K$>'HQiaHjC/9T<+N6}H~QI$

ERpsL.Xq;Q&fsp$EA2005-100$pp%25-

30$2006%

207