On the interaction of audio and visual cues to friendliness in interrogative prosody

PowerPoint Presentation

*

On the interaction of audio and visual cues to friendliness in interrogative prosody
David House

*

Perceiving question intonation
Question intonation in SwedishRaised topline (Grding 1979)

Also delayed peak (e.g. Neapolitan Italian)?

*

Perception experiment
Test sentence: Hon vill bara flyga.? (She only wants to fly.?)Final focal accent on flyga (accent 2)Variables: peak timing and peak heightTask: question or statement

*

*

Chart1

40.90

72.74.5

59.19.1

77.322.7

95.563.6

10068.2

high pitch

low pitch

Stimulus number

Percent

Percent question response

Sheet1

graphs (2)

st1st2st3st4st5st6st7st8st9st10st11st12sumst1st2st3st4st5st6st7st8st9st10st11st12

1jonas0011110010005jonas41334542423338

2annemarie0000111110005annemarie34335545553348

3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335

9karolina0100111110107karolina41224444311434

10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329

12anna eriks0001111000116anna eriks24434533334442

13beate lund0001111110006beate lund53222535553343

14mats lund0011011010106mats lund31343534332236

15boel h0011101010106boel h43423222433234

16gunnar fag0001111110006gunnar fag32233333312129

17arvid0001110001116arvid24224232233231

18elinskogl1111010001107elinskogl51442554223441

19elensven0001111110017elensven55225434534547

20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449

24klaraward0111110010017klaraward22332321111122

25lars-erik20110110011107lars-erik252123314323231

26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331

28rebeckajan0000001110115rebeckajan53432321211128

29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343

31tomasols0001110110117tomasols52133511122127

32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206

st 1st 2st 3st 4st 5st 6st 7st 8st 9st 10st 11st 12

high pitch40.972.759.177.395.5100high pitch-11.826.42042.763.682.7

low pitch04.59.122.763.668.2low pitch-83.6-78.2-68.2-48.216.416.4

graphs (2)

00

00

00

00

00

00

high pitch

low pitch

Stimulus number

Score

Confidence response score (+ question, - statement)

graphs

40.90

72.74.5

59.19.1

77.322.7

95.563.6

10068.2

high pitch

low pitch

Stimulus number

Percent


ssomc_graphs


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


low pitch1009283752525low pitch80706043-27-23

high pitch7525412580high pitch23-33-18-33-52-78

ssomc_graphs

low pitch

high pitch

Stimulus number

Percent

Percent statement response

raw ident

00

00

00

00

00

00

low pitch

high pitch

Stimulus number

Score

Confidence response score (+ statement, - question)

anova1


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


vder3.030303030321.212121212130.30303030363.636363636475.757575757684.8484848485vder45.454545454554.545454545575.757575757630.30303030357.575757575854.5454545455

confidence81.818181818250.30303030355.757575757655.151515151566.060606060675.7575757576confidence55.151515151561.212121212166.666666666754.545454545555.151515151553.3333333333

anova1

00

00

00

00

00

00

vder

confidence

Stimulus number

Percent

Prominence response and confidence

anova1 (2)

00

00

00

00

00

00

vder

confidence

Stimulus number

Percent


adjusted ident


erik15-13-1-1-2-5-4-5-5-4-41jonas453314423423

hillevi14-3-2-23-3-4-4-443-2annemarie353345553453

boel13-53-44-554-54-3-3cathrin551113331111

am155555-3-4-5-5-3-4-5sanna432213542145

sara15-2455222-3-2-111mattias421112221331

arvid15-1434-1-3-2-12-1-1eva a554535445234

anna15-2435-4-5-2-43-4-4jenny423332441311

frida1535-13-1-4-3-5-4-4-5sofia442113553322

hanna14-4444154-423-1

caroline15-4455-4-5-5-5-5-5-5

sofiad14-2324-4-5-5-5-4-5-5

karolina442214344411

1per-ke545554425253

backwards to arvid2erik25-1-143-1-5-5-5-4-5-51jens513233223122

hillevi24-4434-33-3-43-4-3anna eriks254344334334

boel23-2324-3-4-4-553-3beate lund552232553353

am5-3432-325-55-5-4

sara21244413-2-332-11mats lund353413342332

arvid2315455-1-2-22-1-1boel h424233422233

anna2-4-35-4444555-241gunnar fag332323331312

frida2-5-5-1-3-1-22534251arvid22224422233331

hanna2-324-5-1-1-143334elinskogl55441224452341

caroline2-4-4-3-4-33454535elensven54225554533447

sofiad2-3-22-53-114-12-131jimmy55232422211130

johanna44222435223538

1jonas44333523234238

karin33444555453449

klaraward23332211121122

1lars-erik253122334212331

1leopold55555543544555

1martin32322242322431

rebeckajan53433221121128

sally43333443335341

1sparx55432244343443

1tomasols55132311112227

1tor45221121143127

sum-19-127-212310231419521ulrika54333352444545

015sum716548494656514745494651624

18

33


vder166121316381181113

confidence834853517275527077555057


vder0.05882352940.35294117650.35294117650.70588235290.76470588240.94117647060.17647058820.47058823530.64705882350.47058823530.64705882350.7647058824

confidence834853517275527077555057

ssomc_adj iden

st1st2st3st4st5st6st7st8st9st10st11st12

erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4

boel1343-4-5-5445-3-3-5

am15555-35-3-5-4-4-5-5

sara155452-2-222-11-3

arvid15443-1-12-2-3-1-1-1

anna15543-4-23-2-5-4-4-4

frida1535-1-13-4-3-4-4-5-5

hanna144441-42453-1-4

caroline15545-4-4-5-5-5-5-5-5

sofiad14432-4-2-4-5-5-5-5-5

erik153-14-1-1-4-5-5-5-5-5

hillevi14443-3-43-33-4-3-4

boel13432-3-25-4-43-3-5

am15243-3-3552-5-4-5

sara11444123-232-1-3

arvid13554512-2-1-1-1-2

anna145554-2544-3-4-4

frida1554322-1-1-2-5-5-3

hanna14433-134-1-12-3-5

caroline1555443-3-33-4-4-4

sofiad1342-11-123-1-2-3-5

Anova: Single FactorAnova: Single Factor

SUMMARYSUMMARY

GroupsCountSumAverageVarianceGroupsCountSumAverageVariance

Column 122924.18181818181.1082251082Column 122130.590909090913.3008658009

Column 222863.90909090911.8961038961Column 222-29-1.318181818211.4653679654

Column 322753.40909090913.2056277056Column 322-22-113.5238095238

Column 422532.40909090916.538961039Column 422-47-2.13636363648.5995670996

Column 522-18-0.81818181828.5367965368Column 522-70-3.18181818182.9177489177

Column 622-18-0.81818181827.6796536797Column 622-91-4.13636363641.2662337662

ANOVAANOVA

Source of VariationSSdfMSFP-valueF critSource of VariationSSdfMSFP-valueF crit

Between Groups581.45454545455116.290909090924.088955313102.2861854632Between Groups309561.87.26011188340.00000525482.2861854632

Within Groups608.27272727271264.8275613276Within Groups1072.54545454541268.5122655123

Total1189.7272727273131Total1381.5454545454131

ANOVA-all

st1st2st3st4st5st6st7st8st9st10st11st12Anova: Single Factor

erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4SUMMARY

boel1343-4-5-5445-3-3-5GroupsCountSumAverageVariance

am15555-35-3-5-4-4-5-5Row 16-27-4.50.3

sara155452-2-222-11-3Row 26-7-1.166666666713.7666666667

arvid15443-1-12-2-3-1-1-1Row 3620.333333333319.8666666667

anna15543-4-23-2-5-4-4-4Row 46-26-4.33333333330.6666666667

frida1535-1-13-4-3-4-4-5-5Row 56-1-0.16666666674.5666666667

hanna144441-42453-1-4Row 66-6-12.8

caroline15545-4-4-5-5-5-5-5-5Row 76-16-2.66666666678.6666666667

sofiad14432-4-2-4-5-5-5-5-5Row 86-25-4.16666666670.5666666667

erik153-14-1-1-4-5-5-5-5-5Row 9691.511.5

hillevi14443-3-43-33-4-3-4Row 106-30-50

boel13432-3-25-4-43-3-5Row 116-29-4.83333333330.1666666667

am15243-3-3552-5-4-5

sara11444123-232-1-3

arvid13554512-2-1-1-1-2ANOVA

anna145554-2544-3-4-4Source of VariationSSdfMSFP-valueF crit

frida1554322-1-1-2-5-5-3Between Groups330.93939393941033.09393939395.79056203610.00000686992.0077912666

hanna14433-134-1-12-3-5Within Groups314.3333333333555.7151515152

caroline1555443-3-33-4-4-4

sofiad1342-11-123-1-2-3-5Total645.272727272765


Anova: Single Factor

SUMMARYSUMMARY

GroupsCountSumAverageVarianceGroupsCountSumAverageVarianceSUMMARY

Row 1630.57.9Row 16-27-4.50.3GroupsCountSumAverageVariance

Row 26-3-0.59.9Row 26-7-1.166666666713.7666666667Row 16-29-4.83333333330.1666666667

Row 36-4-0.666666666719.4666666667Row 3620.333333333319.8666666667Row 26-8-1.333333333311.4666666667

Row 46223.666666666710.6666666667Row 46-26-4.33333333330.6666666667Row 36-8-1.333333333317.8666666667

Row 56193.16666666677.7666666667Row 56-1-0.16666666674.5666666667Row 46-2-0.333333333323.8666666667

Row 66142.33333333337.0666666667Row 66-6-12.8Row 5620.33333333337.0666666667

Row 76111.833333333314.9666666667Row 76-16-2.66666666678.6666666667Row 66-5-0.83333333332.1666666667

Row 86142.33333333337.4666666667Row 86-25-4.16666666670.5666666667Row 7620.333333333319.4666666667

Row 96132.166666666710.5666666667Row 9691.511.5Row 86-17-2.83333333333.3666666667

Row 106111.833333333320.5666666667Row 106-30-50Row 96-4-0.666666666710.6666666667

Row 11671.166666666711.3666666667Row 116-29-4.83333333330.1666666667Row 106-15-2.57.5

Row 12691.57.9Row 126-29-4.83333333330.1666666667Row 116-6-19.2

Row 13681.333333333314.2666666667Row 136-8-1.333333333311.4666666667

Row 14671.16666666678.5666666667Row 146-8-1.333333333317.8666666667

Row 15681.333333333312.2666666667Row 156-2-0.333333333323.8666666667ANOVA

Row 166162.66666666672.2666666667Row 16620.33333333337.0666666667Source of VariationSSdfMSFP-valueF crit

Row 176233.83333333332.5666666667Row 176-5-0.83333333332.1666666667Between Groups139.27272727271013.92727272731.35815602840.2242575892.0077912666

Row 186213.57.5Row 18620.333333333319.4666666667Within Groups5645510.2545454545

Row 196213.51.9Row 196-17-2.83333333333.3666666667

Row 206162.66666666673.4666666667Row 206-4-0.666666666710.6666666667Total703.272727272765

Row 216264.33333333330.6666666667Row 216-15-2.57.5

Row 22681.33333333334.2666666667Row 226-6-19.2

ANOVAANOVA


Between Groups223.06060606062110.62193362191.20870279150.25835653091.6527934577Between Groups503.21212121212123.96248196253.0009939460.00010228091.6527934577


Total1189.7272727273131Total1381.5454545454131

Sheet3


erik15-13-1-2-1-5-4-5-4-4-51jonas453314423423


boel1343-4-5-5445-3-3-5cathrin551113331111

am15555-35-3-5-4-4-5-5sanna432213542145

sara155452-2-222-11-31mattias421112221331

arvid15443-1-12-2-3-1-1-1eva a554535445234

anna15543-4-23-2-5-4-4-4

frida1535-1-13-4-3-4-4-5-5

hanna144441-42453-1-4

caroline15545-4-4-5-5-5-5-5-5

sofiad14432-4-2-4-5-5-5-5-5

50413719-24-16-8-20-23-25-34-46jenny423332441311

sofia442113553322


1per-ke545554425253

erik253-14-1-1-4-5-5-5-5-51jens513233223122


boel23432-3-25-4-43-3-5beate lund552232553353

am5243-3-3552-5-4-5

sara21444123-232-1-31mats lund353413342332

arvid23554512-2-1-1-1-2boel h424233422233

anna245554-2544-3-4-4

frida2554322-1-1-2-5-5-3

hanna24433-134-1-12-3-5

caroline2555443-3-33-4-4-4

sofiad2342-11-123-1-2-3-5

424538346-221-91-22-36-451gunnar fag332323331312

1arvid22224422233331

elinskogl55441224452341

elensven54225554533447

sum92867553-18-1813-29-22-47-70-911jimmy55232422211130

johanna44222435223538

1jonas44333523234238

percent0.83636363640.78181818180.68181818180.4818181818-0.1636363636-0.16363636360.1181818182-0.2636363636-0.2-0.4272727273-0.6363636364-0.8272727273karin33444555453449

per/ques-83.6-78.2-68.2-48.216.416.4-11.826.42042.763.682.7klaraward23332211121122

1lars-erik253122334212331

1leopold55555543544555

number_s222120178713695101martin32322242322431

percent10095.454545454590.909090909177.272727272736.363636363631.818181818259.090909090927.272727272740.909090909122.72727272734.54545454550053433221121128

per/ques04.54545454559.090909090922.727272727363.636363636468.181818181840.909090909172.727272727359.090909090977.272727272795.4545454545100sally43333443335341

per/ques04.59.122.763.668.240.972.759.177.395.51001sparx55432244343443

1tomasols55132311112227

1tor45221121143127

sum173.23636363640174.5818181818178.9818181818175.8363636364171.43636363640166.8363636364166.9155.5727272727153.4636363636145.8727272727ulrika54333352444545

015sum716548494656514745494651624

18

33


vder166121316381181113

confidence834853517275527077555057


vder0.05882352940.35294117650.35294117650.70588235290.76470588240.94117647060.17647058820.47058823530.64705882350.47058823530.64705882350.7647058824

confidence834853517275527077555057


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


vder3.030303030321.212121212130.30303030363.636363636475.757575757684.848484848545.454545454554.545454545575.757575757630.30303030357.575757575854.5454545455

confidence0.81818181820.5030303030.55757575760.55151515150.66060606060.75757575760.55151515150.61212121210.66666666670.54545454550.55151515150.5333333333


erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4Anova: Single Factor

boel1343-4-5-5445-3-3-5

am15555-35-3-5-4-4-5-5SUMMARY

sara155452-2-222-11-3GroupsCountSumAverageVariance

arvid15443-1-12-2-3-1-1-1Row 1612221.2

anna15543-4-23-2-5-4-4-4Row 2650.833333333339.7666666667

frida1535-1-13-4-3-4-4-5-5Row 3630.550.3

hanna144441-42453-1-4Row 4630536.8

caroline15545-4-4-5-5-5-5-5-5Row 56355.833333333313.3666666667

sofiad14432-4-2-4-5-5-5-5-5Row 66376.166666666712.5666666667

erik153-14-1-1-4-5-5-5-5-5Row 76325.333333333334.2666666667

hillevi14443-3-43-33-4-3-4Row 86355.833333333314.1666666667

boel13432-3-25-4-43-3-5Row 96294.833333333317.3666666667

am15243-3-3552-5-4-5Row 106376.166666666726.9666666667

sara11444123-232-1-3Row 116152.523.9

arvid13554512-2-1-1-1-2

anna145554-2544-3-4-4

frida1554322-1-1-2-5-5-3ANOVA

hanna14433-134-1-12-3-5Source of VariationSSdfMSFP-valueF crit

caroline1555443-3-33-4-4-4Between Groups288.12121212121028.81212121211.09036697250.38562238182.0077912666

sofiad1342-11-123-1-2-3-5Within Groups1453.33333333335526.4242424242

Total1741.454545454665


erik110223-3-2-9-9-10-9-9-10Anova: Single Factor

hillevi18721-6-77-7-1-1-5-8

boel1686-2-8-79010-6-10SUMMARY

am110798-6220-2-9-9-10GroupsCountSumAverageVariance

sara169893010510-6Row 16-56-9.33333333330.2666666667

arvid18997404-4-4-2-2-3Row 26-15-2.530.3

anna1910980-482-1-7-8-8Row 36-6-142.4

frida11089215-5-4-6-9-10-8Row 46-28-4.666666666727.8666666667

hanna188770-16345-4-9Row 5610.166666666712.5666666667

caroline11010990-1-8-8-2-9-9-9Row 66-11-1.83333333338.9666666667

sofiad17851-3-3-2-2-6-7-8-10Row 76-14-2.333333333342.6666666667

Row 86-42-75.6

Row 9650.833333333335.7666666667

Anova: Single FactorAnova: Single FactorRow 106-45-7.57.5

Row 116-35-5.833333333310.5666666667

SUMMARYSUMMARY


Column 111928.36363636362.4545454545Column 111131.181818181840.9636363636ANOVA

Column 211867.81818181824.7636363636Column 211-29-2.636363636416.6545454545Source of VariationSSdfMSFP-valueF crit

Column 311756.81818181827.5636363636Column 311-22-219.6Between Groups672.75757575761067.27575757583.29685179690.00208837682.0077912666

Column 411534.818181818215.1636363636Column 411-47-4.272727272725.2181818182Within Groups1122.33333333335520.4060606061

Column 511-18-1.636363636415.0545454545Column 511-70-6.363636363610.6545454545

Column 611-18-1.636363636412.8545454545Column 611-91-8.27272727274.6181818182Total1795.090909090965

ANOVAANOVA

Source of VariationSSdfMSFP-valueF critSource of VariationSSdfMSFP-valueF critAnova: Single Factor


Within Groups578.5454545455609.6424242424Within Groups1177.09090909096019.6181818182SUMMARY

GroupsCountSumAverageVariance

Total1741.454545454665Total1795.090909090965Column 111131.181818181840.9636363636

Column 211-29-2.636363636416.6545454545

Column 311-22-219.6

Column 411-47-4.272727272725.2181818182

Column 511-70-6.363636363610.6545454545

Column 611-91-8.27272727274.6181818182

ANOVA

Source of VariationSSdfMSFP-valueF crit

Between Groups6185123.66.30027803520.00009225954.7566572903

Within Groups1177.09090909096019.6181818182

Total1795.090909090965


erik1000000000000

hillevi1000000000000

boel1000000000000

am1000000000000

sara1000000000000

arvid1000000000000

anna1000000000000

frida1000000000000

hanna1000000000000

caroline1000000000000

sofiad1000000000000

*

Interrogative face?
Statement
Question
Smile +Fast nod
Slow nod +Eyebrow lowering

*

INTERROGATIVE FACE
0
20
40
60
80
100
1
2
3
4
5
6
Stimulus number
Percent
high pitch
low pitch
DECLARATIVE FACE
0
20
40
60
80
100
1
2
3
4
5
6
Stimulus number
Percent
high pitch
low pitch

Chart1

40.90

72.74.5

59.19.1

77.322.7

95.563.6

10068.2

high pitch

low pitch

Stimulus number

Percent

AUDIO

Sheet1

graphs (2)


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


high pitch40.972.759.177.395.5100high pitch-11.826.42042.763.682.7

low pitch04.59.122.763.668.2low pitch-83.6-78.2-68.2-48.216.416.4

graphs (2)

00

00

00

00

00

00

high pitch

low pitch

Stimulus number

Score

Confidence response score (+ question, - statement)

graphs

40.90

72.74.5

59.19.1

77.322.7

95.563.6

10068.2

high pitch

low pitch

Stimulus number

Percent


ssomc_graphs


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


low pitch1009283752525low pitch80706043-27-23

high pitch7525412580high pitch23-33-18-33-52-78

ssomc_graphs

00

00

00

00

00

00

low pitch

high pitch

Stimulus number

Percent

Percent statement response

raw ident

00

00

00

00

00

00

low pitch

high pitch

Stimulus number

Score

Confidence response score (+ statement, - question)

anova1


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


vder3.030303030321.212121212130.30303030363.636363636475.757575757684.8484848485vder45.454545454554.545454545575.757575757630.30303030357.575757575854.5454545455

confidence81.818181818250.30303030355.757575757655.151515151566.060606060675.7575757576confidence55.151515151561.212121212166.666666666754.545454545555.151515151553.3333333333

anova1

00

00

00

00

00

00

vder

confidence

Stimulus number

Percent


anova1 (2)

00

00

00

00

00

00

vder

confidence

Stimulus number

Percent


adjusted ident


erik15-13-1-1-2-5-4-5-5-4-41jonas453314423423


boel13-53-44-554-54-3-3cathrin551113331111

am155555-3-4-5-5-3-4-5sanna432213542145

sara15-2455222-3-2-111mattias421112221331

arvid15-1434-1-3-2-12-1-1eva a554535445234

anna15-2435-4-5-2-43-4-4jenny423332441311

frida1535-13-1-4-3-5-4-4-5sofia442113553322

hanna14-4444154-423-1

caroline15-4455-4-5-5-5-5-5-5

sofiad14-2324-4-5-5-5-4-5-5


1per-ke545554425253

backwards to arvid2erik25-1-143-1-5-5-5-4-5-51jens513233223122


boel23-2324-3-4-4-553-3beate lund552232553353

am5-3432-325-55-5-4

sara21244413-2-332-11mats lund353413342332

arvid2315455-1-2-22-1-1boel h424233422233

anna2-4-35-4444555-241gunnar fag332323331312

frida2-5-5-1-3-1-22534251arvid22224422233331

hanna2-324-5-1-1-143334elinskogl55441224452341

caroline2-4-4-3-4-33454535elensven54225554533447

sofiad2-3-22-53-114-12-131jimmy55232422211130

johanna44222435223538

1jonas44333523234238

karin33444555453449

klaraward23332211121122

1lars-erik253122334212331

1leopold55555543544555

1martin32322242322431

rebeckajan53433221121128

sally43333443335341

1sparx55432244343443

1tomasols55132311112227

1tor45221121143127

sum-19-127-212310231419521ulrika54333352444545

015sum716548494656514745494651624

18

33


vder166121316381181113

confidence834853517275527077555057


vder0.05882352940.35294117650.35294117650.70588235290.76470588240.94117647060.17647058820.47058823530.64705882350.47058823530.64705882350.7647058824

confidence834853517275527077555057

ssomc_adj iden


erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4

boel1343-4-5-5445-3-3-5

am15555-35-3-5-4-4-5-5

sara155452-2-222-11-3

arvid15443-1-12-2-3-1-1-1

anna15543-4-23-2-5-4-4-4

frida1535-1-13-4-3-4-4-5-5

hanna144441-42453-1-4

caroline15545-4-4-5-5-5-5-5-5

sofiad14432-4-2-4-5-5-5-5-5

erik153-14-1-1-4-5-5-5-5-5

hillevi14443-3-43-33-4-3-4

boel13432-3-25-4-43-3-5

am15243-3-3552-5-4-5

sara11444123-232-1-3

arvid13554512-2-1-1-1-2

anna145554-2544-3-4-4

frida1554322-1-1-2-5-5-3

hanna14433-134-1-12-3-5

caroline1555443-3-33-4-4-4

sofiad1342-11-123-1-2-3-5


SUMMARYSUMMARY


Column 122924.18181818181.1082251082Column 122130.590909090913.3008658009

Column 222863.90909090911.8961038961Column 222-29-1.318181818211.4653679654

Column 322753.40909090913.2056277056Column 322-22-113.5238095238

Column 422532.40909090916.538961039Column 422-47-2.13636363648.5995670996

Column 522-18-0.81818181828.5367965368Column 522-70-3.18181818182.9177489177

Column 622-18-0.81818181827.6796536797Column 622-91-4.13636363641.2662337662

ANOVAANOVA




Total1189.7272727273131Total1381.5454545454131

ANOVA-all

st1st2st3st4st5st6st7st8st9st10st11st12Anova: Single Factor

erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4SUMMARY

boel1343-4-5-5445-3-3-5GroupsCountSumAverageVariance

am15555-35-3-5-4-4-5-5Row 16-27-4.50.3

sara155452-2-222-11-3Row 26-7-1.166666666713.7666666667

arvid15443-1-12-2-3-1-1-1Row 3620.333333333319.8666666667

anna15543-4-23-2-5-4-4-4Row 46-26-4.33333333330.6666666667

frida1535-1-13-4-3-4-4-5-5Row 56-1-0.16666666674.5666666667

hanna144441-42453-1-4Row 66-6-12.8

caroline15545-4-4-5-5-5-5-5-5Row 76-16-2.66666666678.6666666667

sofiad14432-4-2-4-5-5-5-5-5Row 86-25-4.16666666670.5666666667

erik153-14-1-1-4-5-5-5-5-5Row 9691.511.5

hillevi14443-3-43-33-4-3-4Row 106-30-50

boel13432-3-25-4-43-3-5Row 116-29-4.83333333330.1666666667

am15243-3-3552-5-4-5

sara11444123-232-1-3

arvid13554512-2-1-1-1-2ANOVA

anna145554-2544-3-4-4Source of VariationSSdfMSFP-valueF crit

frida1554322-1-1-2-5-5-3Between Groups330.93939393941033.09393939395.79056203610.00000686992.0077912666

hanna14433-134-1-12-3-5Within Groups314.3333333333555.7151515152

caroline1555443-3-33-4-4-4

sofiad1342-11-123-1-2-3-5Total645.272727272765


Anova: Single Factor

SUMMARYSUMMARY

GroupsCountSumAverageVarianceGroupsCountSumAverageVarianceSUMMARY

Row 1630.57.9Row 16-27-4.50.3GroupsCountSumAverageVariance

Row 26-3-0.59.9Row 26-7-1.166666666713.7666666667Row 16-29-4.83333333330.1666666667

Row 36-4-0.666666666719.4666666667Row 3620.333333333319.8666666667Row 26-8-1.333333333311.4666666667

Row 46223.666666666710.6666666667Row 46-26-4.33333333330.6666666667Row 36-8-1.333333333317.8666666667

Row 56193.16666666677.7666666667Row 56-1-0.16666666674.5666666667Row 46-2-0.333333333323.8666666667

Row 66142.33333333337.0666666667Row 66-6-12.8Row 5620.33333333337.0666666667

Row 76111.833333333314.9666666667Row 76-16-2.66666666678.6666666667Row 66-5-0.83333333332.1666666667

Row 86142.33333333337.4666666667Row 86-25-4.16666666670.5666666667Row 7620.333333333319.4666666667

Row 96132.166666666710.5666666667Row 9691.511.5Row 86-17-2.83333333333.3666666667

Row 106111.833333333320.5666666667Row 106-30-50Row 96-4-0.666666666710.6666666667

Row 11671.166666666711.3666666667Row 116-29-4.83333333330.1666666667Row 106-15-2.57.5

Row 12691.57.9Row 126-29-4.83333333330.1666666667Row 116-6-19.2

Row 13681.333333333314.2666666667Row 136-8-1.333333333311.4666666667

Row 14671.16666666678.5666666667Row 146-8-1.333333333317.8666666667

Row 15681.333333333312.2666666667Row 156-2-0.333333333323.8666666667ANOVA

Row 166162.66666666672.2666666667Row 16620.33333333337.0666666667Source of VariationSSdfMSFP-valueF crit

Row 176233.83333333332.5666666667Row 176-5-0.83333333332.1666666667Between Groups139.27272727271013.92727272731.35815602840.2242575892.0077912666

Row 186213.57.5Row 18620.333333333319.4666666667Within Groups5645510.2545454545

Row 196213.51.9Row 196-17-2.83333333333.3666666667

Row 206162.66666666673.4666666667Row 206-4-0.666666666710.6666666667Total703.272727272765

Row 216264.33333333330.6666666667Row 216-15-2.57.5

Row 22681.33333333334.2666666667Row 226-6-19.2

ANOVAANOVA


Between Groups223.06060606062110.62193362191.20870279150.25835653091.6527934577Between Groups503.21212121212123.96248196253.0009939460.00010228091.6527934577


Total1189.7272727273131Total1381.5454545454131

Sheet3


erik15-13-1-2-1-5-4-5-4-4-51jonas453314423423


boel1343-4-5-5445-3-3-5cathrin551113331111

am15555-35-3-5-4-4-5-5sanna432213542145

sara155452-2-222-11-31mattias421112221331

arvid15443-1-12-2-3-1-1-1eva a554535445234

anna15543-4-23-2-5-4-4-4

frida1535-1-13-4-3-4-4-5-5

hanna144441-42453-1-4

caroline15545-4-4-5-5-5-5-5-5

sofiad14432-4-2-4-5-5-5-5-5

50413719-24-16-8-20-23-25-34-46jenny423332441311

sofia442113553322


1per-ke545554425253

erik253-14-1-1-4-5-5-5-5-51jens513233223122


boel23432-3-25-4-43-3-5beate lund552232553353

am5243-3-3552-5-4-5

sara21444123-232-1-31mats lund353413342332

arvid23554512-2-1-1-1-2boel h424233422233

anna245554-2544-3-4-4

frida2554322-1-1-2-5-5-3

hanna24433-134-1-12-3-5

caroline2555443-3-33-4-4-4

sofiad2342-11-123-1-2-3-5

424538346-221-91-22-36-451gunnar fag332323331312

1arvid22224422233331

elinskogl55441224452341

elensven54225554533447

sum92867553-18-1813-29-22-47-70-911jimmy55232422211130

johanna44222435223538

1jonas44333523234238

percent0.83636363640.78181818180.68181818180.4818181818-0.1636363636-0.16363636360.1181818182-0.2636363636-0.2-0.4272727273-0.6363636364-0.8272727273karin33444555453449

per/ques-83.6-78.2-68.2-48.216.416.4-11.826.42042.763.682.7klaraward23332211121122

1lars-erik253122334212331

1leopold55555543544555

number_s222120178713695101martin32322242322431

percent10095.454545454590.909090909177.272727272736.363636363631.818181818259.090909090927.272727272740.909090909122.72727272734.54545454550053433221121128

per/ques04.54545454559.090909090922.727272727363.636363636468.181818181840.909090909172.727272727359.090909090977.272727272795.4545454545100sally43333443335341

per/ques04.59.122.763.668.240.972.759.177.395.51001sparx55432244343443

1tomasols55132311112227

1tor45221121143127

sum173.23636363640174.5818181818178.9818181818175.8363636364171.43636363640166.8363636364166.9155.5727272727153.4636363636145.8727272727ulrika54333352444545

015sum716548494656514745494651624

18

33


vder166121316381181113

confidence834853517275527077555057


vder0.05882352940.35294117650.35294117650.70588235290.76470588240.94117647060.17647058820.47058823530.64705882350.47058823530.64705882350.7647058824

confidence834853517275527077555057


1jonas0011110010005jonas41334542423338


3cathrin0001110000003cathrin51113513311126

4sanna0010110110016sanna41223314545236

5mattias0001111110118mattias41112232231123

6eva a0000111110106eva a53455524434549

7jenny0000001111004jenny43332234411131

8sofia0001111110118sofia41213435522335


10per-ke0000000010001per-ke55554422453549

11jens0000001111116jens53323112222329




15boel h0011101010106boel h43423222433234


17arvid0001110001116arvid24224232233231



20jimmy0011110010016jimmy52234512211230

21johanna0001110111118johanna42224425335238

22jonas0001110010105jonas43335433242238

23karin0001110001116karin34445355534449



26leopold01111101111110leopold55555543445555

27martin0001010110116martin32322222424331


29sally0100110011117sally43334333453341

30sparx0000011100014sparx52432544434343


32tor0011110100005tor41221541231127

33ulrika0100110001015ulrika53333442545445

sum1710212528151825101918197sum135839291109125911011109091881206


vder3.030303030321.212121212130.30303030363.636363636475.757575757684.848484848545.454545454554.545454545575.757575757630.30303030357.575757575854.5454545455

confidence0.81818181820.5030303030.55757575760.55151515150.66060606060.75757575760.55151515150.61212121210.66666666670.54545454550.55151515150.5333333333


erik15-13-1-2-1-5-4-5-4-4-5

hillevi143-2-2-3-34-4-43-2-4Anova: Single Factor

boel1343-4-5-5445-3-3-5

am15555-35-3-5-4-4-5-5SUMMARY

sara155452-2-222-11-3GroupsCountSumAverageVariance

arvid15443-1-12-2-3-1-1-1Row 1612221.2

anna15543-4-23-2-5-4-4-4Row 2650.833333333339.7666666667

frida1535-1-13-4-3-4-4-5-5Row 3630.550.3

hanna144441-42453-1-4Row 4630536.8

caroline15545-4-4-5-5-5-5-5-5Row 56355.833333333313.3666666667

sofiad14432-4-2-4-5-5-5-5-5Row 66376.166666666712.5666666667

erik153-14-1-1-4-5-5-5-5-5Row 76325.333333333334.2666666667

hillevi14443-3-43-33-4-3-4Row 86355.833333333314.1666666667

boel13432-3-25-4-43-3-5Row 96294.833333333317.3666666667

am15243-3-3552-5-4-5Row 106376.166666666726.9666666667

sara11444123-232-1-3Row 116152.523.9

arvid13554512-2-1-1-1-2

anna145554-2544-3-4-4

frida1554322-1-1-2-5-5-3ANOVA

hanna14433-134-1-12-3-5Source of VariationSSdfMSFP-valueF crit

caroline1555443-3-33-4-4-4Between Groups288.12121212121028.81212121211.09036697250.38562238182.0077912666

sofiad1342-11-123-1-2-3-5Within Groups1453.33333333335526.4242424242

Total1741.454545454665


erik110223-3-2-9-9-10-9-9-10Anova: Single Factor

hillevi18721-6-77-7-1-1-5-8

boel1686-2-8-79010-6-10SUMMARY

am110798-6220-2-9-9-10GroupsCountSumAverageVariance

sara169893010510-6Row 16-56-9.33333333330.2666666667

arvid18997404-4-4-2-2-3Row 26-15-2.530.3

anna1910980-482-1-7-8-8Row 36-6-142.4

frida11089215-5-4-6-9-10-8Row 46-28-4.666666666727.8666666667

hanna188770-16345-4-9Row 5610.166666666712.5666666667

caroline11010990-1-8-8-2-9-9-9Row 66-11-1.83333333338.9666666667

sofiad17851-3-3-2-2-6-7-8-10Row 76-14-2.333333333342.6666666667

Row 86-42-75.6

Row 9650.833333333335.7666666667

Anova: Single FactorAnova: Single FactorRow 106-45-7.57.5

Row 116-35-5.833333333310.5666666667

SUMMARYSUMMARY


Column 111928.36363636362.4545454545Column 111131.181818181840.9636363636ANOVA

Column 211867.81818181824.7636363636Column 211-29-2.636363636416.6545454545Source of VariationSSdfMSFP-valueF crit

Column 311756.81818181827.5636363636Column 311-22-219.6Between Groups672.75757575761067.27575757583.29685179690.00208837682.0077912666

Column 411534.818181818215.1636363636Column 411-47-4.272727272725.2181818182Within Groups1122.33333333335520.4060606061

Column 511-18-1.636363636415.0545454545Column 511-70-6.363636363610.6545454545

Column 611-18-1.636363636412.8545454545Column 611-91-8.27272727274.6181818182Total1795.090909090965

ANOVAANOVA

Source of VariationSSdfMSFP-valueF critSource of VariationSSdfMSFP-valueF critAnova: Single Factor


Within Groups578.5454545455609.6424242424Within Groups1177.09090909096019.6181818182SUMMARY

GroupsCountSumAverageVariance

Total1741.454545454665Total1795.090909090965Column 111131.181818181840.9636363636

Column 211-29-2.636363636416.6545454545

Column 311-22-219.6

Column 411-47-4.272727272725.2181818182

Column 511-70-6.363636363610.6545454545

Column 611-91-8.27272727274.6181818182

ANOVA

Source of VariationSSdfMSFP-valueF crit

Between Groups6185123.66.30027803520.00009225954.7566572903

Within Groups1177.09090909096019.6181818182

Total1795.090909090965


erik1000000000000

hillevi1000000000000

boel1000000000000

am1000000000000

sara1000000000000

arvid1000000000000

anna1000000000000

frida1000000000000

hanna1000000000000

caroline1000000000000

sofiad1000000000000

*

Interrogative face
Only minor influence of faceFace supporting or confusing Similar to results from Srinivasan & Massaro (2003)Face gestures not good enough?What are face gestures for?Another possibilityExpression of speaker orientation towards addressee (attitude)

*

Recording environment
Recordings of users of public information kiosk

Animated talking-head agent, August

Sept. 1998 Feb. 1999

*

Final rise
Final low
vad heter du?whats your name?

*

Results: final rise

Chart4

3234

3123

1518

What

Where

Percentage of questions

Questions with final rise

rise

ChildrenWomenMenChildrenWomenMen

What323115What222652

Where342318Where122662

rise

00

00

00

What

Where

Percentage of questions

Questions with final rise

Sheet2

00

00

00

What

Where

Number of questions

Distribution of questions

Sheet3

*

Functions of final rises
August database analyzed according to presumed intentions of the speakers (Bell and Gustafson 1999)Socializing or information seeking Men/Women40% socializing60% information seekingChildren50% socializing50% information seeking

*

Perception of a friendly question

*

Subjects and procedure
Pair-wise testWithin pitch level: all stimuli 1-2, 1-3, 1-4, 2-3, 2-4, 3-4Across pitch level: same peak position 1-1, 2-2, 3-3, 4-4Total of 32 stimuli (reversed order 16 + 16)Random order, forced choice, one repetition of each stimulus

TaskChoose the friendlier sounding question of the pair

Subjects14 native speakers of Stockholm Swedish

*

Results

Chart3

5347

5133

6153

5251

High pitch

Low pitch

Peak position

Percent "friendly" responses

Judged as more "friendly" in pair

RAW

OrderStimulusfp1fp2fp3fp4fp5fp6fp7fp8fp9fp10fp11fp12fp13fp14sum14-sum

191100001011000168

2261111100011110095

321010100000101168

4180000010111010059

5810000100000001311

61400000100000001212

751110000000100159

8191001111110010086

9241111000011010186

1041110100011010186

11251000101010111186

12121101000011001068

1311001001111100186

14271011100000010059

151300011100000000311

16211000111101011086

171600000111100000410

1831111001000101186

19310101001011011077

20151011110100010077

21700101000001010410

22200101111100010077

2360100001001101168

242800001100000100311

253211011111010110104

261000000010001001311

27220011110110010077

28171110110100000068

29300101000011111186

30110011111001100077

312311011100111110104

32291110001011110195

Ordered

OrderStimulusfp1fp2fp3fp4fp5fp6fp7fp8fp9fp10fp11fp12fp13fp14sum14-sumStimulus

131100100111110018601

32101010000010116802

183111100100010118603

104111010001101018604

75111000000010015905

236010000100110116806

2170010100000101041017

581000010000000131118

19110000101100016809

261000000010001001311110

30110011111001100077011

12121101000011001068012

151300011100000000311113

61400000100000001212114

20151011110100010077015

171600000111100000410116

28171110110100000068017

4180000010111010059018

8191001111110010086019

22200101111100010077020

16211000111101011086021

27220011110110010077022

312311011100111110104123

9241111000011010186024

11251000101010111186025

2261111100011110095026

14271011100000010059027

242800001100000100311128

32291110001011110195029

29300101000011111186030

19310101001011011077031

253211011111010110104132

stim_score

Stimulus123411121314

86868698

64101153117

83686768

32741112710

86587787

941086595

666879113

567498710

5337595759576858448

stim_score

Stimulus

Number of responses

Sheet3

5337595759576858

47.321428571433.035714285752.678571428650.892857142952.678571428650.892857142960.714285714351.7857142857

High pitch53516152

Low pitch47335351

Sheet3

High pitch

Low pitch

Peak position



*

Results

Chart3

46.428571428653.5714285714

28.571428571471.4285714286

Test pairs


Peak position

RAW


191100001011000168

2261111100011110095

321010100000101168

4180000010111010059

5810000100000001311

61400000100000001212

751110000000100159

8191001111110010086

9241111000011010186

1041110100011010186

11251000101010111186

12121101000011001068

1311001001111100186

14271011100000010059

151300011100000000311

16211000111101011086

171600000111100000410

1831111001000101186

19310101001011011077

20151011110100010077

21700101000001010410

22200101111100010077

2360100001001101168

242800001100000100311

253211011111010110104

261000000010001001311

27220011110110010077

28171110110100000068

29300101000011111186

30110011111001100077

312311011100111110104

32291110001011110195

Ordered


131100100111110018601

32101010000010116802

183111100100010118603

104111010001101018604

75111000000010015905

236010000100110116806

2170010100000101041017

581000010000000131118

19110000101100016809

261000000010001001311110

30110011111001100077011

12121101000011001068012

151300011100000000311113

61400000100000001212114

20151011110100010077015

171600000111100000410116

28171110110100000068017

4180000010111010059018

8191001111110010086019

22200101111100010077020

16211000111101011086021

27220011110110010077022

312311011100111110104123

9241111000011010186024

11251000101010111186025

2261111100011110095026

14271011100000010059027

242800001100000100311128

32291110001011110195029

29300101000011111186030

19310101001011011077031

253211011111010110104132

stim_score


86868698

64101153117

83686768

32741112710

86587787

941086595

666879113

567498710

5337595759576858448

stim_score

0

0

0

0

0

0

0

0

0

Stimulus

Number of responses

stim_procent

5337595759576858

47.321428571433.035714285752.678571428650.892857142952.678571428650.892857142960.714285714351.7857142857

High pitch53516152

Low pitch47335351

stim_procent

00

00

00

00

High pitch

Low pitch

Peak position



stim_wins

5337595759576858

47.321428571433.035714285752.678571428650.892857142952.678571428650.892857142960.714285714351.7857142857

1 to 32630

High pitch11222 to 31640

Low pitch00211 to 1820

2 to 2820

3 to 31414

1 to 346.428571428653.5714285714

High pitch01012 to 328.571428571471.4285714286LowHigh

Low pitch14011 to 128.571428571471.42857142861 to 128.571428571471.4285714286

2 to 228.571428571471.42857142862 to 228.571428571471.4285714286

3 to 350503 to 35050

4 to 428.571428571471.4285714286

stim_wins

00

00

Test pairs

Distribution in percent

Peak position

00

00

00

00

Low

High

Test pairs


Peak height

Chart4

28.571428571471.4285714286

28.571428571471.4285714286

5050

28.571428571471.4285714286

Low

High

Test pairs


Peak height

RAW


191100001011000168

2261111100011110095

321010100000101168

4180000010111010059

5810000100000001311

61400000100000001212

751110000000100159

8191001111110010086

9241111000011010186

1041110100011010186

11251000101010111186

12121101000011001068

1311001001111100186

14271011100000010059

151300011100000000311

16211000111101011086

171600000111100000410

1831111001000101186

19310101001011011077

20151011110100010077

21700101000001010410

22200101111100010077

2360100001001101168

242800001100000100311

253211011111010110104

261000000010001001311

27220011110110010077

28171110110100000068

29300101000011111186

30110011111001100077

312311011100111110104

32291110001011110195

Ordered


131100100111110018601

32101010000010116802

183111100100010118603

104111010001101018604

75111000000010015905

236010000100110116806

2170010100000101041017

581000010000000131118

19110000101100016809

261000000010001001311110

30110011111001100077011

12121101000011001068012

151300011100000000311113

61400000100000001212114

20151011110100010077015

171600000111100000410116

28171110110100000068017

4180000010111010059018

8191001111110010086019

22200101111100010077020

16211000111101011086021

27220011110110010077022

312311011100111110104123

9241111000011010186024

11251000101010111186025

2261111100011110095026

14271011100000010059027

242800001100000100311128

32291110001011110195029

29300101000011111186030

19310101001011011077031

253211011111010110104132

stim_score


86868698

64101153117

83686768

32741112710

86587787

941086595

666879113

567498710

5337595759576858448

stim_score

0

0

0

0

0

0

0

0

0

Stimulus

Number of responses

stim_procent

5337595759576858

47.321428571433.035714285752.678571428650.892857142952.678571428650.892857142960.714285714351.7857142857

High pitch53516152

Low pitch47335351

stim_procent

00

00

00

00

High pitch

Low pitch

Peak position



stim_wins

5337595759576858

47.321428571433.035714285752.678571428650.892857142952.678571428650.892857142960.714285714351.7857142857

1 to 32630

High pitch11222 to 31640

Low pitch00211 to 1820

2 to 2820

3 to 31414

1 to 346.428571428653.5714285714

High pitch01012 to 328.571428571471.4285714286LowHigh

Low pitch14011 to 128.571428571471.42857142861 to 128.571428571471.4285714286

2 to 228.571428571471.42857142862 to 228.571428571471.4285714286

3 to 350503 to 35050

4 to 428.571428571471.4285714286

stim_wins

00

00

Test pairs


Peak position

00

00

00

00

Low

High

Test pairs


Peak height

*

Audiovisual stimuli I

*

Info face
Early low (F0 peak) Late high

*

Friendly face
Early low (F0 peak) Late high

*

Results: face from parameters
Scores from 27 subjects

Chart2

3679

134186

early low peak

late high peak

Cumulative score

"Friendliness" score

RAW1

OrderStimulusfp1fp2fp3fp4fp5fp6fp7fp8fp9fp10fp11fp12fp13fp14fp15fp16fp17fp18fp19fp20fp21fp22fp23fp24fp25fp26fp27sum

1433333333433433323442233333281

2233222223322222232233332222364

3121111112111111111111111111230

4221223333323323223343332242371

5122112222211111111121221222241

6322212322312122111223321233354

7433343433433433224344343344490

8322212222312222112212222233252

9121312122122212112122222221246

10233333423323323233444433332280

11332222312222212112223222223254

12444444333444444223334434444396

2

Ordered_stim1


31.121111112111111111111111111230117

51.222112222211111111121221222241

91.321312122122212112122222221246

22.133222223322222232233332222364215

42.221223333323323223343332242371

102.333333423323323233444433332280

63.122212322312122111223321233354160

83.222212222312222112212222233252

113.332222312222212112223222223254

14.133333333433433323442233333281267

74.233343433433433224344343344490

124.344444333444444223334434444396

(stimulus 2and3 change places)

StimulusScore "friendliness"

11736

16079

215134

267186

infoearly peak36

infolate peak79

socialearly peak134

sociallate peak186

early low peaklate high peak

info face3679

friendly face134186

Ordered_stim1

early low peak

late high peak

Cumulative score


RAW2


13.123222122223223212231322222256

25.132312132222123123222232232257

34.123233222333333313323333243272

42.112111111223122112111121122138

56.124333132234323234234233333376

61.111111111111112122111211111131

76.233333232334233233334343333481

83.233323322222323321233222323265

95.233332332234223212242222232266

104.224231323442334223323432343377

113.333121333333323311232323243166

121.211111111212111111111111112130

132.211211111211212211212211222138

141.312211111211112112121211112135

156.343233233334333323243332333379

165.332333332333223213223223232267

174.333344333433343312332344343384

182.312211212232222211122122122246

Ordered_stim2

OrderStimulusfp1fp2fp3fp4fp5fp6fp7fp8fp9fp10fp11fp12fp13fp14fp15fp16fp17fp18fp19fp20fp21fp22fp23fp24fp25fp26fp27sumStimulus

61.111111111111112122111211111131961.1

121.2111111112121111111111111121301.2

141.3122111112111121121212111121351.3

42.1121111112231221121111211221381222.1

132.2112111112112122112122112221382.2

182.3122112122322222111221221222462.3

13.1232221222232232122313222222561873.1

83.2333233222223233212332223232653.2

113.3331213333333233112323232431663.3

34.1232332223333333133233332432722334.1

104.2242313234423342233234323433774.2

174.3333443334333433123323443433844.3

25.1323121322221231232222322322571905.1

95.2333323322342232122422222322665.2

165.3323333323332232132232232322675.3

56.1243331322343232342342333333762366.1

76.2333332323342332333343433334816.2

156.3432332333343333232433323333796.3

StimulusScore "friendliness"

9615

12241

187106

233152

190109

236155

early low peaklate high peak

angry face1541

happy face106152

neutral face109155

Ordered_stim2

early low peak

late high peak

Cumulative score


Ordered_H2

OrderStimulusfp1fp2fp3fp4fp5fp6fp7fp8fp9fp10fp11fp12fp13fp14fp15fp16fp17fp18fp19fp20fp21fp22fp23fp24fp25sum25-sumStimulus

13100110110001001000000000006191

3200000101110000010100000017182

18301111111111111111111100112233

10400010110000001110001000007184

7501010101111101111010011011695

23601011101111111110110111112056

217100001011110010001100101112137

5801101101111111111110011112058

1910111101011111111111111112239

2610001011110111011010111110117810

3011011111011111111111011111122311

1212101111100111011111111111121412

1513111111101111110111000111120513

6140011110011101001100000110121314

2015001111111111111111111111123215

1716001111100101111110011110117816

28171001110011101001000101000111417

418111110100110111110111010017818

819101100100000000000011000061919

2220100111101111011011101100016920

16211111101000110000010100100111421

2722110000100000010000100000052022

3123100110100101111011011011116923

924100100100000100000010000052024

1125000001100000000000000000022325

226010100100000100000001000052026

1427101000000000000000001000032227

2428100001001100100100000000061928

3229000000001000000000100000022329

2930000000100000110000011000052030

1931100000100000000001000000032231

2532110000010110110001000000081732

stim_score_H2


1967221871620

11148191691420

18131220981722

17169201152022

3532253421

6522353619

5132820122317

253823202217

81774614210767122158800

stim_score_H2

0

0

0

0

0

0

0

0

0

Stimulus

Number of responses

stim_procent_H2

81774614210767122158

40.538.5237153.533.56179

High pitch53.533.56179

Low pitch40.538.52371

stim_procent_H2

00

00

00

00

High pitch

Low pitch

Peak position



stim_wins_H2

LowHigh

***1 to 11486

81774614210767122158*2 to 23664

40.538.5237153.533.56179***3 to 31090

**4 to 43268

1 to 26436100**p

Documents

On the interaction of audio and visual cues to friendliness in interrogative prosody