Computation for Sound ProcessingPsycho

Georg Essl

Psychology of (Re)Cognition

• Cognition is• Vision

• Audition

• Touch, Smell, Taste, …

• … and recognition of stuff!

• What is this “stuff?”

• When do we confuse “stuff?”

Don’t Give Me That Weird Eye

• Psychological Effects in Vision

• Ambiguity

• Categorical Seeing

• Mis-Classification

• Absurd Constructions

• Perspective/Depth Assumptions

• Color, Size, Relation, Orientation …

Canonical Ambiguities

Canonical Ambiguities

Necker Cube Schroeder Stairs

Illusions

• When we get “stuff” wrong• Size

• Shape

• Color

Size Illusion

• Size and Distance – Mario Ponzo

Size Illusion

• Size and Color – Joseph Jastrow

Size Illusions

• Size and Angles – Mueller & Lyer

Size Illusion

• Size and Angle (2) - Sander

Size Illusions

• Size and Perspective – Roger Shepard

Size Illusion

• Object Size

Shape Illusion

• Bristol Café – Richard Gregory

Shape Illusion

Zoellner

Shape Illusions

Shape Illusions

• Orbison

Color Illusion

• Hermann Grid

Color Illusion

• Checker Shadow – Ted Adelson

Color Illusion

• Checker Shadow – Ted Adelson

Color Illusion

Bridget Riley – “Movement in Squares”Bridget Riley – “Movement in Squares”

Moving Illusion

• Ouchi Illusion

Fill in the Blanks

• Seeing what isn’t there

• Kanisza figure

Quickly – False Reality

• Messed Up Visuals

• Geometry

• Representation

• Categories

M. C. Escher

Pieter Buegel - 'The Magpie on the Gallows' (1568)

Oscar Reutersvaerd

Salvatore Dali - “Invisible Afghan with the Apparition on the Beach of the Face of Garcia Lorca in the Form of a …”

Salvatore Dali - “Swans reflecting elephants“

Salvatore Dali - “Fifty Abstract Pictures Which ... Appear as the Head of a Royal Bengal Tiger”

Rene Magritte

OK, Enough Vision

• Sound Illusions exist too.

• Merging to Beats (2)

• Masking (3)

• Completion (5)

• “Common Fate” (6)

Sound

• Cocktail Party Effect (22)

• Precedence Effect (23)

• Musical Groupings (31-33)

• Separations of Melodies (34)• Frequency distance, Volume, Timbre

Sound

• Voice Separation:

• Wessel Loop (36)

• Musical Example, two melody play on violin (37)

Word/Phoneme Groupings

• Silence gaps: Ara ala -> Arda Alga (46)

• Gray ship or not (47)

Melody Recognition

• Shepard Tritone Paradox (52)

• Scrambled Melodies (53)

Musical Escher

• Infinite Upward Motion

• Risset glissando (54)

• Original discrete Shepard tones (55)

• Tempo Illusions• Risset, Ligeti (56)

• More Shepard (57)