Upload
others
View
26
Download
0
Embed Size (px)
Citation preview
Week 1 – The Speech Chain
Mark Huckvale
Speech Science as a field of Psychology
2
3
Last common ancestor ~ 8million years ago Bipedalism ~ 3.5 million years ago Language ~ 200,000-50,000 years ago Written Language ~ 5,000 years ago
Modern Chimpanzee Modern Human
4
Physiologically, speech is an overlaid function, or to be more precise, a group of overlaid functions. It gets what service it can out of organs and functions, nervous and muscular, that have come into being and are maintained for very different ends than its own. [Sapir, 1921].
5
6
Speech Science
Cognitive Psychology
Anatomy & Physiology
Acoustics
Hearing Linguistics Pragmatics
7
Speech Science
Cognitive Psychology
Anatomy & Physiology
Acoustics
Hearing Linguistics Pragmatics
What does Speech Science study?
8
Speech Science
• Speech Science is the experimental study of speech communication, involving speech production and speech perception as well as the analysis and processing of the acoustic speech signal
• Speech Science has its origins in Phonetics, which is the branch of linguistics that studies the sounds of speech.
• Speech Science differs from Phonetics in that it makes use of empirical investigations to develop quantitative explanatory models of the characteristics of speech sounds and the effects of speech sounds on the listener.
9
Speech Science Questions
• How is speech planned and executed by the vocal system? • How do the acoustic properties of sounds relate to their
articulation? • How and why do speech sounds vary from one context to
another? • How do listeners recover the linguistic code from auditory
sensations? • How do infants learn to produce and perceive speech? • How and why do speech sounds vary between speakers? • How and why do speech sounds vary across speaking styles
or emotions?
10
Speech Science Applications
• Systems for the automatic recognition of speech
• Systems for converting text to speech
• Systems for speaker authentication
• Assessment and therapy for disorders of speech and hearing
• Monitoring of well-being
• Forensic speaker comparison
• Language pronunciation teaching
11
The Speech Chain
12
The Speech Chain
13
Process Knowledge
Intention
Decide how to achieve effect in listener World knowledge, empathy with listener
Meaning
Create utterance having required meaning from
words
The Grammatical Code: Meanings of words,
grammar
Utterance
Look up word pronunciations in mental lexicon,
decide on prosody
The Phonological Code: Pronunciations of words,
meaning of prosody
Articulatory plan
Execute motor plan for articulator movement Auditory consequences of articulation
Articulation
Aero-acoustic properties of articulation
Sound
Propagation of pressure waves from speaker to
hearer. Stimulation of auditory system.
Auditory response
Explanation of audition in terms of word
sequences
Auditory consequences of articulation,
pronunciation of words, likelihood of word
sequences
Word sequence
Recover utterance meaning from word sequence Meanings of words, grammar
Meaning
Recover intention of speaker World knowledge, empathy with speaker
Understanding
14
Intention Meaning
15
Meaning Utterance
16
Meaning Utterance
17
poor John lost his watch
Meaning Utterance
18
S
NP VP
ADJ N V NP
PRON N
poor John lost his watch
Utterance Articulatory Plan
19
Articulatory Plan Articulation
20
Larynx Jaw
Tongue
Lips Soft Palate
20
21
How do we articulate fricative sounds?
22
Articulation Sound
23
Waveform
Spectrogram
Pitch Track
Sound Auditory Response
24
Auditory Response -> Words
25
Ambiguity
26
Meaning Speakers Intentions
• “I’m feeling thirsty” -> get me a drink
• “Can you tell me the time?” -> what is the time?
• “Wonderful weather we’re having” -> it’s terrible weather isn’t it?
28
Meaning Speakers Intentions
• Don’t make your contribution more informative than necessary – A (to a foreigner she’s only just met): So where are you
from? B: Louwesveg 1, 1066 EA, Amsterdam, The Netherlands, Europe
• Don’t say things for which you don’t have evidence – I think there is a supermarket round the corner, but I’m a
stranger here
• Be brief and unambiguous – She was entirely dressed in articles of clothing and had
nothing on her feet except a pair of socks and two shoes.
29
Pragmatics
History of Speech Science
30
31
Big Ideas Today
• Human spoken language re-uses mammalian anatomy and physiology for vocalisation and hearing to create a communication system of complexity beyond any other animal.
• The form of speech is thus contingent on the nature of our vocal apparatus, our hearing, our cognition and our social structures.
• Speech science seeks explanations for the form of spoken language through study of the processes of speaking, listening, language acquisition and language evolution.
• Speech Science is an experimental science that sits at the crossroads of many other disciplines; it has developed its own explanatory models which have in turn been developed into many practical technologies.
• The Speech Chain is a simple model of spoken communication that highlights the transformation of an intention in the mind of the speaker to an understanding of that intention in the mind of the listener through processes that involve the Grammatical Code, the Phonological Code, articulation, sound, hearing and perception.
32
Laboratory Session
• Wednesday Speech Science Lab B07
– 10.00-11.30 Group 1
– 11.30-13.00 Group 2
• How do sounds differ from one another?
• Tutorial session
– Bring questions about lecture or readings
– Bring answers to “Reflections” on handout
33