Upload
phamdan
View
219
Download
0
Embed Size (px)
Citation preview
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Ultrasound Research in Linguistics
Diana Archangeli and Jeff MielkeUniversity of Arizona
October 8, 2005
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Why to image
Acoustic analysis doesn’t tell us everything about speech.Articulatory imaging is important for:
I analyzing the articulatory parameters of speech
I studying sounds which can be articulated in more than oneway (e.g. American English /r/)
I studying articulatory trade-offs such as tongue backness/liprounding or tongue height/pharynx expansion.
I real-time feedback for second-language learners and people inspeech therapy.
I . . .
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
How to image
Several different technologies are available for imaging the vocaltract, such as:
I X-ray
I MRI
I EMMA
I X-ray microbeam
I ultrasound
Each has its own set of advantages and disadvantages. . .
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
X-ray
X-ray imaging works becausex-rays are variably obstructedby different types of tissueaccording to their density.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
X-ray pros and cons
Pros
I high temporal resolution
I locates tongue in mouth
I images entire length ofvocal tract
Cons
I expensive
I not portable
I toxic
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
MRI (Magnetic Resonance Imaging)
MRI works because hydrogenin tissue is jiggled by a strongmagnetic field.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
MRI pros and cons
Pros
I non-toxic
I beautiful pictures
I locates tongue in mouth
I images entire length ofvocal tract
I 3-dimensional imaging
Cons
I scary for some
I subject must lie down andcan’t move
I very noisy
I poor temporal resolution
I expensive
I not portable
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
EMMA (ElectroMagnetic Midsagittal Articulometry)
EMMA works because receiver coilsglued to the vocal tract report theirdistance from three stationarytransmitter coils.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
EMMA pros and cons
Pros
I non-toxic
I precise data points(on tongue)
I high resolution
I good temporal resolution
Cons
I invasive
I expensive
I not portable
I tongue tip and blade only
I must blow-dry tongue(to glue pellets)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
X-ray microbeam (images from U. of Wisconsin Med. Sch.)
Uses a narrow x-ray beam to track gold pellets.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
X-ray microbeam pros and cons
Pros
I less toxic than older x-rayimaging
I precise data points(on tongue)
I high resolution
I good temporal resolution
Cons
I invasive
I expensive
I not portable
I front of tongue only
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Ultrasound
Ultrasound works byemitting high-frequencysound waves which arereflected back to thetransducer by surfaceswith sharp changes indensity.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Ultrasound pros and cons
Pros
I non-toxic
I high temporal resolution(30+ fps)
I inexpensive
I portable
I subjects are comfortable
Cons
I picture can be grainy
I shows tongue only (nopassive articulators)
I limited to area betweenthyroid cartilege and frontof mandible (which castshadows)
I difficult fixed pointidentification
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Pros and cons highlights/summary
safe
por
table
inex
pen
sive
hig
hre
solu
tion
hig
hte
mpor
alre
s.
pas
sive
artic.
whol
evo
caltr
act
surfac
es(n
otpoi
nts
)
3D
X-ray x x x x x
MRI x x x x x x
EMA x x x
X-ray microbeam ? x x
Ultrasound x x x x x
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Pros and cons highlights/summary
safe
por
table
inex
pen
sive
hig
hre
solu
tion
hig
hte
mpor
alre
s.
pas
sive
artic.
whol
evo
caltr
act
surfac
es(n
otpoi
nts
)
3D
X-ray x x x x x
MRI x x x x x x
EMA x x x
X-ray microbeam ? x x
Ultrasound x x x x x
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Pros and cons highlights/summary
safe
por
table
inex
pen
sive
hig
hre
solu
tion
hig
hte
mpor
alre
s.
pas
sive
artic.
whol
evo
caltr
act
surfac
es(n
otpoi
nts
)
3D
X-ray x x x x x
MRI x x x x x x
EMA x x x
X-ray microbeam ? x x
Ultrasound x x x x x
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Pros and cons highlights/summary
safe
por
table
inex
pen
sive
hig
hre
solu
tion
hig
hte
mpor
alre
s.
pas
sive
artic.
whol
evo
caltr
act
surfac
es(n
otpoi
nts
)
3D
X-ray x x x x x
MRI x x x x x x
EMA x x x
X-ray microbeam ? x x
Ultrasound x x x x ? ? x ?
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Ultrasound imaging
I Ultrasound imaging employs high-frequency sound waves togenerate images of objects.
I Abrupt changes in density create echoes.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Ultrasound imaging of the vocal tract
I The tongue-air interface is strongly echogenic (because of thelarge difference in density between air and muscle)
I An ultrasound transducer placed beneath the chin can producea real-time movie of the full length of the tongue surface.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
An ultrasound image of the tongue
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
An ultrasound image of the tongue
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
An ultrasound image of the tongue
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
An ultrasound image of the tongue
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
An ultrasound image of the tongue
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Reasons to imageArticulatory imaging technologiesHow ultrasound imaging worksInterpreting ultrasound imagesDemonstration
Things to look at:
I /a/ vs. /i/ vs. /u/
I tense and lax vowels
I Clear /l/ vs. dark /l/
I Retroflex /r/ vs. bunched /r/
I Grooved vs. non-grooved fricatives
I Front /k/ vs. back /k/
I /h/ before different vowels
I . . .
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate obscured by air
The ultrasoundtransducer’s field ofview:
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate obscured by air
Normally there is airbetween the tongue andthe palate.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate obscured by air
The tongue-airinterface is quiteechogenic.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate obscured by air
This makes the top ofthe tongue imagebrightly.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate obscured by air
Nothing beyond thetongue is visible.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate visible through water
The space between thetongue and palate canbe filled with water.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate visible through water
Sound waves are nolonger impeded by thesurface of the tongue(because tongue-water isless echogenic thantongue-air)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate visible through water
This makes thesurfaces of the palateappear in the image.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Palate visible through water
The tongue is lessvisible.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
An ultrasound image of the palate
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
An ultrasound image of the palate
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
An ultrasound image of the palate
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
An ultrasound image of the palate
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
An ultrasound image of the palate
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Tongue image. . .
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
. . . Palate image
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Tongue+Palate image
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Problem. . .
The head and transducer can move
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Flashlights
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head stabilization: HATS (http://speech.umaryland.edu/ahats.html)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head stabilization: HATS cont’d
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head stabilization: UQAM (Menard et al. 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head movement correction: UBC’s optotrak (photo: Campbellet al. 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head movement correction: UBC’s optotrak cont’d
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Head movement correction: Palatron
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Signal paths
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
SonoSite TITAN and C-11 transducer
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Camcorder and microphone preamplifier
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Video mixer and Digital Video recorder
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
APIL subject in chair
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
APIL subject in chair
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
APIL subject in chair
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
A palate image
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
The palate image after transformation
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Traced palate surfaces
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
Tracings from several palate images
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
A composite palate tracing
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
A tongue image ([u])
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
The tongue image after transformation
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
The tongue image after measurement
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Imaging the palateHead movementUltrasound data extraction and analysis
The tongue image with measurements
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Speech applications of ultrasound
I documenting languages in the field or laboratory
I 2nd language acquisition and speech therapy
I in the clinic (e.g. for partial glossectomy patients or patientswith orthodontic appliances)
I in linguistics, analyzing many aspects of speech that are notobvious from the acoustic record
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Brugman (2005): Pharyngeal Vowels in N|u
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Brugman (2005): Pharyngeal Vowels in N|u
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
A field setup (Gick and Wilson 2005, Namdaran in prep)
I Special chair
I SonoSite
I Desktop mic standw/counterweighted arm
I Lapel mic
I Mini mic amp
I Sony miniDV cam
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
The University of South Florida audiovisual phonemedatabase (Frisch et al. 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Ultrasound in the ESL Classroom (Meadows et al. tomorrow)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Impact of an orthodontic palatal expander appliance ontongue movement and speech (Bressmann et al. 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
The phonetics of speech errors (Frisch et al. 2005)
Alveolar targets Velar targets
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Transparent vowels in Hungarian (Benus 2005)
Transparent vowels in front harmony contexts are less retractedthan transparent vowels in back harmony contexts.
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Gestural Timing and Magnitude of English /r/ (Campbellet al. 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Syllabic position effects in articulation (Davidson 2005)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
American English /r/ production strategies
bunched: crow retroflex: prose
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Articulatory similarity between segments: measurements
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Articulatory similarity between segments: measurements
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Articulatory similarity between segments: measurements
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
Articulatory similarity between segments: results
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
In the fieldIn the classroomClinical ultrasoundIn linguisticsExisting labs
I University of Arizona
I University of British Columbia
I Haskins Laboratories
I University of Maryland-Baltimore
I New York University
I Universite du Quebec a Montreal
I Queen Margaret University College
I University of South Florida
I University of Toronto
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Setting up an ultrasound labSoftware
Equipment used in an ultrasound lab
Ultrasound machine $30,000video camera $1,000video mixer $1,000computer $1,000video software $500imaging software $100video recorder $1,000microphone $100preamplifier $100chair and tableincidentals such as gel, tissue, wipes
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Setting up an ultrasound labSoftware
Software used in an ultrasound lab
Applications
I Image-J (NIH)
I Adobe Photoshop or Corel PHOTO-PAINT (not open source)
I Final Cut Express (not open source)
Ultrsound-specific
I Ultra-CATS (Toronto)
I EdgeTrak (Maryland)
I Surfaces (Maryland)
I QT Extractor (Arizona)
I Palatron (Arizona)
I Glossotron (Arizona)
I Measure-o-tron (Arizona)
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics
Imaging and ultrasound basicsMethodology
Speech applicationsPractical concerns
Demonstration
Time for trying out the machine. . .
Diana Archangeli and Jeff Mielke University of Arizona Ultrasound Research in Linguistics