35
Signal Processing of Auditory Responses from Magnetoencephalography (MEG) Jonathan Z. Simon Department of Electrical & Computer Engineering Department of Biology University of Maryland, College Park

Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

  • Upload
    ngoliem

  • View
    215

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Signal Processing ofAuditory Responses fromMagnetoencephalography (MEG)Jonathan Z. Simon

Department of Electrical & Computer EngineeringDepartment of Biology

University of Maryland, College Park

Page 2: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

ComputationalSensorimotorSystemsLaboratory

CollaboratorsDavid PoeppelNikos KanlisDidier Depireux

StudentsAhmad GheithJuanjuan Xiang

Lab ManagersShantanu RayJeff Richardson (CNL)

Special ThanksShihab ShammaTony Owens

Page 3: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Outline

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

Page 4: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Functional Imaging

Non-invasive recordingfrom human brain(Functional brainimaging)

Positron emissiontomographyPET

Functional magneticresonance imagingfMRI

ElectroencephalographyEEG

Excellent spatial resolution( ~ 1-2 mm)

Poor temporal resolution( ~ 1 s)

Poor spatial resolution( ~ 1 cm)

Excellent temporal resolution( < 1 ms)

Hemodynamictechniques

Electromagnetictechniques

MagnetoencephalographyMEG

PET, EEG requireacross-subjectaveraging

fMRI and MEG cancapture effects insingle subjects

Page 5: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

MEG Magnetic Signal

Non-invasive measurementDirect measurement

~ 104 neurons

Page 6: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Magnetic Field Strengths

Earth field

Urban noise

Contamination at lung

Heart QRS

MuscleFetal heart

Spontaneous signal(α-wave)

Signal from retina

Intrinsic noise of SQUID

Inte

nsity

of m

agn

etic

sig

nal( T

)

Evoked signal

Biomagnetism

EYE (retina) Steady activity Evoked activity

LUNGS Magnetic contaminants

LIVER Iron stores

FETUS Cardiogram

LIMBS Steady ionic current

BRAIN (neurons) Spontaneous activity Evoked by sensory stimulation

SPINAL COLUMN (neurons) Evoked by sensory stimulation

HEART Cardiogram (muscle) Timing signals (His Purkinje system)

GI TRACK Stimulus response Magnetic contaminations

MUSCLE Under tension

~ 104 neurons

Page 7: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Magnetic Flux Detectors

Superconductivity

Magnetic flux quantization

Josephson Effect

SQUID = Superconducting QuantumInterference Device

= 2 eh

= 2.07 10 WbΦ0 × -15

= 2 eh

= Φ n n Φ0

Page 8: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Sensor ConfigurationsNoise reduction fromDifferential measurement

Planar type

Magnetometer Gradiometer

Axial type

50 mm base line

Page 9: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Magnetically Shielded Room

Page 10: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

MEG

MEG (vs. EEG)

EEG

Temporal resolution high as EEGFast, easy set-upMagnetic fields are not attenuated,unlike electric fields

Higher spatial resolution

ExpensiveInverse problem worse(?)

Complementary Techniques

Page 11: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

Outline

Page 12: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Sensor Layout

Recording from 160 channelsResponse peak at 98 ms after onset of an auditory stimulus,in the left and right temporal lobes.

Page 13: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Butterfly Plot

Overlay of all channels above right temporal lobe

Response peak at 98 ms after onset of an auditory stimulus

Page 14: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Contour Plot

Distribution of magnetic field at peak response

t = 98 ms

Page 15: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Magnetic Source Imaging

MEG + MRI

Dipole fit at response peak, 98ms after onset of stimulus

Page 16: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

M100 Latency

Latency decreases withincreasing harmonics

M100 PeakLatency decreases withincreasing frequency

Page 17: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

Outline

• Introduction to MEG

• Auditory MEG Signals

Page 18: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

MEG Variability

dp4_500_R2_2-2_no_A108.par

Page 19: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

We should be able to do betterthan mean and variance of responses tomultiple presentations of one stimulus

Jitter across responses cancelso we lose variance of latencies

Coherence across channels ignored

Blind Source Separation (BSS)? ICA…

Beyond Averaging

Page 20: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

X

W

U Y

g()

mixedrecordings

unknownmixingprocess

blindseparation

Independent Component Analysis (ICA)(1) unmixes the separate sources’ activity, and(2) reduces the information overlap between components

estimatedindependentcomponents

uniformlydistributedindependentcomponents

non-linearity

Learned weights approximateinverse of mixing matrix

Independent Component Analysis

Page 21: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

MEG Waveform & ICAIndependent Component Analysis

Page 22: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Independent Component Analysis

Page 23: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

Outline

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Spectral/Frequency Methods

Page 24: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Systems Theory and Speech• Speech

Broadband, DynamicSpectrotemporally richAlgorithmically complex

• Systems TheoryComplex objects can beexpressed as sum of simplerobjects

• Dynamic RipplesBroadband, DynamicSpectrotemporally richAlgorithmically Simple

Page 25: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

.25

.5

1

2

4

8

0 250Time (ms)

Fre

quen

cy (

kHz)

Fourier Spacerepresentation

Ω

-0.4 cyc/oct

w4 Hz–4 Hz

0.4 cyc/oct

The Fourier transformof a single movingsinusoid has supportonly on a single point(and its complexconjugate).

Spectro-Temporal representation(Spectrogram)

S(t,x)= sin(2πwt + 2πΩx + φ)

x = log2(f / f0)w = ripple velocity,

e.g. 4 Hz = 4 cycles/sΩ = ripple density,

e.g. 0.4 cycles/octave= 2 cycles/5 octaves

c.f. visualcontrast gratings

Simple Spectrally Dynamic Stimulus

∫ [.] exp(±2πjΩx±2πjwt)

w = 4 Hz

Ω = 0.4 cyc/oct

Single Moving Ripple

Page 26: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Miniature EEG

Page 27: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Cortical Surface EEG Before ICA

Page 28: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

ICA & Cortical Surface EEG

Page 29: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

ICA Reveals Cortical Traveling Wave

Page 30: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

• Spectral/Frequency Methods

Outline

• Introduction to MEG

• Auditory MEG Signals

• Independent Component Analysis(ICA)

• Ripple Stimuli & ICA with EEG

Page 31: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

0 5 10 15 20 25 30

0

16 H

z, 2

c/o

8 H

z, 2

c/o

4 H

z, 2

c/o

Nor

mal

ized

diff

eren

ce (

dB)

Frequency (Hz)

Max Mean Power Spectral DensityR – L

Power Spectral Density Follows Ripple Speed

!"

#$% &

Page 32: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

Asymmetric Sampling in Time (AST)

Page 33: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

0 10 20 30 40 50 60

-0.8

-0.4

0

0.4

0.8

noise.5,1.5,2.5,4.5,8.5,162,12,22,42,82,16

Frequency (Hz)

Total Power Spectral Density L – R

Pow

er D

ensi

ty A

sym

met

ry (

dB)

Total Power Spectra: Hemispheric Asymmetry

$" '"

"" &()*+',-

!"

#$% &

Page 34: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic

'".

$( ' /

00 1 (

23.---

4

56$"

!. #"

." "

( "!

"

7" "8--" "

Conclusions

Page 35: Department of Biology Jonathan Z. Simon - UMD · PDF fileSignal Processing of ... Owens. Outline • Introduction to MEG ... Systems Theory and Speech • Speech Broadband, Dynamic