67
Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann @cnbc.cmu.edu 268-2790 •URL: http://www.cnbc.cmu.edu/~behrmann

Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: [email protected] 268-2790 URL: behrmann

Embed Size (px)

Citation preview

Page 1: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Spatial representation and parietal cortex

Marlene Behrmann Department of Psychology,

CMU and CNBC

Contact: [email protected]

•URL: http://www.cnbc.cmu.edu/~behrmann

Page 2: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 3: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Division of labour in human visual cortical system

Page 4: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Mishkin and Ungerleider

Page 5: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 6: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 7: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 8: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

The parietal lobes:• “crossroads of the brain”

(Critchley, 1953)

• well situated

topographically

• multimodal

• requisite cortical and subcortical connectivity

• Distribution of MCA, little collateral supply

InferiorParietal lobule

Supramarginalgyrus

Angulargyrus

Page 9: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Neglect

Page 10: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Federico Fellini (1920-1993)

Page 11: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

*

• Asymmetry in incidence: RH (66%) in humans not monkeys

• Inferior parietal lobule– Areas 39 and 40;

– non-human primate analog: IPL (7) vs STS

– bimodal: short-lived vs persistent

• Affects different sensory modalities

• Not sensory deficit

*

Neglect

Page 12: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Not just parietal

• Distributed network: (Mesulam; Heilman)– dorsolateral prefrontal, medial frontal (cingulate, thalamus,

basal ganglia, white matter).– Same network activated in eye movement studies

• Close relationship between attention and eye movements(Corbetta et al.)

• Other terminology– Extinction– Allesthesia– anosagnosia

Page 13: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Extent of effect

• Other sensory modalities– Auditory– Olfactory– Tactile

• Mental imagery– Piazza del Duomo (Bisiach and Luzzatti)

• Affects output: not surprisingly

Page 14: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Vision and eye movements(Behrmann et al.)

• 45 x 36 degrees visual angle

• magnetic scleral coil in right eye

• indicate number of As in display

Page 15: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Lesions: neglect patients

Page 16: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Lesions: BD controls

with hemianopia

Page 17: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Location and duration of fixations

Page 18: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Eye movements reflect left-sided neglect

Page 19: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

Page 20: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

Page 21: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected?

• What gives rise to neglect?

• What happens to the information that is neglected?

Page 22: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected?

• What gives rise to neglect?

• What happens to the information that is neglected?

Page 23: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Possible frames of reference: what defines ‘left’?

Egocentric: retino? head? trunk?

Allocentric:

Environmentor Scene

Object

Page 24: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Visual neglect in allocentric coordinates

midline of environment midline of environment

(a) (b)

midline of environment midline of environment

UPRIGHT ROTATED

Page 25: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 26: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Depiction of environmental neglect

Page 27: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Visual neglect in allocentric and egocentric coordinatesmidline of environment midline of environment

(a) (b)

midline of environment midline of environment

UPRIGHT ROTATED

Page 28: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Tactile and visual neglectMoscovitch and Behrmann

Page 29: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Tactile neglect in allocentric co-ordinates

Page 30: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Range of possible frames of reference

Egocentric: retino? head? trunk?

Allocentric:

Environmentor Scene

Object

Page 31: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Neglect with respect to object midline

• Target

• Copy

Page 32: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Behrmann and Tipper

right objectright space

left object

right space

Page 33: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Object-based neglect: inhibition for right and facilitation for left targets

Page 34: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Directional selectivity of neuronsOlson and Gettner (1995, 1998)

Fixation spot: 200 msecA

Sample bar: 500 msecB

Cue: 300 msecC

Delay: 400-600 msecD

Fixation spot offTarget bar on

E

ResponseF

L/R of barL/R eye movement

Page 35: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Neurons fire for left or right of bar independent of direction of movement

Eye MovementCue on

500 msec

Left with Respect to Bar

Eye MovementCue on

500 msec

Right with Respect to Bar

Page 36: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Paradigm: object and environ- neglect

square

circle

Page 37: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 38: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Simultaneous object- and environ-based neglect

Page 39: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Multiple reference frames in eye movements too

FARMFEVER

CAGE

TEAR

FLAP

WHIP

TREADFLAME

BLOCK

BRAIN

SLEDGE

HOLDER

DEJECT

HEIGHT

BRIGHT

Page 40: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Normal: no errors in reading

Page 41: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Neglect: errors and eye movements

Page 42: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Another example

FARMFEVER

CAGE

TEAR

FLAP

WHIP

TREADFLAME

BLOCK

BRAIN

SLEDGE

HOLDER

DEJECT

HEIGHT

BRIGHTXX X

X

right

Page 43: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Hemianopic: no reading errors

Page 44: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Frames of reference

• Egocentric (dependent on viewer)

• But also allocentric (independent on viewer)– Not only in vision, also in tactile

• Multiple coordinate frame– Also evident in eye movements

Page 45: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected?

• What gives rise to neglect?

• What happens to the information that is neglected?

Page 46: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What gives rise to neglect?

gradient

Gradient consistent with neuronal distribution: 68 bilateral, 29 contra, 3 ipsi

Page 47: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Suggests competition too:bad on left, too good on right

Page 48: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Visual search paradigm

I. ‘Pop-out’ Task.Target defined by a distinctive feature:specifically, an intersecting line.

II. ‘Serial’ Task.Target defined by the lackof a distinctive feature.

Page 49: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Normal subjectsFeature search Conjunction search

1 6 12 1 6 12

Page 50: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Patients with LHD

Page 51: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Patients with

RHD

Page 52: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

So:

• Spatial deficit apparent in visual search

• Generally scaled with severity of neglect– But more in RHD than LHD

– Some competition: better on right side as neglect severe in conjunction

Page 53: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected?

• What gives rise to neglect?

• What happens to the information that is neglected?

Page 54: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Fate of neglected information

• Do patients process unattended information normally?

– failure to reach consciousness?– degraded processing?

Page 55: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Volpe, Ledoux and Gazzaniga (1979)

Same or different? Name the objects

Response: different Response: A star

Unconscious processing/ failure to explicitly report information that is available

Page 56: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 57: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Priming paradigmMcGlinchey Berroth et al.

Normal subjects: faster lexical decision time if related than unrelated

related unrelated

GOSE THIP

Page 58: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Results

• Patients faster to say ‘yes’ when semantic related pic on right (eye-nose) compared to eye-ship

• Patients faster to say ‘yes’ when semantic related pic on left

• SAME AMOUNT OF PRIMING/FACILITATION FROM BOTH SIDES! Even though report the information.

• Patients process neglected info normally.

Page 59: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Results … Continued

• BUT: normals show double priming on left than right

• Cannot conclude processing is normal!

• Priming not as demanding as explicit report.

Page 60: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected? – Multiple reference frames, demands of task

• What gives rise to neglect?– Competition between residual activated neurons, spatial and temporal factors

relevant

• What happens to the information that is neglected?– Seems to be activated to some extent, not fully

Page 61: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Alternative view of parietal cortex:“how” not “where”

• Milner and Goodale– Parietal cortex involved in on-line ballistic

movements

Where the action is!

Page 62: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 63: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 64: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

Grasping

Page 65: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

matching

Page 66: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann
Page 67: Spatial representation and parietal cortex Marlene Behrmann Department of Psychology, CMU and CNBC Contact: behrmann@cnbc.cmu.edu 268-2790 URL: behrmann

What can we learn about parietal cortex?

• What determines what information is neglected? – Multiple reference frames, demands of task

• What gives rise to neglect?– Competition between residual activated neurons, spatial and temporal factors

relevant

• What happens to the information that is neglected?– Seems to be activated to some extent, not fully