64
Models of Perceptual Uncertainty and Decision Making Leonardo L. Gollo, Michael Breakspear, Muhsin Karim, Gonzalo Polavieja, Eric DeWitt, Vinh T. Nguyen Systems Neuroscience Group Brisbane, Australia [email protected]

Models of Perceptual Uncertainty and Decision Making

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Models of Perceptual Uncertainty and Decision Making

Models of Perceptual Uncertainty and Decision Making

Leonardo L. Gollo, Michael Breakspear, Muhsin Karim, Gonzalo Polavieja, Eric DeWitt, Vinh T. Nguyen

Systems Neuroscience Group Brisbane, Australia

[email protected]

Page 2: Models of Perceptual Uncertainty and Decision Making

● How do we integrate sensory percepts?

● How do we weigh ambiguous evidence?

?

Page 3: Models of Perceptual Uncertainty and Decision Making

● How do we integrate sensory percepts?

● How do we weigh ambiguous evidence?

?

Page 4: Models of Perceptual Uncertainty and Decision Making

Vibrotactile experiment: perceptual decision making

Page 5: Models of Perceptual Uncertainty and Decision Making

Perceptual decision-making task

Two-alternative forced choice:

1: Same or Different? S D2: f2>f1?

Vibrotactile discrimination task

Page 6: Models of Perceptual Uncertainty and Decision Making

Perceptual decision-making task

Two-alternative forced choice:

1: Same or Different?2: f2>f1? Y N

Vibrotactile discrimination task

Page 7: Models of Perceptual Uncertainty and Decision Making

Perceptual decision-making task

Two-alternative forced choice:

1: Same or Different? S D2: f2>f1? Y N

Vibrotactile discrimination task

Subtraction weighted by precision of stimulus representation

Subtraction

Page 8: Models of Perceptual Uncertainty and Decision Making

outline● Same or Different? S D

Effective connectivity

Behavioral, fMRI, DCM

● f2>f1? Y N

Time-order effect

Behavioral, Bayesian approach

Page 9: Models of Perceptual Uncertainty and Decision Making

Vibrotactile discrimination task

Conditions:

1. Different or same frequencies – adaptation

repetition suppression

Experiment 1: Same or Different?

Page 10: Models of Perceptual Uncertainty and Decision Making

Vibrotactile discrimination task

Conditions:

1. Different or same frequencies – adaptation

2. Pure or noisy sinusoidal shape –

what is the role of noise in the input frequency?

Page 11: Models of Perceptual Uncertainty and Decision Making

Vibrotactile discrimination task

Conditions:

1. Different or same frequencies – adaptation

2. Pure or noisy sinusoidal shape –

what is the role of noise in the input frequency?

Page 12: Models of Perceptual Uncertainty and Decision Making

different

Proportion of correct responses

regular noisy noisyregular

same

Karim et al. 2012

Noise reduces precision of stimulus representation

Behavioral data

Page 13: Models of Perceptual Uncertainty and Decision Making

different

Proportion of correct responses

regular noisy noisyregular

same

Noise degrades the perception of different trials and improves the perception of same trials (interaction: p=0.0007, F

1,15=17.927)

Karim et al. 2014

Role of input noise Behavioral data

Page 14: Models of Perceptual Uncertainty and Decision Making

Perceptual decision-making task

Greater activity for different than for same input frequencies

Inferior parietal lobe

Page 15: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)

Inferior parietal lobe

Different > Same

Page 16: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)

Dorsal lateral prefrontal cortex

Different > Same

Page 17: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)rPFC (x4)

SFG(x3)

Rostral prefrontal cortex

Regular > Noisy

Page 18: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)rPFC (x4)

SFG(x3)

Superior frontal gyrus

Interaction effect

Page 19: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)rPFC (x4)

SFG(x3)

Page 20: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)rPFC (x4)

SFG(x3)

Constellation of prefrontal regions

Page 21: Models of Perceptual Uncertainty and Decision Making

IPL (x1)

DLPFC (x2)rPFC (x4)

SFG(x3)

IPLSFGDLPFC

rPFC

How do these regions interact?

Page 22: Models of Perceptual Uncertainty and Decision Making

IPLSFGDLPFC

rPFC

How do these regions interact?

Effective connectivity: Dynamic causal modelling

Page 23: Models of Perceptual Uncertainty and Decision Making

Dynamic causal modelling

Friston et al. (2003) Neuroimage

Model

x=F (x ,u ,θ)

y=H (x ,u ,θ)+ϵ

Prediction

forward model

neural state equationneural state equation

hemodynamic state equations

estimated BOLD response

Page 24: Models of Perceptual Uncertainty and Decision Making

Dynamic causal modelling

Friston et al. (2003) Neuroimage

Model

x=F (x ,u ,θ)

y=H (x ,u ,θ)+ϵ

Model evidence

p( y∣m)=∫ p( y∣θ ,m) p (θ∣m)d θ

Probability of observing the data y given the model m

variational Bayes

Prediction

forward model model inversion

Empirical effect

Page 25: Models of Perceptual Uncertainty and Decision Making

Stephan et al. (2008) Neuroimageeffective connectivity

state changes input

modulation voltage dependent gating (via NMDA receptors)

Page 26: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

Page 27: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

different

Page 28: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

different regular

Page 29: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

different regular

interaction

Page 30: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

Serial Serial

Page 31: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

Parallel

Page 32: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

Hierarchical (bilinear)

Page 33: Models of Perceptual Uncertainty and Decision Making

Set of minimal models

Hierarchical (nonlinear)

Page 34: Models of Perceptual Uncertainty and Decision Making

Example time series

Stork 1

Expectation maximisation optimises the posterior likelihood of each model given the data

Page 35: Models of Perceptual Uncertainty and Decision Making

Model comparison

Karim et al. 2014

Page 36: Models of Perceptual Uncertainty and Decision Making

The nonlinear hierarchical model which best describes the data

Karim et al. 2014

Page 37: Models of Perceptual Uncertainty and Decision Making

IPL

SFG

DLPFCrPFC

How do these regions interact?

The nonlinear hierarchical model which best describes the data

Karim et al. 2014

Page 38: Models of Perceptual Uncertainty and Decision Making

outline

● Same or Different? Effective connectivity

Behavioral, fMRI, DCM

● f2>f1? Time-order effect

Behavioral, Bayesian approach

Page 39: Models of Perceptual Uncertainty and Decision Making

Modeling time-order effect

Delayed vibrotactile discrimination task

Page 40: Models of Perceptual Uncertainty and Decision Making

Modeling time-order effect

Delayed vibrotactile discrimination task

f1=A; f2=B

f1=B; f2=A

Accuracy AB

Accuracy BA Accuracy AB≠

Page 41: Models of Perceptual Uncertainty and Decision Making

Modeling time-order effect

Delayed vibrotactile discrimination task

f1=A; f2=B

f1=B; f2=A

Accuracy AB

Accuracy BA Accuracy AB≠

Time-order effect

Page 42: Models of Perceptual Uncertainty and Decision Making

Modeling time-order effect

Delayed vibrotactile discrimination task

Karim et al. 2013Preferred order improves accuracy

Nonpreferred order reduces accuracy

Global mean = 34 Hz

f1 f2

Page 43: Models of Perceptual Uncertainty and Decision Making

Modeling time-order effect

Delayed vibrotactile discrimination task

Karim et al. 2013Preferred order improves accuracy

Nonpreferred order reduces accuracy

Global mean = 34 Hz

f1 f2 f2f1

Page 44: Models of Perceptual Uncertainty and Decision Making

Bayesian approach

p(x|s)=p(x) p(s|x) / p(s)

Page 45: Models of Perceptual Uncertainty and Decision Making

Bayesian approach

Prior belief: Likelihood: Posterior belief:

p(x|s)=p(x) p(s|x) / p(s)Gaussian assumption:

Page 46: Models of Perceptual Uncertainty and Decision Making

Bayesian approach

Prior belief: Likelihood: Posterior belief:

p(x|s)=p(x) p(s|x) / p(s)Gaussian assumption:

Page 47: Models of Perceptual Uncertainty and Decision Making

Preferred order

Posterior belief (f1)

Sensory evidence – likelihood (f1)

Without precision fade

f1=46 Hz

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

Page 48: Models of Perceptual Uncertainty and Decision Making

Posterior belief (f1)

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz

Sensory evidence – likelihood (f2)

Posterior belief (f2)

f2=52 Hz

Without precision fade

Preferred order

Page 49: Models of Perceptual Uncertainty and Decision Making

Posterior belief (f1)

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz

Sensory evidence – likelihood (f2)

Posterior belief (f2)

f2=52 Hz Posterior f1 Posterior f2

PC = 75%

Without precision fade

Preferred order

Page 50: Models of Perceptual Uncertainty and Decision Making

Posterior belief (f1)

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz

Sensory evidence – likelihood (f2)

Posterior belief (f2)

f2=52 Hz Posterior f1 Posterior f2

PC = 75%

Nonpreferred order

f1=52 Hz

Without precision fade

Preferred order

Page 51: Models of Perceptual Uncertainty and Decision Making

Posterior belief (f1)

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz

Sensory evidence – likelihood (f2)

Posterior belief (f2)

f2=52 Hz Posterior f1 Posterior f2

PC = 75%

Nonpreferred order

f1=52 Hz f2=46 Hz

Without precision fade

Preferred order

Page 52: Models of Perceptual Uncertainty and Decision Making

Posterior belief (f1)

Prior belief

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz

Sensory evidence – likelihood (f2)

Posterior belief (f2)

f2=52 Hz Posterior f1 Posterior f2

PC = 75%

Nonpreferred order

f1=52 Hz f2=46 HzPosterior f2 Posterior f1

Without precision fade

Preferred order

PC = 75%

Page 53: Models of Perceptual Uncertainty and Decision Making

The variance of the sensory evidence of stimulus f1 grows in time

Precision fade

Page 54: Models of Perceptual Uncertainty and Decision Making

The variance of the sensory evidence of stimulus f1 grows in time

Precision fade

Sensory evidence – likelihood (f1) at time t1

Sensory evidence – likelihood (f1) at time t2 (larger variance)

time t1 time t2

Page 55: Models of Perceptual Uncertainty and Decision Making

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz f2=52 HzPosterior f1 Posterior f2

PC= 79%

Precision fade

Preferred order

Page 56: Models of Perceptual Uncertainty and Decision Making

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz f2=52 HzPosterior f1 Posterior f2

PC= 79%

f1=52 Hz f2=46 Hz

Precision fade

Preferred order

Page 57: Models of Perceptual Uncertainty and Decision Making

p(x|s)=p(x) p(s|x) / p(s)

f1=46 Hz f2=52 HzPosterior f1 Posterior f2

PC= 79%

Nonpreferred order

f1=52 Hz f2=46 Hz Posterior f2 Posterior f1

PC= 64%

Precision fade

Preferred order

Page 58: Models of Perceptual Uncertainty and Decision Making

Karim et al. 2013

Page 59: Models of Perceptual Uncertainty and Decision Making

data

Langdon et al. 2012

Page 60: Models of Perceptual Uncertainty and Decision Making

data

f1(Hz)

model

PC

(%

)

Page 61: Models of Perceptual Uncertainty and Decision Making

Conclusions

● Vibrotactile decision-making task depends on a constellation of prefrontal cortical areas

● The data is best described by nonlinear hierarchical models

● Time-order effect = estimation + precision fade

Page 62: Models of Perceptual Uncertainty and Decision Making

Thank you

Page 63: Models of Perceptual Uncertainty and Decision Making

Thank you

Page 64: Models of Perceptual Uncertainty and Decision Making