36
Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons and Neural circuits (Ch 5-7) Classical neuron model (5) Extensions (6) Neural networks (7) Part 3: Adaptation and learning (Ch 8-10) Synaptic plasticity (8) Classical conditioning and RL (9) Pattern recognition and machine learning methods (10)

Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Embed Size (px)

Citation preview

Page 1: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Neurophysics

• Part 1: Neural encoding and decoding (Ch 1-4)• Stimulus to response (1-2)• Response to stimulus, information in spikes (3-4)

• Part 2: Neurons and Neural circuits (Ch 5-7)• Classical neuron model (5)• Extensions (6)• Neural networks (7)

• Part 3: Adaptation and learning (Ch 8-10)• Synaptic plasticity (8)• Classical conditioning and RL (9)• Pattern recognition and machine learning methods (10)

Page 2: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Chapter 1

Page 3: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Outline

• Neurons• Firing rate• Tuning curves• Deviation from the mean: statistical description

– Spike triggered average– Point process, Poisson process

• Poisson process– Homogeneous, Inhomogeneous– Experimental validation– shortcomings

Page 4: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Properties of neurons

Axon, dendrite

Ion channels

Membrane rest potential

Action potential, refractory period

Page 5: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Synapses, Ca influx, release of neurotransmitter, opening of post-synaptic channels

Page 6: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Recording neuronal responses

• Intracellular recording– Sharp glass electrode or

patch electrode

– Typically in vitro

• Extracellular recording– Typically in vivo

Page 7: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

From stimulus to response

• Neurons respond to stimulus with train of spikes

• Response varies from trial to trial:

– Arousal, attention– Randomness in the neuron and

synapse– Other brain processes

• Population response• Statistical description

– Firing rate– Correlation function– Spike triggered average– Poisson model

Page 8: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Spike trains and firing rates

Page 9: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

For Δ t ! 0, each interval contains 0,1 spike. Then, r(t) averaged over trials isthe probability of any trial firing at time t.

B: 100 ms bins

Page 10: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

C: Sliding rectangular windowD: Sliding Gaussian window

Page 11: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Causal window

• Temporal averaging with windows is non-causal. A causal alternative is w(t)=[α2 t e-α t]+

E: causal window

Page 12: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Tuning curves

• For sensory neurons, the firing rate depends on the stimulus s

• Extra cellular recording V1 monkey

• Response depends on angle of moving light bar

• Average over trials is fitted with a Gaussian

Page 13: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Motor tuning curves

• Extra cellular recording of monkey primary motor cortex M1 in arm-reaching task. Average firing rate is fitted with

Page 14: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Retinal disparity

• Retinal disparity is location of object on retina, relative to the fixation point.

• Some neurons in V1 are sensitive to disparity.

Page 15: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Spike-count variability

• Tuning curves model average behavior. • Deviations of individual trials are given by a noise model.

– Additive noise is independent of stimulus r=f(s)+ξ– Multiplicative noise is proportional to stimulus r=f(s) ξ

• statistical description– Spike triggered average– Correlations

Page 16: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Spike triggered average or reverse correlation

• What is the average stimulus that precedes a spike?

Page 17: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Electric fish

• Left: electric signal and response of sensory neuron.• Right: C(τ)

Page 18: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Multi-spike triggered averages

• A: spike triggered average shows 15 ms latency; B: two-spike at 10 +/- 1 ms triggered average yields sum of two one-spike triggered averages; C: two-spike at 5 +/- 1 ms triggered average yields larger response indicating that multiple spikes may encode stimuli.

Page 19: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Spike-train statistics

• If spikes are described as stochastic events, we call this a point process: P(t1,t2,…,tn)=p(t1,t2,…,tn)(Δ t)n

• The probability of a spike can in principle depend on the whole history: P(tn|t1,…,tn-1)

• If the probability of a spike only depends on the time of the last spike, P(tn|t1,…,tn-1)=P(tn|tn-1) it is called a renewal process.

• If the probability of a spike is independent of the history, P(tn|t1,…,tn-1)=P(tn), it is called a Poisson process.

Page 20: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

The Homogeneous Poisson Process

• The probability of n spikes in an interval T can be computed by dividing T in M intervals of size Δ t

Right: rT=10, The distributionApproaches A Gaussian in n:

Page 21: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

• Suppose a spike occurs at tI, what is the probability that the next spike occurs at tI+1?

• Mean inter-spike interval:

• Variance:

• Coefficient of variation:

Inter-spike interval distribution

Page 22: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Spike-train autocorrelation function

Cat visual cortex. A: autocorrelation histograms in right (upper) and left (lower) hemispheres, show 40 Hz oscillations. B: Cross-correlation shows that these oscillations are synchronized. Peak at zero indicates synchrony at close to zero time delay

Page 23: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Autocorrelation for Poisson process

Page 24: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Inhomogeneous Poisson Process

• Divide the interval [ti,ti+1] in M segments of length Δ t.

• The probability of no spikes in [ti,ti+1] is

Page 25: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

• The probability of spikes at times t1,…tn is:

Page 26: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Poisson spike generation

• Either– Choose small bins Δ t and generate with probability r(t)Δ t, or

– Choose ti+1-tI from p(τ)=r exp(-r τ)

• Second method is much faster, but works for homogeneous Poisson processes only

• It is further discussed in an exercise.

Page 27: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Model of orientation-selective neuron in V1

• Top: orientation of light bar as a function of time.

• Middle: Orientation selectivity

• Bottom: 5 Poisson spike trials.

Page 28: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Experimental validation of Poisson process: spike counts

• Mean spike count and variance of 94 cells (MT macaque) under different stimulus conditions.

• Fit of σn2=A <n>B yield A,B typically between 1-1.5, whereas Poisson

yields A=B=1.• variance higher than normal due to anesthesia.

Page 29: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Experimental validation of Poisson process: ISIs

• Left: ISI of MT neuron, moving random dot image does not obey Poisson distribution 1.31

• Right: Adding random refractory period (5 § 2 ms) to Poisson process restores similarity. One can also use a Gamma distribution

Page 30: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Experimental validation of Poisson process: Coefficient of variation

• MT and V1 macaque.

Page 31: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Shortcomings of Poisson model

• Poisson + refractory period accounts for much data but– Does not account difference in vitro and in vivo: neurons are

not Poisson generators– Accuracy of timing (between trials) often higher than Poisson– Variance of ISI often higher than Poisson– Bursting behavior

Page 32: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Types of coding: single neuron description

• Independent-spike code: all information is in the rate r(t). This is a Poisson process

• Correlation code: spike timing is history dependent. For instance a renewal process p(ti+1|ti)

• Deviation from Poisson process typically less than 10 %.

Page 33: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Types of coding: neuron population

• Information may be coded in a population of neurons

• Independent firing is often valid assumption, but– Correlated firing is sometimes

observed– For instance, Hippocampal

place cells spike timing phase relative to common θ (7-12 Hz) rhythm correlates with location of the animal

Page 34: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Types of coding: rate or temporal code?

• Stimuli that change rapidly tend to generate precisely timed spikes

Page 35: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Chapter summary

• Neurons encode information in spike trains• Spike rate

– Time dependent r(t)

– Spike count r

– Trial average <r>

• Tuning curve as a relation between stimulus and spike rate• Spike triggered average• Poisson model• Statistical description: ISI histogram, C_V, Fano, Auto/Cross

correlation• Independent vs. correlated neural code

Page 36: Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons

Appendix APower spectrum of white noise

• If Q_ss(t)=sigma^2 \delta(t) then Q_ss(w)=sigma^2/T• Q_ss(w)=|s(w)|^2

36