89
Lecture 2: Everything you need to know to know about point processes Outline: • basic ideas • homogeneous (stationary) Poisson processes • Poisson distribution • inter-event interval distribution • coefficient of variance (CV) • correlation function • stationary renewal process • relation between IEI distribution and correlation functi • Fano factor F • relation between F and CV • nonstationary (inhomogeneous) Poisson process • time rescaling

Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Embed Size (px)

DESCRIPTION

Point Processes Point process: discrete set of points (events) on the real numbers (or some interval on the reals) Usually we are thinking of times of otherwise identical events. (but sometimes space or space-time)

Citation preview

Page 1: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Lecture 2: Everything you need to know to know about point processes

Outline:• basic ideas• homogeneous (stationary) Poisson processes

• Poisson distribution• inter-event interval distribution• coefficient of variance (CV)• correlation function

• stationary renewal process• relation between IEI distribution and correlation function• Fano factor F• relation between F and CV

• nonstationary (inhomogeneous) Poisson process• time rescaling

Page 2: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Point Processes

Point process: discrete set of points (events) on the real numbers (or some interval on the reals)

−∞< t1 < t2L tN < ∞

Page 3: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Point Processes

Point process: discrete set of points (events) on the real numbers (or some interval on the reals)

Usually we are thinking of times of otherwise identical events.(but sometimes space or space-time)

−∞< t1 < t2L tN < ∞

Page 4: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Point Processes

Point process: discrete set of points (events) on the real numbers (or some interval on the reals)

Usually we are thinking of times of otherwise identical events.(but sometimes space or space-time)

Examples: radioactive decay, arrival times, earthquakes,neuronal spike trains, …

−∞< t1 < t2L tN < ∞

Page 5: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Point Processes

Point process: discrete set of points (events) on the real numbers (or some interval on the reals)

Usually we are thinking of times of otherwise identical events.(but sometimes space or space-time)

Examples: radioactive decay, arrival times, earthquakes,neuronal spike trains, …

Stochastic: characterized by the probability (density) of every set{t1, t2, … tN}

−∞< t1 < t2L tN < ∞

Page 6: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Neuronal spike trains

Action potential:

Page 7: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Neuronal spike trains

spike trains evoked by manypresentations of the same stimulus:

Action potential:

Page 8: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Neuronal spike trains

spike trains evoked by manypresentations of the same stimulus:

Action potential:

(apparently) stochastic

Page 9: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Page 10: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Page 11: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Survivor function: probability of no event in [0,t): S(t)

Page 12: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Survivor function: probability of no event in [0,t): S(t)

dSdt

= −rS ⇒ S(t) = e−rt

Page 13: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Survivor function: probability of no event in [0,t): S(t)

Probability /unit time of first event in [t, t + t)) :

dSdt

= −rS ⇒ S(t) = e−rt

Page 14: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Survivor function: probability of no event in [0,t): S(t)

Probability /unit time of first event in [t, t + t)) :

dSdt

= −rS ⇒ S(t) = e−rt

P(t) = − dS(t)dt

= re−rt

Page 15: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process

Homogeneous Poisson process: r = rate = prob of event per unit time,i.e., rΔt = prob of event in interval [t, t + Δt) (Δt 0)

Survivor function: probability of no event in [0,t): S(t)

Probability /unit time of first event in [t, t + t)) :

(inter-event interval distribution)

dSdt

= −rS ⇒ S(t) = e−rt

P(t) = − dS(t)dt

= re−rt

Page 16: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (2)

Probability of exactly 1 event in [0,T):

PT (1) = dt re−rt

0

T∫ ⋅e−r(T −t ) = rTe−rT

Page 17: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (2)

Probability of exactly 1 event in [0,T):

PT (1) = dt re−rt

0

T∫ ⋅e−r(T −t ) = rTe−rT

Probability of exactly 2 events in [0,T):

PT (2) = dt2 dt10

t2∫ re−rt10

T∫ ⋅ re−r( t2 − t1 ) ⋅e−r(T − t2 ) = 12 (rT)2e−rT

Page 18: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (2)

Probability of exactly 1 event in [0,T):

PT (1) = dt re−rt

0

T∫ ⋅e−r(T −t ) = rTe−rT

Probability of exactly 2 events in [0,T):

PT (2) = dt2 dt10

t2∫ re−rt10

T∫ ⋅ re−r( t2 − t1 ) ⋅e−r(T − t2 ) = 12 (rT)2e−rT

… Probability of exactly n events in [0,T):

PT (n) = 1n!

(rT)n e−rT

Page 19: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (2)

Probability of exactly 1 event in [0,T):

PT (1) = dt re−rt

0

T∫ ⋅e−r(T −t ) = rTe−rT

Probability of exactly 2 events in [0,T):

PT (2) = dt2 dt10

t2∫ re−rt10

T∫ ⋅ re−r( t2 − t1 ) ⋅e−r(T − t2 ) = 12 (rT)2e−rT

… Probability of exactly n events in [0,T):

PT (n) = 1n!

(rT)n e−rT Poisson distribution

Page 20: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Poisson distribution

Probability of n events in interval of duration T:

Page 21: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Poisson distribution

Probability of n events in interval of duration T:

mean count: <n> = rT

Page 22: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Poisson distribution

Probability of n events in interval of duration T:

mean count: <n> = rT

variance: <(n -<n>)2> = rT, i.e. <n> ± <n>1/2

Page 23: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Poisson distribution

Probability of n events in interval of duration T:

mean count: <n> = rT

variance: <(n -<n>)2> = rT, i.e. <n> ± <n>1/2

large rT: Gaussian

Page 24: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Poisson distribution

Probability of n events in interval of duration T:

mean count: <n> = rT

variance: <(n -<n>)2> = rT, i.e. <n> ± <n>1/2

large rT: Gaussian

Page 25: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

P(n) = e−a an

n!

Page 26: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

P(n) = e−a an

n!

Page 27: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

= e−a exp(e ika) = exp (e ik −1)a[ ]€

P(n) = e−a an

n!

Page 28: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

Cumulant generating function

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

= e−a exp(e ika) = exp (e ik −1)a[ ]€

P(n) = e−a an

n!

Page 29: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

Cumulant generating function

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

= e−a exp(e ika) = exp (e ik −1)a[ ]€

P(n) = e−a an

n!

logG(k) = e ik −1( )a = ika − 12 k 2a +L

Page 30: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

Cumulant generating function

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

= e−a exp(e ika) = exp (e ik −1)a[ ]€

P(n) = e−a an

n!

logG(k) = e ik −1( )a = ika − 12 k 2a +L

⇒ n = a, n − n( )2

= a, L

Page 31: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Characteristic functionPoisson distribution with mean a:

Characteristic function

Cumulant generating function

All cumulants = a

G(k) = e ikn = e−a e ikn

n∑ an

n!= e−a e ika( )

n

n!n∑

= e−a exp(e ika) = exp (e ik −1)a[ ]€

P(n) = e−a an

n!

logG(k) = e ik −1( )a = ika − 12 k 2a +L

⇒ n = a, n − n( )2

= a, L

Page 32: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (3): inter-event interval distribution

rtrtP e)(Exponential distribution: (like radioactive Decay)

Page 33: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (3): inter-event interval distribution

rtrtP e)(

t = 1r

Exponential distribution: (like radioactive Decay)

mean IEI:

Page 34: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (3): inter-event interval distribution

rtrtP e)(

t = 1r

(t − t )2 = 1r2 = t 2

Exponential distribution: (like radioactive Decay)

mean IEI:

variance:

Page 35: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (3): inter-event interval distribution

rtrtP e)(

t = 1r

(t − t )2 = 1r2 = t 2

CV = std devmean

=1

Exponential distribution: (like radioactive Decay)

mean IEI:

variance:

Coefficient of variation:

Page 36: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (4): correlation function

)()( f

ftttS notation:

Page 37: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (4): correlation function

)()( f

ftttS notation:

Page 38: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (4): correlation function

)()( f

ftttS

S(t) = r

notation:

mean:

Page 39: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Homogeneous Poisson process (4): correlation function

)())()()(()( rrtSrtSC

)()( f

ftttS

S(t) = r

notation:

mean:

correlation function:

Page 40: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:(1):

S(t)S( ′ t ) , t ≠ ′ t :

Page 41: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:(1):

S(t) and S(t’) are independent, so

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

Page 42: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

Page 43: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

Page 44: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

S2(t) = rε ⋅ 1ε ⎛ ⎝ ⎜

⎞ ⎠ ⎟2

= rε

= rδε (0)

Page 45: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

S2(t) = rε ⋅ 1ε ⎛ ⎝ ⎜

⎞ ⎠ ⎟2

= rε

= rδε (0)

so

S(t)S( ′ t ) = rδε (t − ′ t ) + r2 1−εδε (t − ′ t )( )

Page 46: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

S2(t) = rε ⋅ 1ε ⎛ ⎝ ⎜

⎞ ⎠ ⎟2

= rε

= rδε (0)

so

S(t)S( ′ t ) = rδε (t − ′ t ) + r2 1−εδε (t − ′ t )( )

= r(1−εr)δε (t − ′ t ) + r2

Page 47: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

S2(t) = rε ⋅ 1ε ⎛ ⎝ ⎜

⎞ ⎠ ⎟2

= rε

= rδε (0)

so

S(t)S( ′ t ) = rδε (t − ′ t ) + r2 1−εδε (t − ′ t )( )

= r(1−εr)δε (t − ′ t ) + r2

S(t) − S(t)( ) S( ′ t ) − S( ′ t )( ) = δS(t)δS( ′ t ) = r(1−εr)δε (t − ′ t )

Page 48: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Proof:

Use finite-width, finite-height delta functions:

ε (t) = 1ε

, −ε /2 < t < ε /2

(1):

S(t) and S(t’) are independent, so

(2): €

S(t)S( ′ t ) , t ≠ ′ t :

S(t)S( ′ t ) = S(t) S( ′ t ) = r2

t = ′ t :

S2(t) = rε ⋅ 1ε ⎛ ⎝ ⎜

⎞ ⎠ ⎟2

= rε

= rδε (0)

so

S(t)S( ′ t ) = rδε (t − ′ t ) + r2 1−εδε (t − ′ t )( )

= r(1−εr)δε (t − ′ t ) + r2

S(t) − S(t)( ) S( ′ t ) − S( ′ t )( ) = δS(t)δS( ′ t ) = r(1−εr)δε (t − ′ t ) ε →0 ⏐ → ⏐ ⏐ rδ(t − ′ t )

Page 49: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

General stationary point process:

For any point process,

C(t) = rδ(t) + A(t)

Page 50: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

General stationary point process:

For any point process,

with A(t) continuous,

C(t) = rδ(t) + A(t)

A(t) t →∞ ⏐ → ⏐ ⏐ 0

Page 51: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

General stationary point process:

For any point process,

with A(t) continuous,

(because S(t) is composed of delta-functions) €

C(t) = rδ(t) + A(t)

A(t) t →∞ ⏐ → ⏐ ⏐ 0

Page 52: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal processDefined by ISI distribution P(t)

Page 53: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal processDefined by ISI distribution P(t)

Relation between P(t) and C(t):

Page 54: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal process

C+(t) ≡ 1r

(C(t) + r2)Θ(t)

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Page 55: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal processDefined by ISI distribution P(t)

Relation between P(t) and C(t): define

Page 56: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal process

C+(t) ≡ 1r

(C(t) + r2)Θ(t)

C+(t) = P(t) + d ′ t P( ′ t )0

t

∫ P(t − ′ t ) +L

= P(t) + d ′ t P( ′ t )0

t

∫ C+(t − ′ t )

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Page 57: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal process

C+(t) ≡ 1r

(C(t) + r2)Θ(t)

C+(t) = P(t) + d ′ t P( ′ t )0

t

∫ P(t − ′ t ) +L

= P(t) + d ′ t P( ′ t )0

t

∫ C+(t − ′ t )

C+(λ ) = P(λ ) + P(λ )C+(λ )

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Laplace transform:

Page 58: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Stationary renewal process

C+(t) ≡ 1r

(C(t) + r2)Θ(t)

C+(t) = P(t) + d ′ t P( ′ t )0

t

∫ P(t − ′ t ) +L

= P(t) + d ′ t P( ′ t )0

t

∫ C+(t − ′ t )

C+(λ ) = P(λ ) + P(λ )C+(λ )

C+(λ ) = P(λ )1− P(λ )

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Laplace transform:

Solve:

Page 59: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nspike count variance / mean spike count

Page 60: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nF =1

spike count variance / mean spike count

for stationary Poisson process

Page 61: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nF =1

n = S(t) dt =0

T

∫ rT

δn2 = dt1 dt2 δS(t1)δS(t2)0

T

∫0

T

spike count variance / mean spike count

for stationary Poisson process

Page 62: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nF =1

n = S(t) dt =0

T

∫ rT

δn2 = dt1 dt2 δS(t1)δS(t2)0

T

∫0

T

spike count variance / mean spike count

for stationary Poisson process

t2 t1

Page 63: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nF =1

n = S(t) dt =0

T

∫ rT

δn2 = dt1 dt2 δS(t1)δS(t2)0

T

∫0

T

∫ = T C(τ−∞

∫ )dτ

spike count variance / mean spike count

for stationary Poisson process

τ t

Page 64: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Fano factor

F =(n − n )2

nF =1

n = S(t) dt =0

T

∫ rT

δn2 = dt1 dt2 δS(t1)δS(t2)0

T

∫0

T

∫ = T C(τ−∞

∫ )dτ

⇒ F =C(τ )dτ

−∞

∫r

spike count variance / mean spike count

for stationary Poisson process

τ t

Page 65: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

Page 66: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).

Page 67: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

Page 68: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ]−∞

∞∫

Page 69: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ] =1+ 2r

rC+(t) − r2[ ]0

∞∫ dt−∞

∞∫

Page 70: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ] =1+ 2r

rC+(t) − r2[ ]0

∞∫ dt−∞

∞∫

=1+ 2limλ →0

dt e−λ t C+(t) − r[ ] =10

∞∫ + 2limλ →0

C+(λ ) − rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

Page 71: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ] =1+ 2r

rC+(t) − r2[ ]0

∞∫ dt−∞

∞∫

=1+ 2limλ →0

dt e−λ t C+(t) − r[ ] =10

∞∫ + 2limλ →0

C+(λ ) − rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

=1+ 2limλ →0

P(λ )1− P(λ )

− rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

Page 72: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

Now use

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ] =1+ 2r

rC+(t) − r2[ ]0

∞∫ dt−∞

∞∫

=1+ 2limλ →0

dt e−λ t C+(t) − r[ ] =10

∞∫ + 2limλ →0

C+(λ ) − rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

=1+ 2limλ →0

P(λ )1− P(λ )

− rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

P(λ ) =1− λ t + 12 λ2 t 2 +L

Page 73: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 for a stationary renewal process

F depends on integral of C(t), CV depends on moments of P(t).Use relation between C(λ) and P(λ) to relate F and CV.

The algebra:

Now use and

F = 1r

dt C(t) =−∞

∞∫ 1r

dt rδ(t) + A(t)[ ] =1+ 2r

rC+(t) − r2[ ]0

∞∫ dt−∞

∞∫

=1+ 2limλ →0

dt e−λ t C+(t) − r[ ] =10

∞∫ + 2limλ →0

C+(λ ) − rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

=1+ 2limλ →0

P(λ )1− P(λ )

− rλ

⎡ ⎣ ⎢

⎤ ⎦ ⎥

P(λ ) =1− λ t + 12 λ2 t 2 +L

r = 1t

Page 74: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Page 75: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2 − 1

λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Page 76: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Page 77: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

−λ t + 12 λ t 2 / t + 1

2 λ2 t 2

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

Page 78: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

−λ t + 12 λ t 2 / t + 1

2 λ2 t 2

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2 −1+ 12 t 2 / t 2

[ ]

Page 79: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

−λ t + 12 λ t 2 / t + 1

2 λ2 t 2

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2 −1+ 12 t 2 / t 2

[ ]

= −1+t 2 + t − t( )

2

t 2

Page 80: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

−λ t + 12 λ t 2 / t + 1

2 λ2 t 2

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2 −1+ 12 t 2 / t 2

[ ]

= −1+t 2 + t − t( )

2

t 2 =t − t( )

2

t 2

Page 81: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

F=CV2 (continued)

F =1+ 2limλ →0

1− λ t + 12 λ2 t 2

λ t − 12 λ2 t 2

− 1λ t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1 ⎡

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

1− λ t + 12 λ2 t 2

1− 12 λ t 2 / t

−1− 1

2 λ t 2 / t

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2limλ →0

1λ t

−λ t + 12 λ t 2 / t + 1

2 λ2 t 2

1− 12 λ t 2 / t

⎣ ⎢ ⎢

⎦ ⎥ ⎥

=1+ 2 −1+ 12 t 2 / t 2

[ ]

= −1+t 2 + t − t( )

2

t 2 =t − t( )

2

t 2 = CV 2

Page 82: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Page 83: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

s = r( ′ t )d ′ t t∫

Page 84: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

Then the event rate per unit s is 1, i.e. the process is stationarywhen viewed as a function of s.

s = r( ′ t )d ′ t t∫

Page 85: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

Then the event rate per unit s is 1, i.e. the process is stationarywhen viewed as a function of s. In particular, still have• Poisson count distribution in any interval€

s = r( ′ t )d ′ t t∫

Page 86: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

Then the event rate per unit s is 1, i.e. the process is stationarywhen viewed as a function of s. In particular, still have• Poisson count distribution in any interval• F =1

s = r( ′ t )d ′ t t∫

Page 87: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

Then the event rate per unit s is 1, i.e. the process is stationarywhen viewed as a function of s. In particular, still have• Poisson count distribution in any interval• F =1

Nonstationary renewal process: time-dependent inter-event distribution

s = r( ′ t )d ′ t t∫

Page 88: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

Nonstationary Poisson processes

Nonstationary Poisson process: time-dependent rate r(t)

Time rescaling: instead of t, use

Then the event rate per unit s is 1, i.e. the process is stationarywhen viewed as a function of s. In particular, still have• Poisson count distribution in any interval• F =1

Nonstationary renewal process: time-dependent inter-event distribution

)()(0

tPtP t = inter-event probability starting at t0

s = r( ′ t )d ′ t t∫

Page 89: Lecture 2: Everything you need to know to know about point processes Outline: basic ideas homogeneous (stationary) Poisson processes Poisson distribution

homework

• Prove that the ISI distribution is exponential for a stationary Poisson process.

• Prove that the CV is 1 for a stationary Poisson process.• Show that the Poisson distribution approaches a Gaussian one for

large mean spike count.• Prove that F = CV2 for a stationary renewal process.• Show why the spike count distribution for an inhomogeneous

Poisson process is the same as that for a homogeneous Poisson process with the same mean spike count.