70
Principles of Wireless Sensor Networks https://www.kth.se/social/course/EL2745/ Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks e-mail:carlofi@kth.se http://www.ee.kth.se/carlofi/ KTH Royal Institute of Technology Stockholm, Sweden October 1, 2014 Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 1 / 33

Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Principles of Wireless Sensor Networkshttps://www.kth.se/social/course/EL2745/

Lecture 9

Dynamic Distributed Estimation

Carlo FischioneAssociate Professor of Sensor Networks

e-mail:[email protected]://www.ee.kth.se/∼carlofi/

KTH Royal Institute of TechnologyStockholm, Sweden

October 1, 2014

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 1 / 33

Page 2: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Course content

Part 1

I Lec 1: Introduction to WSNsI Lec 2: Introduction to Programming WSNs

Part 2

I Lec 3: Wireless ChannelI Lec 4: Physical LayerI Lec 5: Medium Access Control LayerI Lec 6: Routing

Part 3

I Lec 7: Distributed DetectionI Lec 8: Static Distributed EstimationI Lec 9: Dynamic Distributed EstimationI Lec 10: Positioning and LocalizationI Lec 11: Time Synchronization

Part 4

I Lec 12: Wireless Sensor Network Control Systems 1I Lec 13: Wireless Sensor Network Control Systems 2I Lec 14: Summary and Project Presentations

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 2 / 33

Page 3: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Previous lecture

Star and general topology

Estimation from one sensor

Distributed estimation in a start topology

Distributed estimation in a general topology

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 3 / 33

Page 4: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Today’s lecture

Today we study how to perform dynamic estimation from erroneous or noisymeasurements of the sensors

“Dynamic” means that we take advantage of the time evolution of signals to buildthe estimators

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 4 / 33

Page 5: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Today’s learning goals

How to perform estimation of a dynamic signal from one sensor?

How to perform estimation of a dynamic signal from many sensors?

How to make a sensor fusion of a dynamic signal by the distributed Kalman filter?

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 5 / 33

Page 6: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Outline

Dynamic estimation from one sensor

Dynamic estimation from many sensors in a star topology

Dynamic estimation from many sensors by the distributed Kalman filter

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 6 / 33

Page 7: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Outline

Dynamic estimation from one sensor

Dynamic estimation from many sensors in a star topology

I Dynamic sensor fusion, centralized setupI Dynamic sensor fusion, centralized setup (drawbacks)I Dynamic sensor fusion, distributed Kalman filtering

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 7 / 33

Page 8: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

x̂n

EstimatedParameters

Xn =CXn−1 + wn−1

The sensort = n

x̂n−1

EstimatedParameters

Xn−1 =CXn−2 + wn−2

The sensort = n − 1

......

...

x̂0

EstimatedParameters

X0The sensort = 0

Figure: Illustration of how the fusion of sequential measurement works to combine measurements in one sensor.

We want to combine many dynamic measurements in one sensor

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 8 / 33

Page 9: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensor

Proposition 1

Consider a phenomenon x evolving in time (indexed by n) according to

xn+1 = Axn +wn

Every time step sensor generates a measurement of the form

yn = Cxn + vn

wn: white zero mean Gaussian with covariance matrix E{wnwTn} = Q

vn: white zero mean Gaussian with covariance matrix E{vnvTn} = R

A: a known nonsingular matrix

C: a known matrix

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 9 / 33

Page 10: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensor

Proposition 1

Consider a phenomenon x evolving in time (indexed by n) according to

xn+1 = Axn +wn

Every time step sensor generates a measurement of the form

yn = Cxn + vn

wn: white zero mean Gaussian with covariance matrix E{wnwTn} = Q

vn: white zero mean Gaussian with covariance matrix E{vnvTn} = R

A: a known nonsingular matrix

C: a known matrix

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 9 / 33

Page 11: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensor

Proposition 1Then we have

x̂n|n−1 = Ax̂n−1|n−1

Pn|n−1 = APn−1|n−1AT +Q

x̂n−1|n−1: estimate of xn−1 given z = (y0, . . . ,yn−1)

Pn−1|n−1: corresponding error covariance matrix

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 10 / 33

Page 12: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Proof of proposition 1

Question: How to show that x̂n|n−1 = Ax̂n−1|n−1?

Answer:Use a well known result: MMSE estimate x̂ of a random variable x given a randomvariable y is E{x|y}

x̂n|n−1 = E {xn|(y0, . . . ,yn−1)}= E {Axn−1 +wn−1|z)}= AE {xn−1|z}= Ax̂n−1|n−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 11 / 33

Page 13: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Proof of proposition 1

Question: How to show that x̂n|n−1 = Ax̂n−1|n−1?

Answer:Use a well known result: MMSE estimate x̂ of a random variable x given a randomvariable y is E{x|y}

x̂n|n−1 = E {xn|(y0, . . . ,yn−1)}= E {Axn−1 +wn−1|z)}= AE {xn−1|z}= Ax̂n−1|n−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 11 / 33

Page 14: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Proof of proposition 1

Question: How to show that Pn|n−1 = APn−1|n−1AT +Q?

Answer:By the definition of error covariance, we already have

Pn−1|n−1 = E{(x̂n−1|n−1 − xn−1)(x̂n−1|n−1 − xn−1)T}

Pn|n−1 = E{(x̂n|n−1 − xn)(x̂n|n−1 − xn)T}

= E{(Ax̂n−1|n−1 −Axn−1 −wn−1)(Ax̂n−1|n−1 −Axn−1 −wn−1)T}

= E{A(x̂n−1|n−1 − xn−1)(x̂n−1|n−1 − xn−1)TAT +wn−1w

Tn−1}

= APn−1|n−1AT +Q

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 12 / 33

Page 15: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Proof of proposition 1

Question: How to show that Pn|n−1 = APn−1|n−1AT +Q?

Answer:By the definition of error covariance, we already have

Pn−1|n−1 = E{(x̂n−1|n−1 − xn−1)(x̂n−1|n−1 − xn−1)T}

Pn|n−1 = E{(x̂n|n−1 − xn)(x̂n|n−1 − xn)T}

= E{(Ax̂n−1|n−1 −Axn−1 −wn−1)(Ax̂n−1|n−1 −Axn−1 −wn−1)T}

= E{A(x̂n−1|n−1 − xn−1)(x̂n−1|n−1 − xn−1)TAT +wn−1w

Tn−1}

= APn−1|n−1AT +Q

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 12 / 33

Page 16: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

An observation about xn−1|n−1x̂n−1|n−1: estimate of xn−1 given z = (y0, . . . ,yn−1)?

yn−1 = Cxn−1 + vn−1

yn−2 = Cxn−2 + vn−2 = C(A−1(xn−1 −wn−2)) + vn−2

= CA−1xn−1 +(vn−2 −CA−1wn−2

)...

y0 = CA−(n−1)xn−1 +(v0 −CA−(n−1)wn−2 − · · · −CA−1w0

)

i.e., the overall linear system is given byyn−1

...y0

︸ ︷︷ ︸

z

=

C...

CA−(n−1)

︸ ︷︷ ︸

H

xn−1 +

vn−1

...v0 − · · · −CA−1w0

︸ ︷︷ ︸

u

From Proposition 1 (Lecture 8)

P−1n−1|n−1x̂n−1|n−1 = HTR−1

u z ,where

Pn−1|n−1 =(R−1

xn−1+HTR−1

u H)−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 13 / 33

Page 17: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

An observation about xn−1|n−1x̂n−1|n−1: estimate of xn−1 given z = (y0, . . . ,yn−1)?

yn−1 = Cxn−1 + vn−1

yn−2 = Cxn−2 + vn−2 = C(A−1(xn−1 −wn−2)) + vn−2

= CA−1xn−1 +(vn−2 −CA−1wn−2

)...

y0 = CA−(n−1)xn−1 +(v0 −CA−(n−1)wn−2 − · · · −CA−1w0

)i.e., the overall linear system is given byyn−1

...y0

︸ ︷︷ ︸

z

=

C...

CA−(n−1)

︸ ︷︷ ︸

H

xn−1 +

vn−1

...v0 − · · · −CA−1w0

︸ ︷︷ ︸

u

From Proposition 1 (Lecture 8)

P−1n−1|n−1x̂n−1|n−1 = HTR−1

u z ,where

Pn−1|n−1 =(R−1

xn−1+HTR−1

u H)−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 13 / 33

Page 18: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

An observation about xn−1|n−1x̂n−1|n−1: estimate of xn−1 given z = (y0, . . . ,yn−1)?

yn−1 = Cxn−1 + vn−1

yn−2 = Cxn−2 + vn−2 = C(A−1(xn−1 −wn−2)) + vn−2

= CA−1xn−1 +(vn−2 −CA−1wn−2

)...

y0 = CA−(n−1)xn−1 +(v0 −CA−(n−1)wn−2 − · · · −CA−1w0

)i.e., the overall linear system is given byyn−1

...y0

︸ ︷︷ ︸

z

=

C...

CA−(n−1)

︸ ︷︷ ︸

H

xn−1 +

vn−1

...v0 − · · · −CA−1w0

︸ ︷︷ ︸

u

From Proposition 1 (Lecture 8)

P−1n−1|n−1x̂n−1|n−1 = HTR−1

u z ,where

Pn−1|n−1 =(R−1

xn−1+HTR−1

u H)−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 13 / 33

Page 19: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)

Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by Mbecause yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 20: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by Mbecause yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 21: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by Mbecause yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 22: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by M

because yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 23: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by Mbecause yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 24: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensorQuestion: x̂n|n, the MMSE estimate of xn given (y0, . . . ,yn−1,yn) = (z,yn)Answer: Apply Proposition 2 (lec 8, Static Sensor Fusion) in a straightforward manner

we already know x̂n|n−1, i.e., the estimate of xn given zwe already know Pn|n−1, the corresponding error covariance matrix

we need the estimate of xn given yn, denote it by x̂we need the corresponding error covariance matrix, denote it by Mbecause yn = Cxn + vn, from Proposition 1 (Lecture 8), we have

x̂ = MCTR−1yn ,where M =(R−1

xn+CTR−1C

)−1

from Proposition 2 (Leecture 8)

Result

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +M−1x̂ , where

P−1n|n = −R−1

xn+P−1

n|n−1 +M−1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 14 / 33

Page 25: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic estimation from one sensor

Time and measurement update steps of the Kalman filter

Kalman filter can be seen to be a combination of estimators

Optimality of the Kalman filter in the minimum mean squared sense

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 15 / 33

Page 26: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Outline

Dynamic estimation from one sensor

Dynamic estimation from many sensors in a star topology

I Dynamic sensor fusion, centralized setupI Dynamic sensor fusion, centralized setup (drawbacks)I Dynamic sensor fusion, distributed Kalman filtering

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 16 / 33

Page 27: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion

Consider a phenomenon x evolving in time (indexed by n) according to the law

xn+1 = Axn +wn

Every time step, sensor k generates a measurement of the form

yn,k = Ckxn + vn,k

Multiple sensors that generate measurements about the random variable that isevolving in time

Question: How to fuse data from all the sensors for an estimate of the state xn attime step n?

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 17 / 33

Page 28: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion

Consider a phenomenon x evolving in time (indexed by n) according to the law

xn+1 = Axn +wn

Every time step, sensor k generates a measurement of the form

yn,k = Ckxn + vn,k

Multiple sensors that generate measurements about the random variable that isevolving in time

Question: How to fuse data from all the sensors for an estimate of the state xn attime step n?

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 17 / 33

Page 29: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion

Consider a phenomenon x evolving in time (indexed by n) according to the law

xn+1 = Axn +wn

Every time step, sensor k generates a measurement of the form

yn,k = Ckxn + vn,k

Multiple sensors that generate measurements about the random variable that isevolving in time

Question: How to fuse data from all the sensors for an estimate of the state xn attime step n?

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 17 / 33

Page 30: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup

At every time step n, all the sensors transmit their measurements yn,k to a centralnode

The central node implements a fusion mechanism

However, there are two reasons why this may not be the preferred implementation

(1) number of sensors increases ⇒ computational effort required at the central nodeincreases (bear some of the computational burden at sensors)

(2) the sensors may not be able to transmit at every time step (transmit localprocessed information rather that raw measurements)

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 18 / 33

Page 31: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)

Assume that the sensors can transmit at every time step

Reducing the computational burden at the central node?

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 19 / 33

Page 32: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 1

The overall linear system is given byyn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

Ck

CkA−1

...CkA

−n

︸ ︷︷ ︸

Hk

xn +

vn,k

vn−1,k −CkA−1wn−1

...v0,k − · · · −CkA

−1w0

︸ ︷︷ ︸

vk

Process noise wn appears in the noise ⇒ the measurement noises vk are notindependent as desired

vk are not independent ⇒ the noise is correlated

⇒ Proposition 2 (Lecture 8) does not apply for combining local estimates

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 20 / 33

Page 33: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 1

The overall linear system is given byyn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

Ck

CkA−1

...CkA

−n

︸ ︷︷ ︸

Hk

xn +

vn,k

vn−1,k −CkA−1wn−1

...v0,k − · · · −CkA

−1w0

︸ ︷︷ ︸

vk

Process noise wn appears in the noise ⇒ the measurement noises vk are notindependent as desired

vk are not independent ⇒ the noise is correlated

⇒ Proposition 2 (Lecture 8) does not apply for combining local estimates

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 20 / 33

Page 34: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 1

The overall linear system is given byyn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

Ck

CkA−1

...CkA

−n

︸ ︷︷ ︸

Hk

xn +

vn,k

vn−1,k −CkA−1wn−1

...v0,k − · · · −CkA

−1w0

︸ ︷︷ ︸

vk

Process noise wn appears in the noise ⇒ the measurement noises vk are notindependent as desired

vk are not independent ⇒ the noise is correlated

⇒ Proposition 2 (Lecture 8) does not apply for combining local estimates

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 20 / 33

Page 35: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 2: Estimate of x0 known ⇒ estimate of xn known

The overall linear system is given by

yn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

CkA

n CkAn−1 · · · Ck

CkAn−1 · · · Ck 0

CkAn−2 · · · 0 0

......

. . . 0Ck 0 · · · 0

︸ ︷︷ ︸

Hk

x0

w0

...wn−1

+

vn,k

vn−1,k

...v0,k

︸ ︷︷ ︸

vk

The measurement noises vk are independent as desired

⇒ Proposition 2 (lec 8) does apply for combining local estimates

Vectors transmitted from sensors are increasing in dimension as the time step nincreases

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 21 / 33

Page 36: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 2: Estimate of x0 known ⇒ estimate of xn known

The overall linear system is given by

yn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

CkA

n CkAn−1 · · · Ck

CkAn−1 · · · Ck 0

CkAn−2 · · · 0 0

......

. . . 0Ck 0 · · · 0

︸ ︷︷ ︸

Hk

x0

w0

...wn−1

+

vn,k

vn−1,k

...v0,k

︸ ︷︷ ︸

vk

The measurement noises vk are independent as desired

⇒ Proposition 2 (lec 8) does apply for combining local estimates

Vectors transmitted from sensors are increasing in dimension as the time step nincreases

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 21 / 33

Page 37: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (transmittinglocal estimates)Let yk = (y0,k,y1,k, . . . ,yn,k) denote the measurements from sensor k that is used toestimate xn

Potential method 2: Estimate of x0 known ⇒ estimate of xn known

The overall linear system is given by

yn,k

yn−1,k

...y0,k

︸ ︷︷ ︸

yk

=

CkA

n CkAn−1 · · · Ck

CkAn−1 · · · Ck 0

CkAn−2 · · · 0 0

......

. . . 0Ck 0 · · · 0

︸ ︷︷ ︸

Hk

x0

w0

...wn−1

+

vn,k

vn−1,k

...v0,k

︸ ︷︷ ︸

vk

The measurement noises vk are independent as desired

⇒ Proposition 2 (lec 8) does apply for combining local estimates

Vectors transmitted from sensors are increasing in dimension as the time step nincreases

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 21 / 33

Page 38: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion, centralized setup (drawbacks)

Practically, it is not feasible to combine local estimates from method 2 to obtainthe global estimate

i.e., lots of communication overhead

If there is no process noise, then the method 1 will work

However, in general it is not possible

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 22 / 33

Page 39: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion:Distributed Kalman filtering

Recall: Sequential Measurements from One Sensor

Random variable evolution: xn+1 = Axn +wn

Measurements: yn = Cxn + vn, where E{vnvTn} = R

We have [yn

z

]=

[CH

]xn +

[vn

u

]x̂ = MCTR−1yn ,where M =

(R−1

xn+CTR−1C

)−1

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +CTR−1yn

P−1n|n = P−1

n|n−1 +CTR−1C

The requirements from individual sensors are derived by the equations above

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 23 / 33

Page 40: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion:Distributed Kalman filtering

Recall: Sequential Measurements from One Sensor

Random variable evolution: xn+1 = Axn +wn

Measurements: yn = Cxn + vn, where E{vnvTn} = R

We have [yn

z

]=

[CH

]xn +

[vn

u

]x̂ = MCTR−1yn ,where M =

(R−1

xn+CTR−1C

)−1

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +CTR−1yn

P−1n|n = P−1

n|n−1 +CTR−1C

The requirements from individual sensors are derived by the equations above

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 23 / 33

Page 41: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion:Distributed Kalman filtering

Recall: Sequential Measurements from One Sensor

Random variable evolution: xn+1 = Axn +wn

Measurements: yn = Cxn + vn, where E{vnvTn} = R

We have [yn

z

]=

[CH

]xn +

[vn

u

]x̂ = MCTR−1yn ,where M =

(R−1

xn+CTR−1C

)−1

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +CTR−1yn

P−1n|n = P−1

n|n−1 +CTR−1C

The requirements from individual sensors are derived by the equations above

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 23 / 33

Page 42: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion:Distributed Kalman filtering

Recall: Sequential Measurements from One Sensor

Random variable evolution: xn+1 = Axn +wn

Measurements: yn = Cxn + vn, where E{vnvTn} = R

We have [yn

z

]=

[CH

]xn +

[vn

u

]x̂ = MCTR−1yn ,where M =

(R−1

xn+CTR−1C

)−1

P−1n|nx̂n|n = P−1

n|n−1x̂n|n−1 +CTR−1yn

P−1n|n = P−1

n|n−1 +CTR−1C

The requirements from individual sensors are derived by the equations above

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 23 / 33

Page 43: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusion:Distributed Kalman filtering

Proposition 2Consider a random variable xn evolving in time as xn = Axn−1 +wn−1 being observedby K sensors in every time step n. Suppose they generate measurements of the formyn,k = Ckxn + vn,k. Then the global error covariance matrix and the estimate are givenin terms of the local covariances and estimates by

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 24 / 33

Page 44: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filteringProof: Note that overall linear system is given by

yn,1

.

.

.yn,K

z1

.

.

.zK

=

C1

.

.

.CK

H1

.

.

.HK

xn +

vn,1

.

.

.vn,K

u1

.

.

.uK

,[yn

z

]=

[CH

]xn +

[vn

u

]

Lets now simplify CTR−1yn

CTR−1

yn =[C

T1 · · ·CT

K

]R−1

1 0 · · · 0

0 R−12 · · · 0

.

.

....

. . ....

0 0 · · · R−1K

yn,1

.

.

.yn,K

=∑K

k=1 CTk R−1

k yn,k

=∑K

k=1

(P−1

n,k|nx̂n,k|n − P−1n,k|n−1

x̂n,k|n−1

)C

TR−1

C =∑K

k=1 CTk R−1

k Ck

=∑K

k=1

(P−1

n,k|n − P−1n,k|n−1

)

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 25 / 33

Page 45: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering

Recap:

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

Based on the result above → two architectures for dynamic sensor fusion

Method 1: more computation at the fusion center, less communication overhead

Method 2: less computation at the fusion center, more communication overhead

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 26 / 33

Page 46: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 47: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 48: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 49: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 50: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 51: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 52: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 53: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 54: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 55: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 56: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 57: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 0....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−10,1|0, x̂0,1|0

P−10,2|0, x̂0,2|0

P1,1|0 = AP0,1|0AT + Q

x̂1,1|0 = Ax̂0,1|0

P1,2|0 = AP0,2|0AT + Q

x̂1,2|0 = Ax̂0,2|0

P1|0 = AP0|0AT + Q

x̂1|0 = Ax̂0|0

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 27 / 33

Page 58: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)

Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

The fusion center now have knowledge about the terms in red for the previous step

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 28 / 33

Page 59: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 60: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 61: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 62: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 63: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 64: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 65: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 29 / 33

Page 66: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 1)Say n = 1....what will happen?

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)y0,1 y1,1 y2,1 y3,1

sensor 1 measurements

x0 x1 x2 x3

what we want to estimate

y0,2 y1,2 y2,2 y3,2

sensor 2 measurements

. .sensor 1 / sensor 2 fusion center

P−11,1|1, x̂1,1|1

P−11,2|1, x̂1,2|1

P2,1|1 = AP1,1|1AT + Q

x̂2,1|1 = Ax̂1,1|1

P2,2|1 = AP1,2|1AT + Q

x̂2,2|1 = Ax̂1,2|1

P2|1 = AP1|1AT + Q

x̂2|1 = Ax̂1|1

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 30 / 33

Page 67: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 2)

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

key idea:

The term P−1n|n−1x̂n|n−1 can be written in terms of contributions from individual

sensors

The term P−1n|n−1 can be written in terms of contributions from individual sensors

Allows the fusion center to form the estimate by summing the results sent from thesensors

Try it or look it up

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 31 / 33

Page 68: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Dynamic sensor fusionDistributed Kalman filtering (method 2)

P−1n|n = P−1

n|n−1 +∑K

k=1

(P−1

n,k|n −P−1n,k|n−1

)P−1

n|nx̂n|n = P−1n|n−1x̂n|n−1 +

∑Kk=1

(P−1

n,k|nx̂n,k|n −P−1n,k|n−1x̂n,k|n−1

)

key idea:

The term P−1n|n−1x̂n|n−1 can be written in terms of contributions from individual

sensors

The term P−1n|n−1 can be written in terms of contributions from individual sensors

Allows the fusion center to form the estimate by summing the results sent from thesensors

Try it or look it up

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 31 / 33

Page 69: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Summary

Today we have studied:

Dynamic estimation from one sensor

Dynamic estimation from many sensors

Dynamic sensor fusion, distributed Kalman filtering

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 32 / 33

Page 70: Principles of Wireless Sensor Networks - KTH...Principles of Wireless Sensor Networks Lecture 9 Dynamic Distributed Estimation Carlo Fischione Associate Professor of Sensor Networks

Next Lecture

Application of Lecture 8 and 9 to Positioning and Localization in WSNs

Carlo Fischione (KTH) Principles of Wireless Sensor Networks October 1, 2014 33 / 33