14
Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Embed Size (px)

Citation preview

Page 1: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Kalman Filter

12.03.22.(Thu)Joon Shik Kim

Computational Models of Intelligence

Page 2: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Application of Kalman Filter

NASA Apollo navigation and U.S. Navy’s Tomahawk missile

Page 3: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Recursive Bayesian Estima-tion

Hidden Markov Model Discrete Kalman filter cycle

Page 4: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Roles of Variables in Kalman FilterkB

: state : state transition model

: control-input model : control vector

: zero mean multi-variate normal dis-tribution

: observation model

: observation noise : noise covariance

kw

Page 5: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Predict Phase

- Predicted (a priori) state estimate

- predicted (a priori) estimate error covariance

Page 6: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Update Phase

- Innovation of measurement residual

- Innovation of residual covariance

- Optimal Kalman gain is chosen by minimizing the error covariance Pk

- Updated (a posteriori) state estimate

Page 7: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Estimating a Random Con-stant

• Measurements are corrupted by a 0.1 volt RMS white measurement noise.

• State

• Measurement

• The state does not change from step to step so A=1. There is no control input so u=0. Our measurement is of the state di-rectly so H=1.

1 1k k k kx Ax Bu w

1k kx w

k k kz Hx v

k kx v

Page 8: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Kalman Filter Simulation with R=0.01

Page 9: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Kalman Filter Simulation with R=1 and R=0.0001

Slower response to themeasurements

More quick responseto the measurements

Page 10: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Extended Kalman Filter (EKF)

• In the extended Kalman filter, (EKF) the state transition and observation models need not be linear functions of the state but may instead be (differen-tiable) functions.

• At each time step the Jacobian is eval-uated with current predicted states

Page 11: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Unscented Kalman filter (UKF) (1/2)

• When the state transition and obser-vation models – that is, the predict and update functions f and h– are highly non-linear, the extended Kalman filter can give particularly poor performance. This is because the covariance is propagated through linearization of the underlying non-linear model.

Page 12: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Unscented Kalman filter (UKF) (2/2)

• The unscented Kalman filter (UKF) uses a deterministic sampling tech-nique known as the unscented trans-form to pick a minimal set of sample points (called sigma points) around the mean.

• The result is a filter which more accu-rately captures the true mean and covariance.

Page 13: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Ensemble Kalman Filter (EnKF) (1/2)

• EnKF is a Monte Carlo approximation of the Kalman filter, which avoids evolving the covariance matrix of the probability density function (pdf) of the state vector.

• Instead, the pdf is represented by an ensemble

Page 14: Kalman Filter 12.03.22.(Thu) Joon Shik Kim Computational Models of Intelligence

Ensemble Kalman Filter (EnKF) (2/2)

• Markov Chain Monte Carlo (MCMC)

• Fokker-Planck equation (also named as Kolmogorov’s equation)

Where describe a vector Brownian motion process with covariance .

,

: probability density of the model state