45
Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23 September 2016 Dr. Shubhendu Bhasin Department of Electrical Engineering IIT Delhi

Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Embed Size (px)

Citation preview

Page 1: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov Theory and Design

TEQIP Workshop on

Control Techniques and Applications IIT Kanpur, 19-23 September 2016

Dr. Shubhendu Bhasin

Department of Electrical Engineering IIT Delhi

Page 2: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Feedback Control 101

Syste

m Controller

Sensors

desired

behavior

disturbance

Actuator

s

actual

behavior

noise

Control = Sensing + Computation + Actuation Control Design Process

Control System Objectives

• Modeling – ODE, PDE.

• Analysis – stability, robustness, performance

• Synthesis – Feedback Design Tools

• Regulation

• Tracking Stability

• Modeling Uncertainties

• Disturbances

• Sensor Noise

Robustness

• Transient

• Steady State

• Minimizing cost function

Performance

Inverted pendulum regulation Satellite attitude tracking

disturbance rejection

u + -

Page 3: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Why Study Nonlinear Systems? Real world is inherently nonlinear !

Mass-Spring-Coulomb Damper

Pendulum

Saturation Deadzone u u

Quantization u

Inherently nonlinear physical

laws

Actuator

nonlinearities

50

-50

e.g. on-off control, adaptive control laws Intentional nonlinearities

Page 4: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Why Study Linear Systems?

• Linear approximation about operating point

Steady level flight

• Superposition: Impulse response characterizes LTI system behavior

• Closed-form solution

• Universal controllers: Pole-placement, LQR etc.

Page 5: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Limitations of Linearization

• Linearization of and produce the same linear

system!

• Linearization captures local behavior around the operating point

• Linearization cannot capture rich nonlinear behavior

Limit Cycle

Multiple Equilibria

Bifurcation

Chaos

• Linearization not possible for “hard” nonlinearities e.g. backlash, saturation etc.

Page 6: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Nonlinear System Analysis

• No general method to solve nonlinear differential equations

• Superposition does not hold

• No general method to design controllers

Lyapunov (1857-1918)

Challenges

Lyapunov Theory (1892)

• Select a scalar positive function

• Choose u such that V(x, t) decreases i.e.

|e(t)|

t 0

|e(t)|

t 0

Bounded or

Ultimately

Bounded Exponential |e(t)|

t 0

Asymptotic

Page 7: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Nonlinear Systems

Autonomous System:

Non-Autonomous System:

Existence and Uniqueness of Solutions

Equilibrium Point (s)

Solution of

Page 8: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Example: Pendulum System

Page 9: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Stability of Equilibrium Points

Page 10: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Van der Pol Oscillator

Stable or unstable ?

Page 11: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Asymptotic Stability

Asymptotic Stability = Stability + Convergence Convergence Stability ?

Page 12: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Exponential Stability (Rate of Convergence)

Exponential Asymptotic ?

Asymptotic Exponential ?

Page 13: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Local Vs Global Stability

Page 14: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov’s Indirect Method (Linearization)

Page 15: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov’s Direct Method (Motivating Example)

Page 16: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Motivating Example (contd..)

Key Observations:

• Zero Energy corresponds to equilibrium

• Asymptotic stability convergence of mechanical energy to zero

• Stability properties are related to variation of mechanical energy

Page 17: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov’s Direct Method (Basic Idea)

Page 18: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov’s Stability Theorem (Local)

V(x) is positive definite

negative-definite

negative semi-definite

Page 19: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Exercise

Asymptotically stable?

Page 20: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov’s Stability Theorem (Global)

V(x) is radially unbounded

Radial Unboundedness is Necessary

Divergence of states while

moving to lower “energy” curves

Page 21: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Exercise

Remarks:

• Lyapunov theorems give sufficient conditions for stability

• Failure of a Lyapunov function candidate to satisfy the theorem does not

mean that the eq. point is unstable.

Page 22: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Example (Pendulum with Friction)

Page 23: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Stability Analysis

Page 24: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Using a different V(x)

Page 25: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

LaSalle’s Invariance Set Theorem

• Useful for proving asymptotic stability when

derivative of V(x) is only negative semi-definite

Page 26: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Pendulum with friction (Revisit)

Page 27: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Non-Autonomous Systems

Page 28: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Non-Autonomous Systems (Stability Definitions)

Page 29: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov Theorems for Non-Autonomous Systems

Page 30: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Barbalat’s Lemma

Page 31: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Asymptotic Properties of functions and its derivatives

Page 32: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Lyapunov-Like Lemma

Page 33: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Example continued…

Page 34: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Boundedness of Solutions

Page 35: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Uniformly Ultimately Bounded Stability

Page 36: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Adaptive Control

TEQIP Workshop on

Control Techniques and Applications IIT Kanpur, 19-23 September 2016

Dr. Shubhendu Bhasin

Department of Electrical Engineering IIT Delhi

Page 37: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Introduction

Page 38: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Historical Perspective

X-15

Page 39: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Basic Idea

Page 40: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Adaptive Control: A Parametric Framework

Page 41: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Indirect and Direct Adaptive Control

Page 42: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Indirect and Direct Adaptive Control

Indirect Adaptive Control

Direct Adaptive Control

Page 43: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Gain Scheduling Adaptive Control

No parameter estimation

Page 44: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Model Reference Adaptive Control (MRAC)

Page 45: Lyapunov Theory and Design - Indian Institute of ... techniques/ppt/bhasin.pdf · Lyapunov Theory and Design TEQIP Workshop on Control Techniques and Applications IIT Kanpur, 19-23

Adaptive Control Topics

• Direct MRAC (SISO)

• Indirect MRAC (SISO)

• Lyapunov-Based Nonlinear Adaptive Control

• Parameter Convergence

• Parameter Drift

• Adaptive Backstepping