50
12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Embed Size (px)

Citation preview

Page 1: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

12 November 2009, UT Austin, CS Department

Control of Humanoid Robots

Luis Sentis, Ph.D.

Personal robotics Guidance of gait

Page 2: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Assessment of Disruptive Technologies by 2025 (Global Trends)

Page 3: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Human on the loop:

Personal / Assitive robotics (health) Unmanned surveillance systems (defense / IT) Modeling and guidance of human movement (health)

Human-Centered Robotics

Page 4: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Current Projects: Compliant Control of Humanoid Robots

Page 5: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Recent Project:Guidance of Gait Using Functional Electrical Stimulation

Page 6: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

CONTROL OF HUMANOID ROBOTS

Page 7: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

General Control Challenges

Dexterity: How can we create and execute advanced skills that coordinate motion, force, and compliant multi-contact behaviors

Interaction: How can we model and respond to the constrained physical interactions associated with human environments?

Autonomy: How can we create action primitives that encapsulate advance skills and interface them with high level planners

PARKOUR

Page 8: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

The Problem (Interactions)

Operate efficiently under arbitrary multi-contact constraints

Respond compliantly to dynamic changes of the environment

Plan multi-contact maneuvers

Coordination of complex skills using compliant multi-contact interactions

Page 9: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Key Challenges (Interactions)

Find representations of the robot internal contact state

Express contact dependencies with respect to frictional properties of contact surfaces

Develop controllers that can generate compliant whole-body skills

Plan feasible multi-contact behaviors

Page 10: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Approach (8 years of development)

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 11: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Humanoids as Underactuated Systems in Contact

Non-holonomic Constraints(Underactuated DOFs)

External forces

Model-based approach: Euler-Lagrange

Torque commands

Whole-bodyAccelerations

External Forces

Page 12: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Model of multi-contact constraints

Accelerations are spanned by the contact null-space multiplied by the underactuated model:

Assigning stiff model:

Page 13: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Model of Task Kinematics Under Multi-Contact Constraints

x

q legs

Reduced contact-consistent Jacobian

x base

q arms Differential kinematics

Operational point (task to joints)

Page 14: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Modeling of Internal Forces and Moments

Page 15: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Variables representing the contact state

Page 16: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Aid using the virtual linkage model (predict what robot can do)

CC

C

C

Grasp / Contact Matrix

Center of pressure pointsInternal tensions

Center of Mass

Normal moments

Page 17: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Properties Grasp/Contact Matrix

1. Models simultaneously the internal contact state and Center of Mass inter-dependencies

2. Provides a medium to analyze feasible Center of Mass behavior

3. Emerges as an operator to plan dynamic maneuvers in 3d surfaces

Page 18: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Example on human motion analysis(is the runner doing his best?)

Page 19: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

More Details of the Grasp / Contact Matrix

Balance of forces and moments:

Underdetermined relationship between reaction forces and CoM behavior:

Optimal solution wrt friction forces

Page 20: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Example on analysis of stability regions (planning locomotion / climbing)

Page 21: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 22: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Linear Control

Stanford robotics / AI lab

Torque control: unified force and motion control(compliant control)

Control of the task forces (pple virtual work)

Control of the task motion

Potential Fields

Page 23: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Inverse kinematics vs. torque control

duality

Pros:

Trajectory based

Cons:

Ignores dynamicsForces don’t appear

Pros:

Forces appearCompliant because of dynamics

Cons:

Requires torque control

Inverse kinematics: Torque control:

Page 24: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Highly Redundant Systems Under Constraints

Page 25: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Prioritized Whole-Body Torque Control

Prioritization (Constraints first):

Gradient descent is in the manifold of the constraint

Page 26: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Constrained-consistent gradient descent

x task

Optimal gradient descent:

Constrained kinematics:

x un-constrained

Page 27: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Constrained Multi-Objective Torque Control

Lightweight optimization

Decends optimally in constrained-consistent space

Resolves conflicts between competing tasks

Page 28: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Torque control of humanoids under contact

Page 29: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Control of Advanced Skills

Page 30: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Example: Interactive Manipulation

Page 31: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Manifold of closed loops

Control of internal forces

Unified motion / force / contact control

Page 32: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Compliant Control of Internal Forces

Using previous torque control structure, estimation of contact forces, and the virtual linkage model:

Page 33: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Simulation results

Page 34: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait
Page 35: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 36: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Contact Requisites: Avoid Rotations and Friction Slides

C Rotational Contact Constraints: Need to maintain CoP in support area

Frictional Contact Constraints: Need to control tensions and CoM behavior to remain in friction cones

Page 37: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Automatic control of CoP’s and internal forces

Motion control

Page 38: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

CoM control

Page 39: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Example: CoM Oscillations

Page 40: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Specifications

Page 41: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Multiple steps: forward trajectories

Page 42: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Results: lateral steps

Page 43: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Approach

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 44: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait
Page 45: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait
Page 46: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait
Page 47: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Demos Asimo

Upper body compliant behaviors

Honda’s balance controller

Torque to position transformer

Page 48: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

Summary

Grasp Matrix

1. Models of multi-contact and CoM interactions

2. Methodology for whole-body compliant control

3. Planners of optimal maneuvers under friction

4. Embedded control architecture

Page 49: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

PRESENTATION’S END

Page 50: 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait