64
Ames Research Center Planning from Head to Toe David E. Smith NASA Ames Research Center ?? Sunday, August 7, 2011

Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Planning from Head to Toe

David E. SmithNASA Ames Research Center

??

Sunday, August 7, 2011

Page 2: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter 1997-2000: Marsokhod

Sunday, August 7, 2011

Page 3: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter 2001-2005: K9 rover

Sunday, August 7, 2011

Page 4: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter 2007-2008: ATHLETE

Sunday, August 7, 2011

Page 5: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter 2009-: A Different Kind of Rover

Sunday, August 7, 2011

Page 6: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Some Rover Peculiarities

• Hazardous environmentsSlow rad-hardened processors (200 MHz)Low power (125 Watts)Limited memory (256 MB)Limited storage (2 GB)

• Unstructured rough terrainNavigation/localization difficult

• Limited autonomyLocal obstacle avoidanceOpportunistic pictures

Sunday, August 7, 2011

Page 7: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Some Rover Peculiarities

• Hazardous environmentsSlow rad-hardened processors (200 MHz)Low power (125 Watts)Limited memory (256 MB)Limited storage (2 GB)

• Unstructured rough terrainNavigation/localization difficult

• Limited autonomyLocal obstacle avoidanceOpportunistic pictures

Igno

reIg

nore

Sunday, August 7, 2011

Page 8: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter The Planning Problem

• TemporalAction durationsConcurrency

• Time constraintsCommunication windowsIllumination of targetsTemperature

• UncertaintyTerrain & trackingDuration of actionsEnergy usageStorage available

• OversubscriptionMany conflicting goalsGoal dependence

Sunday, August 7, 2011

Page 9: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter The Talk

• TemporalAction durationsConcurrency

• Time constraintsCommunication windowsIllumination of targetsTemperature

• UncertaintyTerrain & trackingDuration of actionsEnergy usageStorage available

• OversubscriptionMany conflicting goalsGoal dependence

Levels of planning

Sunday, August 7, 2011

Page 10: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

• 6 legs, 36 degrees of freedom• Feet are wheels (walk and roll)• 6 stereo camera pairs outward• 3 stereo camera pairs inward• 1 stereo pair on each foot• 2.75m chassis• 850 kg

ATHLETE1/

3 sc

ale

Sunday, August 7, 2011

Page 11: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter ATHLETE Capabilities

Sunday, August 7, 2011

Page 12: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter ATHLETE in action

Sunday, August 7, 2011

Page 13: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter ATHLETE in action

Sunday, August 7, 2011

Page 14: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Current Operation

commandcenter

• Remotely operated• Rolling: ok• Walking: slow

Sunday, August 7, 2011

Page 15: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Simple Planning Problem

• Given: – simple goal point– terrain map with varying resolution• detailed ≤ 5 meters• satellite > 5 meters

• Find: – command sequence– prefer rolling to stepping

Sunday, August 7, 2011

Page 16: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Configuration Space Planning

• Implementation issues:– Computational– Rolling not included– Odd solutions

• Practical issues:– Data quality degrades quickly over distance

– Uncertainty regarding future configurations– Active compliance (rolling)

Sunday, August 7, 2011

Page 17: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Decomposing the problem

Route Planner

Chassis Planner

Move Planner

Configuration Space Planner

Goals

Goals

Goals Viability

Viability

Viability

State UpdateCommands

Sunday, August 7, 2011

Page 18: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Route Planner

Sunday, August 7, 2011

Page 19: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Route Planning Approach

Sunday, August 7, 2011

Page 20: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Route Planning Search

Sunday, August 7, 2011

Page 21: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Route Planning Search

• D*-Lite

Sunday, August 7, 2011

Page 22: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Chassis Planner

• Given: – goal direction, horizon, detailed terrain map

• Find: – sequence of translations and rotations– minimize stepping

• Simplification: – fixed leg pose

Sunday, August 7, 2011

Page 23: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Chassis Planner

Sunday, August 7, 2011

Page 24: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Chassis Planner Approach

• Fine tessellation of horizon• For each tile

– steepness = max - min elevation– steepness < clearance (within entire chassis)

• Between tiles– roughness = std-deviation from mode– cost = roughness*steepness

Sunday, August 7, 2011

Page 25: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Chassis Planner Approach

• For successive chassis positions, cost is:– sum over leg paths of tile transition costs

• Additional penalties when– adjacent legs have significant elevation change at same time– legs move into steep squares.

Sunday, August 7, 2011

Page 26: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

• Given: fixed path for chassis• Find: sequence of moves

– Roll– Shift chassis– Step

• Simplification: ignore transitions

drive 090,5mrotate -20move-leg 2,posraise-leg 1drive 070,1mlower-leg 1…

Sunday, August 7, 2011

Page 27: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Finding the best move

• Using depth-first search 1. Roll if possible in the direction dictated by the chassis

plan2. If lifting a leg will allow further rolling, prefer it3. For each leg and the chassis:

• compute the max progress that the leg/chassis can be advanced in the direction of the chassis plan

• order the leg/chassis moves according to progress along the chassis plan

Sunday, August 7, 2011

Page 28: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Steps Considered

R = Reachable positionsS = Stable positionsD = Desired positions

Reachable and stable regions are computed quickly by the Configuration Space routines

Sunday, August 7, 2011

Page 29: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 30: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 31: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 32: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 33: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 34: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 35: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 36: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 37: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 38: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 39: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Move Planner

Sunday, August 7, 2011

Page 40: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Configuration Space Planner

• Given: specific move• Find: path in configuration space• Only a few steps• Simplification: none!

– check self-collisions– check environment collisions– check torque

Sunday, August 7, 2011

Page 41: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Decomposing the problem

Route Planner

Chassis Planner

Move Planner

Configuration Space Planner

Goals

Goals

Goals Viability

Viability

Viability

State UpdateCommands

Sunday, August 7, 2011

Page 42: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

At

Path Planner

Travel ...TravelAt TravelAt

Sunday, August 7, 2011

Page 43: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

At

Path Planner

Travel ...

Chassis Planner ...

Travel

At

At TravelAt

At

Sunday, August 7, 2011

Page 44: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

At

Path Planner

Travel ...

Chassis Planner ...

Travel

At

At TravelAt

AtTranslate Rotate TranslateAt At

Sunday, August 7, 2011

Page 45: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Chassis Planner ...At AtTranslate Rotate TranslateAt At

Sunday, August 7, 2011

Page 46: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Chassis Planner ...At AtTranslate Rotate TranslateAt At

Sunday, August 7, 2011

Page 47: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Chassis Planner ...At AtTranslate Rotate TranslateAt At

Move Planner ...At At

Sunday, August 7, 2011

Page 48: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Chassis Planner ...At AtTranslate Rotate TranslateAt At

Move Planner ...At AtRoll Shift body StepAt At

Sunday, August 7, 2011

Page 49: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Move Planner ...At AtRoll Shift body StepAt At

Move Planner ...At AtRoll Shift body StepAt At

Sunday, August 7, 2011

Page 50: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Move Planner ...At AtRoll Shift body StepAt At

Sunday, August 7, 2011

Page 51: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Example

Move Planner ...At AtRoll Shift body StepAt At

Configuration Space Planner ...At AtRoll Shift body aAt At b c ...

Sunday, August 7, 2011

Page 52: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Problem 1: Planning

Move Planner ...At AtRoll Shift body StepAt At

Configuration Space Planner ...At AtRoll Shift bodyAt At

Sunday, August 7, 2011

Page 53: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Problem 1: Planning

Move Planner ...At AtRoll Shift body StepAt At

Configuration Space Planner ...At AtRoll Shift bodyAt At

Sunday, August 7, 2011

Page 54: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter

Problem 2: Execution

Move Planner ...At AtRoll Shift body StepAt At

Configuration Space Planner ...At AtRoll Shift body aAt At b c ...End up in different place or

configuration

Sunday, August 7, 2011

Page 55: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Some Questions

• Level breakdown– More than usual– Boundaries? Route Planner

Chassis Planner

Move Planner

Configuration Space Planner

Goals

Goals

Goals Viability

Viability

Viability

State UpdateCommands

Point

Hexagon

Body pose

Sunday, August 7, 2011

Page 56: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Some Questions

• Horizon– Route planner– Chassis planner

• visual horizon ~ 5 meters– Move Planner

• 2-5 meters– Config space planner

• a few moves

Route Planner

Chassis Planner

Move Planner

Configuration Space Planner

Goals

Goals

Goals Viability

Viability

Viability

State UpdateCommands

Dependent on terrain difficulty ?

Sunday, August 7, 2011

Page 57: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Some Questions

• How often to replan at levels– Route planner

• terrain detail changes roughness• cost of Chassis plan is higher than

predicted– Chassis planner

• cost of move plan is higher than predicted

• advancement by more than 2 meters

– Move Planner• after each command

Route Planner

Chassis Planner

Move Planner

Configuration Space Planner

Goals

Goals

Goals Viability

Viability

Viability

State UpdateCommands

Dependent on terrain difficulty ?

Sunday, August 7, 2011

Page 58: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter The Talk

• TemporalAction durationsConcurrency

• Time constraintsCommunication windowsIllumination of targetsTemperature

• UncertaintyTerrain & trackingDuration of actionsEnergy usageStorage available

• OversubscriptionMany conflicting goalsGoal dependence

Sunday, August 7, 2011

Page 59: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Complicating the Planning Problem

• Given: – collection of goals with utilities– time constraints– uncertain durations

• Find: – command sequence– prefer rolling to stepping

Sunday, August 7, 2011

Page 60: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Impact

• Good news: only affects the top-level route planner: – need oversubscription planner

• Bad news: duration uncertainty – impacts time constraints– constantly simulate expected value– if timing is tight, contingency planning

Sunday, August 7, 2011

Page 61: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Contingency Planning

• Uncertainty in continuous quantity• Discretization usually not viable• Uncertainty is cumulative

– the condition needs to be predictive– if probability of completing this goal drops below x,

do plan2 instead

Sunday, August 7, 2011

Page 62: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter The Talk

• TemporalAction durationsConcurrency

• Time constraintsCommunication windowsIllumination of targetsTemperature

• UncertaintyTerrain & trackingDuration of actionsEnergy usageStorage available

• OversubscriptionMany conflicting goalsGoal dependence

Sunday, August 7, 2011

Page 63: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter The Tracking Problem

• Navigation and localization difficult – beyond horizon - only gross features from satellite images– choose paths near trackable features

Sunday, August 7, 2011

Page 64: Planning from Head to Toe - NASA– 4 levels of path planning – 3T+++ • Good abstraction is key – allows feedback from lower level failures – minimizes backtracking between

AmesResearchCenter Take Home Message

• Multiple levels of planning – 4 levels of path planning– 3T+++

• Good abstraction is key– allows feedback from lower level failures– minimizes backtracking between layers

• Task planning interacts primarily with highest layer– more serious with time constraints and duration uncertainty– breaks down w/tool usage

Sunday, August 7, 2011