49

Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped
Page 2: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

Practical in Humanoid Robotics

Marcelo dos Anjos

University National of Asuncion

Page 3: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

About Me

Maker for hobby

Electronic Engineer Software and Computer Engineer Finishing my PHD in Computer Sciences

Page 4: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Motivation

Page 5: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Humanoid Robot

Humanoid refers to any being whose body structure resembles that of a human: head, torso, legs,arms, hands.

But it is also a robot made to resemble a human both in appearance and behavior

Page 6: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Humanoid Robot Applications

Page 7: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Why do we need a motion specification?

Difficulties for researchers in robotics: Industrial copyright Programs are not re-usable in

different robot families, even different versions of same robot families

Have to choose OS based on the drivers provided

Not easy to share a robot remotely with other collaborators in different locations

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Motion Commands

Windows? Linux? Mac OS?

Embedded OS?

Page 8: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Project goals OpenSource OpenHardware

Whatever: (cross-model) Provide a network-enabled interface for independent of the

controller libraries Access to other robots & simulators.

Whoever: (cross-platform) User interface must be cross-platform: support Linux, Mac OS X

and Windows. Wherever: (cross-network)

Good quality of service across the Internet.

Page 9: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Basic Components of Humanoid

Page 10: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture

Control Algorithm

Command Queue

Unit Control

Interface Hardware

Read

Write

Input sensors

Feedbackactuators

3D Choreography Programs

Artificial Intelligence

Robot Movement

Page 11: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Locomotion – Walking Video

Page 12: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Locomotion

Page 13: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Degree of Freedom (DOF)

Page 14: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Prices for Human Sizes Robots

Poppy Child Kit +- 9.000 u$$

Big Size Servo Motor 20 x 2.000 U$$ = 40.000 u$$.

Page 15: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Parts - Kits and Prices.

Page 16: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Parts

Page 17: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Parts

Page 18: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Parts

Page 19: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Servo Motor

Board

Board

Servo

Servo

Servo

M Servo M Servo M Servo

Digital or AnalogicServo Motors

Micro controlled Servo Motors

Page 20: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Micro controlled Servo Motor with PID

PID is the most commonly used servo control algorithm:

– Proportional

– Integral

– Derivative

PID systems can be understood by way of analogous physical models.

Page 21: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Micro controlled Servo Motor with PID

Page 22: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Servo Motor – Video and Practical

Page 23: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Main Board Control

Page 24: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Main Board Control - Practical

Page 25: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

3D Choreography - Practical

Page 26: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Sequencer – Practical

Page 27: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Dancing – Video and Practical

Page 28: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Artificial Intelligence

Artificial intelligence (AI) is a branch of science, which deals with helping machines find solutions to complex problem in a more human like fashion.

Borrowing characteristics from human intelligence, and applying them as algorithm in a computer friendly way.

Page 29: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Recognition Technology

1. Recognition of moving objects2. Posture/gesture recognition3. Environment recognition4. Sound recognition5. Face recognition.

Page 30: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Sound Recognition

Many Robots can distinguish between voices and other sounds.

He can respond to his name, face peoplewhen being spoken to, and recognizesudden, unusual sounds such as that of afalling object or a collision, and face in thatdirection.

Page 31: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Facial Recognition

Many Robots has the ability torecognize faces, or the human being ismoving.

It can individually recognizefaces. Once they are registeredit can address them by name.

Page 32: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - Specification Standard

Configuration Spec

Command Spec

Communication Spec

Abstraction

Page 33: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - System Overview

Client/Server

...

Client

Client

Server

Asimo Library

Pioneer Library

Simulator

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Configuration Spec

Command Spec

Communication Spec

Page 34: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - Robotalk Server

Server Daemon

Robot Daemon

Read and Write TCP/IP sockets

Issue Robot Driver Calls

CClientConnection

CClientConnection

Provide: Buffering, Scheduling, Panic, etc.

Class Interface

.

.

.

CRobotDriver

Page 35: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - CClientConnection

CClientConnection

Command Queue

Return Queue

Playback Queue

Read

Write

Input commands

Feedback

Priority Queues

Server Daemon

Robot Daemon

Page 36: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - CClient

Read Daemon

Return cache

CClient Class

Class Interface

Commands to the server.(Blocking/Nonblocking)

Feedback

(Nonblocking)

Broadcastcache

Function calls

Page 37: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Architecture - Communication Modes

Direct mode: blocking & instantaneous, for debug purposes

Delay mode: nonblocking, instantaneous or delay

Playback mode: nonblocking, adaptive caching based on channel quality

Broadcast mode: periodic query feedback

Page 38: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Direct Mode

Client Server Sync system clock

Clock

Command Cache

RobotDaemon

Client

Function call

Cache Return Cachereturn

Page 39: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Delay Mode

Client Server Sync system clock

RobotDaemon

Client

Cache

Function call

return

Delay

Command Cache

Clock +

Return Cacheerror signal

Page 40: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Playback Mode

Client

Cache

Function call

return

Return Cacheerror signal

Clock

Playback Cache

Command Cache

Delay

RobotDaemon

Client Server

Length of the sequence

Page 41: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Broadcast Mode

Client

Cache

Broadcast

call

return

Command Cache

RobotDaemon

Return Cachedata

Delay

Page 42: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Conclusions

Motivations System Structure Four Network Command Modes Future Extensions

Exclusive control Data channels Controlling multiple humanoid robots Virtual humanoid robots

Page 43: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Virtual Humanoid

Server

Pioneer Library

Camera Library

Puma Library

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

Site A

Site B

Virtual Humanoid

Page 44: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Conclusion

Page 45: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Conclusion

Page 46: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Conclusion

Page 47: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

References

== H. Kitano and H. Asada, “The RoboCup humanoid challenge as the millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736.

== C. Zhou and Q. Meng, “Dynamic balance of a biped robot using fuzzy reinforcement learning agents,” Fuzzy Sets and Systems 134(1) (2003) 169-187.

== http://www.davidgeer.com/artificial-intelligence-humanoids-david-geer.pdf

== http://plen.jp/playground/wiki/about

== www.airspacedefense.org

== All CODES in

https://github.com/splash2018

Page 48: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Thank you!

Page 49: Practical in Humanoid Robotics - MIT ESP...millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736. == C. Zhou and Q. Meng, “Dynamic balance of a biped

[email protected]

Contact

== All CODES in https://github.com/splash2018