39
Intelligent Machines Hermann Hauser Cambridge July 2018 Evolution Design

Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

  • Upload
    others

  • View
    13

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Intelligent MachinesHermann Hauser Cambridge July 2018

Evolution Design

Page 2: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Biological Machines

Neurons

Think: Brains

Hear: Ears

See: Eyes

Move: Legs

Learn: Schools

Disruption

Evolution

Human Goals

Artificial Machines

Transistors

Computers

Microphones

Cameras

Robots

Machine Learning

Cars, Healthcare

Design

Contents

Page 3: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Neurons vs. Transistors

Size: 20um

Speed: 1kHz

Brain: 100bn

Connections: 100tr

20nm 1000x

1GHZ 1,000,000x

10bn 1/10x

Internet: 1bn hosts

20bn IOT connected

Page 4: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Soma

Dendrites

Axons with myelin sheaths

Synapses

Voltage gated Ion channels

Hodgekin-Huxley model

Neurons

Page 5: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• Source, Gate, Drain

• Simple, uniform

• Universal building block:

• NAND GATE

Transistors

Page 6: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Think

Page 7: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Capacity:

10 to 100TB

Processing power:

10Peta-1ExaFLOPS

Power consumption:

20W

Connections: 100tr

500TB 5x

10TeraFLOPS:

1000x

200kW 10,000x

Memory 512GB

1g

Brains vs. Computers

GPU Graphical Processing

Unit

Page 8: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Neural Networks

Page 9: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• MRI picture from Oxford

• 200 different brain regions

• 461 people

Human Connectome

Page 10: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Graphcore IPU

(Intelligent Processing Unit)

• Graphcore

• 7,000 processors

• 350MB RAM

• largest chip in the world: inch a side

• BSP: Bulk Synchronisation Protocol

Page 11: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Hear

Page 12: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Frequency:

20-20kHz

Loudness:

0 to 120dB

Sound localisation:

5deg

20- GHz Ultrasound

10 to 220dB SaturnV

much finer

Ears vs Microphones

Hear

https://youtu.be/-7xvqQeoA8c

Page 13: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• Amazon Echo

• Software from EVI

• Xmos working on best HW solution

• Hearing people across a crowded room

• Voice recognition across a room

Beam forming Microphone

Page 14: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

See

Page 15: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Resolution:

0.1mm

Speed:

1/100 sec

Frequency

430-770THz

Number: 2

Angstrom: 1,000,000x

psec: 10^10x

3Hz-300EHz

100,000

Eyes

Camera

Page 16: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •
Page 17: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• At least 100k webcams

• Autonomous vehicles will need 6 to 16

• Connected cars will get info from cars in

front and CCTV

Many Cameras

Page 18: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Self-driving car

Page 19: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Millenials

• Transport as a service

• No interest in driving

• Live in cities

• Get their information on the web

Page 20: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Move

Page 21: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• Boston Dynamics

• Handle

Legs vs. Robots

Page 22: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Learn

Page 23: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

What is Machine Learning?

Systems that learn from data rather then following

pre-programmed rules

(Royal Society ML Report)

Page 24: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Branches of ML

• SUPERVISED ML: trained on LABELED DATA

• UNSUPERVISED ML: without labels

• REINFORCEMENT ML: learning from experience, reward

function (winning game)

• INVERSE REINFORCEMENT ML: system has to deduce

reward function buy observation (driving a car)

Page 25: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

ML Examples

• Speech recognition: Google, Siri, Alexa

• Object / Face recognition: Google Photo

• Recommender systems: Amazon, Netflix

Page 26: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Probablility and ML

• NOT 0s and 1s but P for Probability

• NOT deterministic but STATISTICAL

• NOT programming but TEACHING

• Needs Big Data

• Needs (Human) GOALS

• Genie Problem

Page 27: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Artificial Intelligence

Page 28: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

AI Risks

“Success in creating AI would be the

biggest event in human history.

Unfortunately, it might also be the last,

unless we learn how to avoid the risks.”

“Hope we’re not just the biological boot

loader for digital superintelligence.

Unfortunately, that is increasingly

probable.” 28

Page 29: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Life 3.0

Page 30: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Evonetix

The GeneSynthesis

Company

Pixelflo

w

Page 31: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

AlphaGo

Move 37

in game 2

Move 78

in game 4

Page 32: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Disruption

Page 33: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

ARM Business model

Intel ARM

Customer Dell,HP Samsung,Apple

Chipfab Intel TSMC+450

Design Intel ARM

Intellectual

PropertyIntel ARM

Page 34: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

ARM

• 100bn shipped >10x population of earth

• $30bn sale to Softbank

• >95% market share in phones

• ARM:Intel = 20:1

• ARMs 450 licensees: ARM $ > Intel Revenue

• Licensing model

• Low power

Page 35: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

ML effect on Car industry

Today With ML

Customer Showroom Uber

Autonomous SW BMW, Tesla Uber, FiveAI

Car BMW,Tesla BYD, KIA

Components Bosch China

Page 36: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Trillion $ Opportunity

• US spends $3tr on Healthcare

• Treating ill people: 70%

• Keeping them healthy: 30%

• Expected to change to 50:50 in 5 yrs

Page 37: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

ML effect on Pharma

Today With ML

Customer Patient Healthy person

Provider Doctor/hospital e-Health

Supplier PharmaPersonalised

Advice

Components Drugs Data

Page 38: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

Evolution vs DesignEvolution vs. Design

Page 39: Intelligent Machines - pdfs.semanticscholar.org€¦ · (Intelligent Processing Unit) • Graphcore • 7,000 processors • 350MB RAM • largest chip in the world: inch a side •

• Humanity has a new partner:

• Intelligent Machines

• How to co-evolve with them?

Conclusion