AI Trust and Safeguards

Trust and Safeguards

Peter Cochrane

AI Summit, Olympia, London 29 November 2017

cochrane.org.uk

Where Are We Today?At the foothills of AI we have a mountain to climb

Intelligence

Abilities

Categories

1) NarrowSingular Problem Solving with human involvement

in coding and tuning

Human based algorithm Top down, Bottom up Machine learning

2) Learning

3) Cognitive

4) Wide


Intelligence

Abilities

Categories




2) Learning

3) Cognitive

4) Wide

Most AI today is here as is so very easy

Google alphago

IBM Watson


Intelligence

Abilities

Categories




Multiple Problem Classes with interactive memory - little or no human help

Initial algorithms from (1) + a learning abilty - solves problems by observing, playing and creating rule sets

2) Learning

3) Cognitive

4) Wide

A wide range of problem sets - with cognition &

near 100% autonomy

Initial algorithms from (2) + a degree of understanding - sees new ways of analysis and solution formulation

Can address any problem type/set - has high level

context/self awareness

A completely new ‘mind’ proposition in a variety of species connected to the wider environment - autonomous


Google alphago

IBM Watson


Intelligence

Abilities

Categories






2) Learning

3) Cognitive

4) Wide


near 100% autonomy





Machine influenceHuman influence


Google alphago

IBM Watson

IsolatedFixed

Machines

NetworkedFixed

Machines

NetworkedFixed/MobileWith Sensors

NetworkedFixed/MobileWith Full I/O


Intelligence

Abilities

Categories






2) Learning

3) Cognitive

4) Wide


near 100% autonomy





Machine influenceHuman influence


Google alphago

IBM Watson

IsolatedFixed

Machines

NetworkedFixed

Machines

NetworkedFixed/MobileWith Sensors

NetworkedFixed/MobileWith Full I/O

Main Frame

Main FramePC Laptop

Main FramePC Laptop

Mobile

Main FramePC Laptop

Mobile Robot

Sentient Machines

Sentient Lifeforms

Cyborgs

Languages &TechniquesThe biggest fract ion of the technology mixes today

TechniquesSoftware

An A.I. system:

1) Must be subject to the full gamut of laws that apply to its human operator/creator

2) Must clearly disclose that it is not human

3) Cannot retain or disclose confidential information without explicit approval from the source

Etzioni’s 2017

A Robot must:

0) Not harm humanity, or, by inaction, allow humanity to come to harm

1) Not injure a human being or, through inaction, allow a human being to come to harm

2) Obey orders given it by human beings except where such orders would conflict with the 1st Law

3) Protect its own existence as long as such protection does not conflict with the First or 2nd Law

Asimov’ 1942

LAWS To Be HEEDED ?Ignored by governments & industry to date

An A.I. system:

1) Must be subject to the full gamut of laws that apply to its human operator/creator

2) Must clearly disclose that it is not human

3) Cannot retain or disclose confidential information without explicit approval from the source

Etzioni’s 2017

A Robot must:





Asimov’ 1942

LAWS To Be HEEDED ?Ignored by governments & industry to date

NEVER APPLIED

N o C h a n c e

STO P P R ESSKi l le r A I & Robots are GO!

A I A R M S

RACE IS GO

ONLY ONEAl l that i s needed

Mobi le AI /Robot ic weapon p lat forms demand far less resources than any atom bomb and/or miss i le program

Numerous rogue states wi l l qu ick ly embrace th is new opportunity !

We a p o n s

C o n t r o l S E E M S

I m p o s s i b l e

Etzioni’s 2017

AI & Robots must:





4) Be subject to the full gamut of laws that apply to its human operator/creator

5) Clearly disclose that it is/they are not human

6) Not retain or disclose confidential information without explicit approval from the source

7) Be bounded in their actions & inaction according to the safety requirements of humans and their systems

8) Not violate human social, cultural, safety and legal norms

9) ????

Asimov’ 1942

LAWS To Be combineD ?To be ignored by future governments & industry

Etzioni’s 2017

AI & Robots must:





4) Be subject to the full gamut of laws that apply to its human operator/creator

5) Clearly disclose that it is/they are not human

6) Not retain or disclose confidential information without explicit approval from the source

7) Be bounded in their actions & inaction according to the safety requirements of humans and their systems

8) Not violate human social, cultural, safety and legal norms

9) ????

Asimov’ 1942

LAWS To Be combineD ?To be ignored by future governments & industry

L e g a l

e n f o rc e m

e n t

v e r y u n l i k e l y

Meanwhile in industry ?People protected from robots by wire cages and bars

A s s i s t a n t

AT HOME in officePeople are us ing and working with AIAI i s increas ingly a l l pervas ive in homes, of f ices , appl iances , vehic les , mobi les and our trust and dependency i s bui ld ing fast - i t i s changing everything…

Fam i l i ar ityJust a repeat of the past ?

Faster, more profound, inclusive and impactful with an acceleration of other technologies and big changes in the way we work and live…..

A greater dependency and risk of human errors/mistakes

Job creation on huge scale but with vast shortages of skilled and capable people

Breeds trust & dependency Fam i l i a r i ty

It takes time: builds slowly along with the abil ity to work together in teams using tools, tech and nets to collaborate globally +++

AI wil l soon be doing trust and dependency rankings of us; our teams, tools, faci l it ies, plant & companies along with other AI systems +++ It is an essential for their real world modell ing

Man Woman

Machine

A tr iad of trust mechanisms at

work here

A population of ’N’ machines could see ≤ N(N-1) different trust mechanisms at work at

the same t ime

SAFEGUARDSO p e ra t i o n a l m e a s u re s Te s t i n g F i xe d , C o m b i n a t o r i a l , D y n a m i c

- G o l d s t a n d a rd p ro b l e m c h e c k s - M a t h p r o v a b l e v e r i f i c a t i o n s - W i t h i n n o r m a l i n p u t r a n g e - B e y o n d n o r m a l i n p u t r a n g e - A n o m a l y t e s t a n d s e a r c h - S t r u c t u re d w a l k t h ro u g h - Monte Car lo assessment - D y n a m i c f l o o d t e s t i n g - P re - re l e a s e re a l d a t a - R e g r e s s i o n t e s t i n g - S t a t i s t i c a l a n a l y s i s - S e n s i t i v i t y a n a l y s i s - N e w d e v e l o p m e n t s

SAFEGUARDSO p e ra t i o n a l m e a s u re s

C o n s t r a i n e r s F i xe d , C o m b i n a t o r i a l , D y n a m i c

- I n p u t s e n s o r / d a t a r a n g e l i m i t e r s - O u t p u t a c t u a t o r / d a t a l i m i t e r s - A n o m a l y d e t e c t i o n / w a r n i n g s - H i s t o r i c a l e x c e p t i o n f l a g s - H u m a n i n t e r v e n t i o n a l e r t s - M 2 M r a n g e c o m p a r i s o n s - C o m p l i a n c e m o n i t o r i n g - S t a t i s t i c a l I / O t re n d i n g - N e w d e v e l o p m e n t s - C o re a c t i v i t y f l a g s - F l O P c o u n t e r a l e r t s - E n e r g y c o n s u m p t i o n a l a r m

Human SafetyRooms, floors, cages and barriers

We have kept machines and people well apart for decades and only recently have we considered it safe to mix the two in the same space…

H uman S a f etyRestricted inputs/outputs by design

This philosophy is applicable to AI and Intelligent roboticsand by default, industry, appliance and vehicle producers

et al are obeying ‘The Laws of Robotics and AI’ to date

https://www.youtube.com/watch?v=F6UxmpbSQGU&ab_channel=JustWowme

FAR FUTUREAI + Human guardians

Being discussed, debated andInitially researched at this time:

Policing AI into the future by Humans,AI, Bots, Machines, Networks:- Interrogators

- Enforcers

- Monitors

- Auditors

- Ethicists A lot of research/thinking required as a sentient and creative AI may be capable of outsmarting any and all guardianship systems

Thank Youwww.cochrane.org.uk

What are these crazy humans planning to do next ?? They are

the biggest risk and not us!!

http://cochrane.org

Technology

AI Trust and Safeguards