32
Nick Clarke Data analytics: Multidisciplinary by Design October 2014 Translating solutions from other industries

Data analytics: Multidisciplinary by Design

Embed Size (px)

DESCRIPTION

Translating solutions from other industries

Citation preview

Page 1: Data analytics: Multidisciplinary by Design

Nick Clarke

Data analytics:

Multidisciplinary

by Design

October 2014

Translating solutions from other industries

Page 2: Data analytics: Multidisciplinary by Design

Amsterdam is a city of many bridges

Page 3: Data analytics: Multidisciplinary by Design

Cross industry analytics technology transfer

Increasing volume and complexity of data

New ways forward can be found in unexpected places

Outside Oil and Gas

Page 4: Data analytics: Multidisciplinary by Design

Bridging the communication barrier

man to dog

Page 5: Data analytics: Multidisciplinary by Design

dog to man dog to dog

Page 6: Data analytics: Multidisciplinary by Design

But when communication is established …

Page 7: Data analytics: Multidisciplinary by Design

Communication in the workplace

I have a practical problem. Can you

guys help me with it?

I tackle problems in the language of

mathematics. Please translate your problem.

analyst IT

I tackle them in the architectural language of data & information. Please translate your

problem. Both of them.

I just want my problem solved

Page 8: Data analytics: Multidisciplinary by Design

Analytics is inherently multidisciplinary

Data Handling

Skills

Math & Statistics

Knowledge

Domain Knowledge

Machine Learning

Drew Conway

Data Science

Page 9: Data analytics: Multidisciplinary by Design

Multidisciplinary structures can work …

chemistry

physics materials engineering

chemistry

physics numerical

computation at scale

nanotechnology quantum chemistry

Page 10: Data analytics: Multidisciplinary by Design

… but these examples are quite academic

chemistry

physics materials engineering

chemistry

physics numerical

computation at scale

nanotechnology quantum chemistry

Page 11: Data analytics: Multidisciplinary by Design

Not famous for great communication

chemistry

physics numerical

computation at scale

quantum chemistry

1 Dirac = 1 word per hour

"I was taught at school never to start a

sentence without knowing the end of it."

Page 12: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

electronics engineering

mechanical engineering medicine

Page 13: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

cochlear implants

Page 14: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

artificial pancreas

Page 15: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

digital band-aid heart monitor

Page 16: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

DNA mutation detection on a stick

Page 17: Data analytics: Multidisciplinary by Design

Chris Toumazou

Institute of

biomedical engineering

DNA mutation detection on a stick

Page 18: Data analytics: Multidisciplinary by Design

Medicine Digital Pathology

Security Feature Recognition

Consumer Animal Coat Condition

Oil & Gas Drill Bit Condition Assessment?

Camera data: Automated image analysis

Page 19: Data analytics: Multidisciplinary by Design

Sensor data: detection, tracking, prediction

Type 45 destroyer Sampson radar

Page 20: Data analytics: Multidisciplinary by Design

Military radar has come a long way

highly irectional

Page 21: Data analytics: Multidisciplinary by Design

Military radar has come a long way

highly irectional

Page 22: Data analytics: Multidisciplinary by Design

Military radar has come a long way

noisy data

multiple targets simultaneously

highly directional

Page 23: Data analytics: Multidisciplinary by Design

Rapid hypothesis testing

• Is it real?

• Is it friendly?

• What direction is it going in?

• What’s the risk?

Page 24: Data analytics: Multidisciplinary by Design

Our really clever 3-stage iterative process

Target extraction

– Bayesian filtering

– De-clutter data

– Type classification

Target tracking

– Optimal association

– Maximum likelihood

Target extrapolation

– Kalman filters

– Optimal fusion of

empirical data with

predictive model

Page 25: Data analytics: Multidisciplinary by Design

Our really clever 3-stage iterative process

Target extraction

– Bayesian filtering

– De-clutter data

– Type classification

Target tracking

– Optimal association

– Maximum likelihood

Target extrapolation

– Kalman filters

– Optimal fusion of

empirical data with

predictive model

Page 26: Data analytics: Multidisciplinary by Design

What does all that mean to me?

Target extraction

– Bayesian filtering

– De-clutter data

– Type classification

Target tracking

– Optimal association

– Maximum likelihood

Target extrapolation

– Kalman filters

– Optimal fusion of

empirical data with

predictive model

We can identify hard to find features, in messy data typical of real world problems

Once found we keep hold of those features, even in a fast changing environment

We combine multiple sources of information turn current knowledge into the best possible future predictions

Page 27: Data analytics: Multidisciplinary by Design

What does all that mean to me?

Target extraction

– Bayesian filtering

– De-clutter data

– Type classification

Target tracking

– Optimal association

– Maximum likelihood

Target extrapolation

– Kalman filters

– Optimal fusion of

empirical data with

predictive model

We can identify hard to find features, in messy data typical of real world problems

Once found we keep hold of those features, even in a fast changing environment

We combine multiple sources of information turn current knowledge into the best possible future predictions

Page 28: Data analytics: Multidisciplinary by Design

Radar threat identification and tracking Nerve pain signal transmission

Automated assessment of hair regrowth

Analytics transfer in action

Novel seismic data reduction techniques?

Page 29: Data analytics: Multidisciplinary by Design

Gear Changes Audio Analytics

Video image Analytics

Circuit Topology

Data fusion of audio and video

Page 30: Data analytics: Multidisciplinary by Design

LWD and MWD rig telemetry data • Noise reduction • Filter out and track key features of interest • Predict and test for future operational states

Data fusion of logging data?

Page 31: Data analytics: Multidisciplinary by Design

Data Handling

Skills

Analytics: Multidisciplinary by design

Domain Knowledge

Math & Statistics

Knowledge

Machine Learning

Data Science

Page 32: Data analytics: Multidisciplinary by Design

Making the bridges invisible