Let hackathons help your new product development strategy (by João Abrantes)

3.4 Let hackathons help your new product development strategy

CONFIDENTIAL1

Template presentation Innovation Day 2016 CONFIDENTIAL

LET HACKATHONS HELP YOUR NEW PRODUCT DEVELOPMENT STRATEGY

João AbrantesManaging Director Load [email protected]

TRACK 3: EVOLVING ARCHITECTURES


CONFIDENTIAL2

1

2

3

4

5

Content

Introduction

Internet: Past, Present, Future

Big Data Technologies

How companies are dealing with it

How internal hackathons can help


CONFIDENTIAL3

CONFIDENTIAL3

INTRODUCTIONWho am I and what are we going to talk about


CONFIDENTIAL4

Who am I

Name: João Abrantes

Job: Managing Director

Company: Load Interactive

Mobile: +351 966 071 667

Email: [email protected]

Linkedin: https://pt.linkedin.com/in/jabrant3s


CONFIDENTIAL5

What are we going to talk about

World is turning digital

Big technological changes

Companies need to be agile and adapt

Data is turning ‘Big’ in size and variety

There are many technological choices to make

Digital Innovation decisions need to me taken fast and with high level of confidence

Internal hackathons will help


CONFIDENTIAL6

CONFIDENTIAL6

INTERNET: PAST, PRESENT, FUTUREPast, present and forecasting the future for the internet


CONFIDENTIAL7

CONFIDENTIAL7

OUR TECH WORLD SO FAR ...A brief look at the evolution of the Internet as a technology for People


CONFIDENTIAL8

World is changing fast


CONFIDENTIAL9

Millennials will soon become the dominant generation

Source: Kleiner Perkins Caufield Buyers, Internet Trends


CONFIDENTIAL10

Big GAP between Millennials and their predecessors



CONFIDENTIAL11

There is also a GAP between Millennials and Generation Z



CONFIDENTIAL12

Internet is all around although still growing



CONFIDENTIAL13

Online shopping is also growing rapidly



CONFIDENTIAL14

Social networks became visual and real-time/near-real-time



CONFIDENTIAL15

Traditional services are becoming connected



CONFIDENTIAL16

Searching via non-textual inputs is growing



CONFIDENTIAL17

Globally, market, products & services are becoming connected


CONFIDENTIAL18

It implies major changes to the Internet stack



CONFIDENTIAL19

CONFIDENTIAL19

IT IS ALL ABOUT DATAData nowadays and in the future


CONFIDENTIAL20

What happens in an internet minute?

USA 2016 ConsumptionIn Real-time

Source: Visual Capitalist


CONFIDENTIAL21

This is...


CONFIDENTIAL22

Data growth forecast

Gigabyte Terabyte Petabyte Exabyte Zettabytex 1024 x 1024 x 1024 x 1024


CONFIDENTIAL23

The 4 V’s of Big Data

Source: Technophenia


CONFIDENTIAL24

Mainly, where is Big Data still coming from?

Source: IBM


CONFIDENTIAL25

CONFIDENTIAL25

BIG DATA TECHNOLOGIESLet’s dive in a bit in technology


CONFIDENTIAL26

CONFIDENTIAL26

BIG DATA?SOMEONE IN THE ROOM SAYS:“WHAT ABOUT HADOOP?”Let’s dive in a bit and learn the basics


CONFIDENTIAL27

Hadoop

• Open-source project to work with Big Data• Created by Doug Cutting• Written in Java• Optimized to handle

• Massive amount of data• Variety of data• Using inexpensive commodity hardware

• Great performance• Reliability provided through replication• Complements Online Transaction Processing and Online

Analytical Processing• It is not a replacement for a relational database system

https://www.youtube.com/watch?v=ebgXN7VaIZA





CONFIDENTIAL28

Main distributions

• Open-source (apache.org)

• Free vs Paid services

https://aws.amazon.com/emr/details/hadoop/

https://aws.amazon.com/emr/details/hadoop/

http://www.cloudera.com/products/apache-hadoop.html

http://www.cloudera.com/products/apache-hadoop.html

http://hortonworks.com/apache/hadoop/

http://hortonworks.com/apache/hadoop/

https://www.mapr.com/products/apache-hadoop

https://www.mapr.com/products/apache-hadoop


CONFIDENTIAL29

Two basic components (core)

Data• HDFS (Hadoop Distributed File System)Distributed file-system

Processing• Hadoop MapReduceProgramming model for large scale data processing


CONFIDENTIAL30

Basic Hadoop architectural stack

• Original Version (1.0)

MapReduce(cluster resource management & data processing)

Pig(data flow)

Hive(SQL)

Others(cascading)

HDFS(redundant, reliable storage) Data

Processing

Other applications


CONFIDENTIAL31

HDFS

• Example

training.txt150mb

64mb

64mb

22mb

blk_1

blk_2

blk_3

Split into chunks

Question:What happens when the file is uploaded to HDFS?


CONFIDENTIAL32

HDFS

64mb

64mb

22mb

DataNodes

NameNode


CONFIDENTIAL33

HDFS

• Data Redundancy


CONFIDENTIAL34

HDFS

• Data Redundancy


CONFIDENTIAL35

HDFS

NameNode

NFS(network file system)

NameNode(active)

NameNode(standby)


CONFIDENTIAL36

Map Reduce

• Mappers• Can work at the same time with chunks of data

(ex: first record, write to a card the name of the storeand the amount of the sale)

• Cards of the same store go in the same pile

• Reducers• Each reducer is reponsible for a specific store(s)• Retrieve the pile of cards related to their stores• Create a larger pile

------------

-----

--

----

Mappers

Reducers

Intermediate Records(Key, Value)

Results

Suffle and Sort

(Key, Values)


CONFIDENTIAL37

Map Reduce

• Daemons

Job Tracker

Task Trackers


CONFIDENTIAL38

CONFIDENTIAL38

IS HADOOP THE KEY FOR ALL THE DOORS?


CONFIDENTIAL39

No. There is a variety of options, for multiple purposes


CONFIDENTIAL40

Big Data Landscape is broad and full of players


CONFIDENTIAL41

CONFIDENTIAL41

SO WE’VE GOT TO CHOOSE WHAT’S BEST FOR OUR BUSINESS


CONFIDENTIAL42

CONFIDENTIAL42

HOW COMPANIES ARE DEALING WITH ITStruggles perceived from the corporate world


CONFIDENTIAL43

Some companies have it in their DNA


CONFIDENTIAL44

Some simply don’t want to know about it


CONFIDENTIAL45

Others say they do... (But they don’t)


CONFIDENTIAL46

And finally, the rest is struggling to get into it


CONFIDENTIAL47

CONFIDENTIAL47

HOW INTERNAL HACKATHONS CAN HELPOur disruptive approach to face the uncertainty


CONFIDENTIAL48

Usual Tech Innovation process


CONFIDENTIAL49

But it could be done better


CONFIDENTIAL50

We start with a...


CONFIDENTIAL51

How it works

- Team

- Duration

- Schedule

- Rules


CONFIDENTIAL52

The challenge

Limited time

Main goalTechnology


CONFIDENTIAL53

The results


CONFIDENTIAL54

Innovation Day is an initiative of Masters in Innovation, the umbrella brand of the Verhaert Group which aims to connect, train and accelerate professional innovators.

KruibekeBelgiumHogenakkerhoekstraat 21B-9150 KruibekeT +32 3 250 19 00E [email protected]

www.verhaert.com

NivellesBelgium

NoordwijkNetherlands

Av. Robert Schuman 102B-1400 NivellesT +32 67 47 57 10E [email protected]

www.lambda-x.com

Kapteynstraat 12201 BB NoordwijkT +31 71 760 05 50E [email protected]

connect.verhaert.com

INDUSTRY

TECHXFER

MEDICAL

AEROSPACE

TECHXFER

FMCGCONNECT

TECHXFER

FMCGCONNECT

MEDICAL

AveiroPortugalAv. Dr. LourençoPeixinho 96D 4o3800-159 AveiroT +351 234 604 088E [email protected]

www.load-interactive.com

CONNECT

GentbruggeBelgiumBruiloftstraat 55-57B-9050 GentbruggeT +32 9 330 27 90E [email protected]

www.moebiusdesign.com

ON SITE CONSULTANCY

Business

Let hackathons help your new product development strategy (by João Abrantes)