The Impact of SMACT on the Data Management Stack

Darren Cunningham, SnapLogic

About Me •  Responsible for Marketing @ SnapLogic

o  Co-founded by Gaurav Dhillon, co-founder and former CEO of Informaticao  www.SnapLogic.com

•  Prior to SnapLogic: o  4 years at Informatica (Cloud Team)o  2 years at LucidEra (Cloud BI)o  1 year at Salesforce (Analytics / AppExchange)o  7 years at Business Objects

The New Enterprise Integration Challenges Big Data Access and Analytics! Disconnected SaaS Silos!

API Proliferation! The Internet of Things!

We Recently

Posted This

Infographic…

of line of business employeesadmit to using non-approved

SaaS applicationsin their jobs

The global HadoopMarket is estimated to reach

$50.2 billion by 2020.

It was valued at $1.5 billion in2012 and is expected to grow

at a CAGR of 58.2%between 2013 to 2020

The Integrator’s Dilemma !

Old Approaches Not Built for the New Data Challenges

•  Not built for the web• On-prem ESB (xml, soap)• Code-intensive

Legacy EAI •  Built for rows and columns•  Batch-oriented•  Struggles with real-time

Legacy ETL

The Integrator’s Dilemma is faced when legacy integration solutions are no longer effective in the new world of Social, Mobile, Analytics (Big

Data), Cloud and the Internet of Things

2003 2014

So What’s Changed? 1 Speed

2014 TechValidate Survey

So What’s Changed? 2 User (and Buyer) Expectations

Citizen integrators are proliferating, in most cases outside of the control or

visibility of whoever in the company is commissioned with fulfilling integration. 

So What’s Changed? 3 The Data (Volume, Velocity, Variety, right?)

Top 5 Use Cases:

1) Customer Analytics 2) Operational Analytics: Understanding Machines, Devices and Human Interactions 3) Fraud and Compliance 4) Data-Driven Products & Services 5) EDW Optimization

Source: Datameer

So What’s Changed? 4 Cloudification and “Data Gravity” (iPaaS, elastic scale, opex)

CRM!HRMS ! ITSM!

SCM!

Analytics!

?

?

ERP?

The Cloud Analytics Wave

Analytics

So What’s Changed? 5 Standards, Protocols and Architectural Styles

Whitepaper on Cloud Integration

•  From XML to JSON•  From SOAP to REST•  From ESB to iPaaSWorking on ETL Paper…stay tuned!

Buses Don’t Fly in the Cloud Why the ESB Is the Wrong ApproachFor Cloud Integration

What’s the Same? It’s All About the Pipes!

Your Integration Strategy: Innovation On Ramp or Roadblock?

2014 TechValidate Survey

Same Old, Same Old (SO SO) is not an Option

•  Determine if you’re suffering from the “Integrator’s Dilemma”o  Multiple teams and tools for EAI, SOA, ESB / ETL, ELT; old tech used to solve new challenges

•  Review your ICC / COE practiceso  Command and control won’t fly in the age of the “Citizen Integrator” and need for speed

•  Do an audit of your cloud applications currently in useo  Find out how/if they’re integrated and how it’s going (typically many SaaS silos)

•  Dig into Hadoopo  The economics and scale will make it a key component of your data infrastructure

•  Investigate AWS Redshift other cloud DW / BI options

SnapLogic Elastic Integration Single Platform Connecting���

Data, Apps, APIs

SnapLogic: Connecting Data, Apps and APIs •  Experienced Team: Leadership from Informatica,

Salesforce, Microsoft•  Investors: Andreessen Horowitz & Ignition•  Advisory Board: AstraZeneca, HP, Symantec, Yahoo•  Headquarters: San Mateo, CA•  Customers: Adobe, Acxiom, Blackberry, Bloomin’ Brands,

CapitalOne, Cisco, GE, iRobot, Netflix…

Why SnapLogic Elastic Integration?

!

Easily Design Monitor, Manage

Deploy in Days not Months

•  EAI, ETL, APIs, Hybrid Deployment

•  Modern Standards: REST, JSON

•  Scale Out ArchitectureRESTSOAPWEBAPIs

Multi-Point ! Modern!Fast !

Hybrid Architecture

•  Streams: No data is stored/cached

•  Secure: 100% standards-based

•  Elastic: Scales out & handles data and app integration use cases

Metadata

Data

Software Defined Integration

Integration Cloud!Designer, Manager, Dashboards

(Multi-tenant cloud service)

Elastic Execution!Snaplex

Snaps!(Buy or Build)

“Cloudplex”

“Groundplex”

“Hadooplex”

SnapReduce and the Hadooplex Acquire, Prepare, Deliver Big Data

YARN

YARN

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

MapReduce

Snaplex YARN Application!

MapReduce Generation!

Snaplogic iPaaS + Hadoop

= Snaplex Container

Common SnapLogic Use Cases

Cloud App Integration

•  Workday: HR On-Boarding

•  Salesforce: CRM Back Office

•  Eliminate SaaS Silos

Digital Marketing

•  AWS Redshift•  Tableau, Social, CRM•  Cloud Analytics

Big Data Analytics

Enterprise Platform

•  Data Access•  Data Preparation•  Data Delivery

•  Self Service•  Data, Apps, APIs•  Integrator’s Solution

– Jim Teal, Information Architect, iRobot

We looked at SnapLogic as an opportunity to think differently about integration. With a document-centric processing approach and schema-

less platform, we’ve been able to eliminate some of the rigidity and time-consuming tasks related to traditional integration patterns.

$555M revenue, 534 employees

Challenges Faced:•  Geographically distributed manufacturing

•  Wanted to improve data quality and eliminate FTP and VPN channels

•  Growing cloud app adoptionWhy SnapLogic?

•  Flexibility: Control plane in Boston, data planes in China, schema-less approach

•  Connectivity: Standards connectivity, eliminated VPNs, etc.

•  Productivity: 68 to 6 pipelines

Designs and builds robots that make a difference in people’s lives

Largest apparel brand ever built on the web in the United States.

•  1 month vs. 6m-1yr•  Reduction in headcount to administer and maintain•  Lowers the barrier to entry for advanced analytics

Speed

Flexibility

Scale

Amazon  Redshi.  

Repor1ng  Pla5orm  

Analy1cs  Pla5orm  

Data  Integra1on  Pla5orm  

Real-­‐Time  Dashboards  

Challenges Faced: !How to integrate all of the company's applications and keep its 24/7 operations running smoothly.

Why SnapLogic?!

Speed: Northgate was able to achieve a significant improvement in sales order throughput and accuracy.

Productivity: In a matter of months, the company went from 30 pipelines to 64, all while adding 14 additional stores

Connectivity: Modernized and connected the ERP and WMS systems in only 12 weeks

50+ stores serving needs of Hispanic community in Southern CA and AZ

The Impact of SMACT on the Data Management Stack?

•  Presents an opportunity to re-think your approach to data and application integration

•  Means you need to accept / embrace self-service data access (citizen integrators)

•  Data, App, API integration converging quickly•  Innovation is back in the DI market (so don’t settle for same old, same

old – SO SO Integration)

Discussion

@SnapLogic

Facebook.com/SnapLogic Plus.google.com/+SnapLogic