40
The Briefing Room

Where the Warehouse Ends: A New Age of Information Access

Embed Size (px)

DESCRIPTION

The Briefing Room with Barry Devlin and Composite Software Live Webcast May 21, 2013 All good things must come to an end, and even though the data warehouse will remain a prominent force in the information age, the handwriting is all over the enterprise: the center of gravity is moving. Whether due to Big Data or real-time demands, Cloud computing or globalization, today's leading organizations have analytical needs that the warehouse simply cannot accommodate. That's why data virtualization continues to attract attention. Register for this episode of The Briefing Room to hear veteran Analyst Barry Devlin explain why the traditional model for data warehousing is being outmoded by a range of more flexible methods for accessing and analyzing information assets. He'll be briefed by David Besemer of Composite Software who will discuss how his company's data virtualization platform can be used to provide access to all manner of information sources, including data warehouses, Big Data silos, as well as partner and public data sources on demand. Visit: http://www.insideanalysis.com

Citation preview

Page 1: Where the Warehouse Ends: A New Age of Information Access

The Briefing Room

Page 2: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

Welcome

Host: Eric Kavanagh

[email protected]

Page 3: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

!   Reveal the essential characteristics of enterprise software, good and bad

!   Provide a forum for detailed analysis of today’s innovative technologies

!   Give vendors a chance to explain their product to savvy analysts

!   Allow audience members to pose serious questions... and get answers!

Mission

Page 4: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

MAY: Integration

June: DATABASE

July: CLOUD

August: HIGH PERFORMANCE ANALYTICS

Page 5: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

Processing Monitoring

Integration

MOBILE

M a c h i n e - g e n e r a t e d

RFID

SINGLE VIEW

Applications +

Web Services

Excel +

Flat files

Hadoop +

Big Data

OLAP Cubes +

Data Warehouse

XML

RDBMS

Page 6: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

Analyst: Barry Devlin

 Barry Devlin is the founder and principal of

9sight Consulting

Page 7: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

!   Composite Software takes the data virtualization approach to the data integration challenge, providing an agile, relatively low cost solution with rapid deployment and quick iterations

!   Its platform unifies data from multiple, disparate sources into a logical virtual data layer and readies data for consumption

!   Composite’s Analytic Sandbox and Analytic Hub allow analysts the flexibility to perform purposeful analytics

Composite Software

Page 8: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

David Besemer

David Besemer is the CTO of Composite Software. For over twenty-five years, David has architected and engineered leading-edge software technologies and companies. Before joining Composite he was CTO in residence for several venture firms, CTO of eStyle and Product Marketing Director at NeXT Computer. Prior to that he built program trading systems on Wall Street and researched natural language processing systems at GE’s Corporate R&D center. David holds a BS in computer science from Michigan State University and an MS in computer science from Rensselaer Polytechnic Institute.

Page 9: Where the Warehouse Ends: A New Age of Information Access

9 © 2013 Composite Software, Inc., Composite Proprietary

Data Integration for Analytics

The Briefing Room David Besemer

CTO Composite Software

Page 10: Where the Warehouse Ends: A New Age of Information Access

10 © 2013 Composite Software, Inc., Composite Proprietary

OTHER BUSINESSES

Business Leaders Take Advantage of Their Data

OBJECTIVES: •  Agility •  Cost Reduction •  Competitive Advantage

BUSINESS LEADERS

Page 11: Where the Warehouse Ends: A New Age of Information Access

11 © 2013 Composite Software, Inc., Composite Proprietary

Data Warehouses

Supplying Data for Analytics Used To Be Easier

The Business

Page 12: Where the Warehouse Ends: A New Age of Information Access

12 © 2013 Composite Software, Inc., Composite Proprietary

Data Warehouses

Operational Databases

Enterprise Applications

Today Data for Analytics Presents A Bigger Challenge

The Business

“The Cloud”

“Big Data”

Third Party Data

Page 13: Where the Warehouse Ends: A New Age of Information Access

13 © 2013 Composite Software, Inc., Composite Proprietary

Data Warehouses

Composite Lets You Take Big Advantage of Your Data

Operational Databases

Enterprise Applications “The Cloud”

“Big Data”

Third Party Data

The Business

Page 14: Where the Warehouse Ends: A New Age of Information Access

14 © 2013 Composite Software, Inc., Composite Proprietary

Organizations That Gain Big Advantage Using Composite

Page 15: Where the Warehouse Ends: A New Age of Information Access

How to Solve the Analyst’s Data Problem

Page 16: Where the Warehouse Ends: A New Age of Information Access

16 © 2013 Composite Software, Inc., Composite Proprietary

The Analyst’s “Data Problem”

Find the Data

Access the

Data

Build a Sandbox for the

Data

Build the Model

Analyze the

Results

Develop the

Business Insight

“Analysts spend more than half their time pulling

together their data”

Page 17: Where the Warehouse Ends: A New Age of Information Access

17 © 2013 Composite Software, Inc., Composite Proprietary

Iterate, Iterate, Iterate….. Agility Is Critical

Find the Data

Access the

Data

Build a Sandbox for the

Data

Build the Model

Analyze the

Results

Develop the

Business Insight

Page 18: Where the Warehouse Ends: A New Age of Information Access

18 © 2013 Composite Software, Inc., Composite Proprietary

Addressing the Analyst’s Data Problem

•  Identify local, enterprise and external data sources

•  Flexibly group, sort and search sources

Find the Data

Access the

Data

Build a Sandbox for the

Data

•  Connect various source data types and data shapes

•  Explore live data

•  Create a unified data model

•  Filter, transform and aggregate data sets

•  Selectively materialize into sandbox host

Page 19: Where the Warehouse Ends: A New Age of Information Access

19 © 2013 Composite Software, Inc., Composite Proprietary

Data Warehouses

Deployment Options: Analytic Sandboxes & Data Hubs

Operational Databases

Enterprise Applications “The Cloud”

“Big Data”

Third Party Data

Analytic Data Hub

Analytic Data Hub •  Agility •  Self-service •  Recurring analyses •  Broader use •  Central control

Analytic Sandbox •  Agility •  Self-service •  One-off analyses •  Personal use •  Local control

Analytic Sandbox

Page 20: Where the Warehouse Ends: A New Age of Information Access

20 © 2013 Composite Software, Inc., Composite Proprietary

Benefits

• Faster time to analysis ◦ Simplify access to enterprise and local data ◦ Accelerate insight and business impact

• Self-service data integration ◦ Empower analytic users ◦ New role for IT as data provider

•  Improved data consistency and quality ◦ Promote reuse of proven datasets • Share data integration logic across analytic tools

Page 21: Where the Warehouse Ends: A New Age of Information Access

21 © 2013 Composite Software, Inc., Composite Proprietary

Gain More Insights By Leveraging All Your Data

$21M in Services Upsell Revenue

$9M Increase in PlayStation Revenue

Page 22: Where the Warehouse Ends: A New Age of Information Access

22 © 2013 Composite Software, Inc., Composite Proprietary

Respond Faster To Ever Changing Analytics Needs

“Hours or Days, Not Weeks or Months…

That’s Agility!”

“10 Times Faster Response to Executive Information

Requests”

Page 23: Where the Warehouse Ends: A New Age of Information Access

23 © 2013 Composite Software, Inc., Composite Proprietary

Save 50-75% Over Data Replication And Consolidation

“$4.5M in savings on first project”

“Spent 80% Less”

Page 24: Where the Warehouse Ends: A New Age of Information Access

24 © 2013 Composite Software, Inc., Composite Proprietary

Composite Provides a Complete Analytics Data Integration Solution

Discovery

Active Cluster

Composite Information Server Monitor

Manager

Studio

PerformancePlus Adapters

Development Environment

Runtime Server Environment

Management Environment

XML

Packaged Apps RDBMS Excel Files Data Warehouse OLAP Cubes Hadoop / “Big Data” XML Docs Flat Files Web Services

Composite 6.2 Data Virtualization Platform

Human Capital Management

Governance, Risk &

Compliance Business

Intelligence Customer

Experience Management

Mergers & Acquisitions

Single View of Enterprise Data

Supply Chain Management Analytics

Page 25: Where the Warehouse Ends: A New Age of Information Access

25 © 2013 Composite Software, Inc., Composite Proprietary

Data Virtualization Leadership Blog

Data Virtualization Case Study Book

For More Information

Data Virtualization Day

Analyst Webinars & White Papers

The Data Virtualization Channel

Data Virtualization Community

Data Virtualization Microsite

Enterprise Information Insight

Page 26: Where the Warehouse Ends: A New Age of Information Access

THE BIG DATA ADVANTAGE: TAKE BIG ADVANTAGE OF YOUR DATA

Page 27: Where the Warehouse Ends: A New Age of Information Access

Barry Devlin

27 Copyright © 2013 9sight Consulting

Founder and Principal 9sight Consulting, www.9sight.com

Dr. Barry Devlin is a founder of the data warehousing industry and among the foremost authorities worldwide on business intelligence (BI) and beyond. He is a widely respected consultant, lecturer and author of “Data Warehouse—from Architecture to Implementation”. Barry has 30 years of experience in the IT industry, previously with IBM, as an architect, consultant, manager and software evangelist. As founder and principal of 9sight Consulting (www.9sight.com), Barry provides strategic consulting and thought-leadership to buyers and vendors of BI solutions. He is currently developing a new architectural model for fully consistent business support—from informational to operational and collaborative—Business Integrated Insight (BI2). Based in Cape Town, South Africa, Barry’s knowledge and expertise are in demand both locally and internationally.

Email: [email protected] Twitter: @BarryDevlin

Page 28: Where the Warehouse Ends: A New Age of Information Access

Copyright © 2013 9sight Consulting, All Rights Reserved

Dr Barry Devlin Founder & Principal

9sight Consulting

The Integration Dilemma

The Briefing Room, 21 May 2013

Page 29: Where the Warehouse Ends: A New Age of Information Access

Everybody’s integrating something…always

29 Copyright © 2013 9sight Consulting

Integration is the key IT enabler for the business process… [and] touches and connects all areas of the business, its

customers, suppliers and partners. Jason Hill, partner, Glue Reply via

http://blogs.computerworlduk.com/management-briefing/2012/10/the-dangers-of-taking-your-eye-

off-integration/index.htm

Page 30: Where the Warehouse Ends: A New Age of Information Access

The dilemma is…

…everybody thinks its something different

So, let’s review…

30 Copyright © 2013 9sight Consulting

Page 31: Where the Warehouse Ends: A New Age of Information Access

Prior integration – during data warehouse population

§  The original goal – consistency

§  Bespoke programming

§  Extract – Transform – Load (ETL)

§  Highly technical focus on data and process of operational systems

§  Reducing in popularity… but not going away

31 Copyright © 2013 9sight Consulting

Page 32: Where the Warehouse Ends: A New Age of Information Access

§  The Prodigal Son returns – timeliness / agility

§  Federation becomes Virtualization

§  Also driven by “big data” volume and variety

§ Growing in popularity… but not the only answer

32 Copyright © 2013 9sight Consulting

Immediate integration – at query time

Page 33: Where the Warehouse Ends: A New Age of Information Access

“Where the warehouse ends…” means:

§  Logical boundary to the scope and purpose of the data warehouse

§  Consistency still matters

§  Information and data for analytics and operations beyond this boundary

§  Timeliness is key

§  For more on this architectural picture see: http://bit.ly/OpAn-A2Z

33 Copyright © 2013 9sight Consulting

Core Reporting & Analytic

Data

Fast Analytic

Data

Prior Integration

Core Business

Data

Deep Analytic

Info

Specialty Analytic

Data

Specialty Analytic

Data

Operational Systems Machine-generated

Data Process-mediated Data Human-sourced

Information

Business Analytics and Administrative Tools

Integrated information platform

Metadata

Data Virtualization (Immediate Integration)

Events Transactions Communications

Page 34: Where the Warehouse Ends: A New Age of Information Access

Concept integration – from information to data

§  Data is information dumbed down for computers

§  Information contains the human context

§  Integration must first occur conceptually at the business level –  Modeling, text analytics, etc.

§  Common metadata needed for prior and immediate integration

34 Copyright © 2013 9sight Consulting

Page 35: Where the Warehouse Ends: A New Age of Information Access

Copyright © 2013 9sight Consulting, All Rights Reserved

Dr Barry Devlin Founder & Principal

9sight Consulting

Page 36: Where the Warehouse Ends: A New Age of Information Access

Questions (1)

1.  What is Composite’s take on the title of the webinar “Where the Warehouse Ends?”

2.  The Analyst’s “Data Problem” has been around forever and everybody has claimed to tackle it one time or another. Why would Composite succeed where others have failed?

3.  Conceptually, I understand the distinction you’re making between the “analytic sandbox” and “analytic data hub.” However, in implementation terms, they seem very similar or perhaps even identical. Can you clarify, please?

4.  Data virtualization is very much part of the “plumbing business.” How do you convince the CMO that it’s as sexy as Hadoop? How do you position yourself vs. the “Yellow Elephant Solution” to all the world’s data needs and opportunities?

5.  The phrase “self-service data integration” worries me even more than “self-service BI.” Do you really think business users can do this well? How can you help them to do so?

36 Copyright © 2013 9sight Consulting

Page 37: Where the Warehouse Ends: A New Age of Information Access

Questions (2)

6.  What do you see as the biggest challenges for a business new to data virtualization? How does Composite address them?

7.  I position (roughly) ETL for consistency and data virtualization for agility. How do you see that distinction? Does Composite have functions (or plans) that would drive enhanced data consistency in a virtualized environment?

8.  You claim 50-75% savings over data replication and consolidation. Is this a short-term benefit of the first project or is it repeatable? My observation is that in the longer term, investment in consistency (via replication and consolidation) will pay dividends. What is your view?

37 Copyright © 2013 9sight Consulting

Page 38: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

Page 39: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

June: DATABASE

July: CLOUD

August: HIGH PERFORMANCE ANALYTICS

Upcoming Topics

www.insideanalysis.com

Page 40: Where the Warehouse Ends: A New Age of Information Access

Twitter Tag: #briefr

The Briefing Room

Thank You for Your

Attention