How To Leverage OBIEE Within A Big Data Architecture

Preview:

DESCRIPTION

If you've invested in OBIEE and want to start exploring the use of Big Data technology, this presentation talks about how and why you might want to use OBIEE as the common visualization layer across both.

Citation preview

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted

How to Leverage Your Investment in OBIEE Within a Big Data ArchitectureKevin McGinleyOracle ACE DirectorOwner and Co-founderRed Pill AnalyticsJuly 9, 2014

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Oracle Confidential – Internal/Restricted/Highly Restricted

2

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

How To Leverage Your Investment In OBIEE Within A Big Data

Architecture

4

KEVIN MCGINLEY

@kevin_mcginleymedium.com/@kevin_mcginley linkedin.com/in/kevinmcginley

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

About Red Pill Analytics

Capacity AnalyticsAgile Cloud Development for Oracle BI & Analytics

CheckmateDevOps for Oracle BI

Single DosesTraining + Strategy + Solutioning + Infrastructure + Support

5

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Real Time BI with Kevin & Stewart

• 19 episodes over the last 2 years

• Featured guests from the Oracle BI, EPM, and Big Data industries

• Published on iTunes and YouTube

6

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Contents

• Connect OBIEE To Hive

• Typical Big Data Architecture Today

• Why Integrate OBIEE With Big Data?

7

Connect OBIEE To Hive

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

What Is Hive?

• RDBMS table structures

• ETL capabilities in Hadoop

• SQL-like layer above HDFS

• Auto MapReduce coding

9

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

A Basic Hive Table & Query

10

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Connect OBIEE To Hive

11

OBIEE

HiveQL via ODBC

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Steps

• Configure odbc.ini

• Download BI Admin tool ODBC drivers for Hive

• Create ODBC DSN

• Import data structures and create metadata

• Update database type

12

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Configure odbc.ini

13

odbc.ini file location

Configure a DSN connection for Hive database

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

14

Choose the Hive driver for the ODBC DSN

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

15

Set the Host and Port the same as

odbc.ini fileSet the default database name to the Hive database

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Create ODBC DSN

16

Test the connection

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

17

Create new or import into

existing RPD

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

18

Select the newly created DSN for

Hive

Add the user and password

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

19

Most of these won’t apply; keep

the defaults

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Import Data Structures And Create Metadata

20

Select the database or

tables like normal

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Update Database Type

21

Double-click the database

Imported table structure

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Update Database Type

22

Change database type to Apache

Hadoop

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Update Database Type

23

You are prompted to edit the

connection pool

Select Yes

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Update Database Type

24

Verify the call interface is ODBC 2.0

Typical Big Data Architecture Today

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

OLTP Data Is Loaded Into Data Warehouse

26

Enterprise Data

Old

Sou

rces

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Experimenting With New Data Sources In Hadoop

27

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Different Visualization Tools

28

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tools

Visualization Tools

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Constant Data Movement Back And Forth

29

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tools

Visualization Tools

Why Integrate OBIEE With Big Data?

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Common Visualization Tool = Less Data Movement

31

Big DataEnterprise

Data

Old

Sou

rces

New

Sources

Visualization Tool

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Three Main Reasons To Use OBIEE Across Both

• Streamline data access through common tools

• Provide Hadoop access to users without programming skills

• Federate queries across Hadoop & Oracle database to avoid constant data movement

32

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Federate OBIEE Across RDBMS and Hadoop

33

Hive Table

Oracle Table

Oracle Table

Oracle Table

Oracle Table

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Full Business Model & Presentation Layer

34

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Easy Report Creation

35

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Pros

• Easier data visualization capabilities

• Drag-and-drop ease of access

• No new skills to learn

• Centralized data access

36

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

Cons

• Queries against Hive are slower than against Oracle

• Some data/metadata modeling and manipulation is required

• Might be throw-away work

37

www.redpillanalytics.com info@redpillanalytics.com @RedPillA © 2014 RED PILL Analytics

The Future?

38

OBIEE

Storage

Filesystem(HDFS)

NoSQL(HBase)

Workload Management

MapReduce

Batch SQL(Hive)

Metadata

Interactive SQL(Impala)

Questions?