1 Copyright © 2013, Oracle and/or its affiliates. All ... › ... › 4-oracle-bi-app-architecture-2241442-zh… · 5 Copyright © 2013, Oracle and/or its affiliates. All rights

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1


Oracle BI Applications ArchitectureVersion 11g

3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle BI Suite EE Plus

Ad-hoc Analysis

ProactiveDetectionand Alerts

MS OfficePlug-in

Interactive Dashboards

AdvancedAnalytics

WebServices

Oracle Business Intelligence ApplicationsMulti-source Analytic Business Applications

Oracle BI Applications

Intelligent

Pre-packaged

Data Maps

UniversalData Map Templates

Source Examples

Legacy/Feeder Systems, Budget, Spreadsheets,

Other DWDW Schema

Public

Sector

Case

Service Enterprise

Asset Mgmt

Supply Chain &

Order

Management

Procurement

and

Spend

FinancialsHuman

ResourcesProjects

Reporting & Publishing


Pre-mapped metadata, including embedded best

practice calculations and metrics for financial

analysts, executives and other business users

A “best practice” library of over 488

pre-built metrics, 36 intelligent dashboards, 250+

reports and several alerts for CFO, Finance

Controller, Financial Analyst, AR/AP Managers and

Executives

Pre-built ETL to extract data from a large number

of operational tables and load it into the DW,

sourced from PSFT, Oracle EBS, JD Edwards,

SAP and other sources

Pre-built warehouse with 16 star-schemas

designed for analysis and reporting on financial

analytics

• Presentation layer

• Logical business model

• Physical sources

1 3

2 4

Oracle BI Applications Product ComponentsExample: Financial Analytics


Building BI Solutions is Challenging Significant Investment, Skills and Time Required

License an ETL tool to move data from operational systemsto this DW

License interactive user access tools

License/create information delivery tools

Research/understand analytic needs of each user community

Set up user security & visibility rules

Perform QA & performance testing

Manage on-going changes/upgrades

Develop detailed understanding of operational data sources

Build ETL programs for every data source

Build analytics for each audience

Design a data warehouse by subject area

License an ETL tool to move data from operational systemsto this DW

License interactive user access tools

License/create information delivery tools

These steps require

multiple different BI

and DW technology

INVESTMENTS

Develop detailed understanding of operational data sources

Build ETL programs for every data source

Build analytics for each audience

Design a data warehouse by subject area

These steps require IT

or BI staff resources

with specialized

SKILLS

These steps take TIME

to understand and

perfect as knowledge

of best practices is

learned

Research/understand analytic needs of each user community

Set up user security & visibility rules

Perform QA & performance testing

Manage on-going changes/upgrades


Build from Scratchwith Traditional BI Tools

Oracle BI Applications

Pre-built Business Adapters for Oracle EBS, PeopleSoft, JD Edwards. Siebel, SAP, others

Pre-built DW design, adapts to your EDW

Role-based dashboards and thousands of pre-defined metrics

Easy to use, easy to adapt

Weeks or Months

Back-end ETL andMapping

DW Design

Define Metrics& Dashboards

Back-end ETL andMapping

DW Design

Define Metrics& Dashboards

Training / Roll-out

Training / Rollout

Quarters or Years

Source: Patricia Seybold Research, Merrill Lynch, Oracle Analysis

Speeds Time To Value and Lowers TCOOracle BI Applications

�Faster deployment

�Lower TCO

�Assured business value


BI Applications Configuration Manager

• Administrative UI to

manage system

configuration for your BI

Applications

•Global parameters

•Language setup

•Currency setup

•Extract dates

• Ability to export and

import configuration

from file


BI Applications Functional Setup Manager

• Administrative UI to

track and manage

implementation

projects and their

required functional

setup steps

•Assign owners and

due dates to tasks

•Domain setup

• Ensures setups are

complete and easily

interrogated


Oracle BI Applications with ODI

– Pre-built, extensible jobs (i.e., load plans)

� Incremental

� Parallel

� Failure handling & Restart

– Installed in BI domain

� No additional ETL server required

– ODI Agent sends transformations as DB requests to be performed on the data warehouse DB

� Simple architecture

� High performing

Architecture


Oracle Business Intelligence Applications 11g: Simple Proven Architecture


Simple but sophisticated

• All server-side BI Apps components now run within WebLogic

Server Domain

• Web-based apps for configuring and controlling the ETL process

• ODI agent runs within WebLogic domain, uses WLS security etc

• ODI Console embedded in web apps, used for web-based

detailed monitoring of loads

• ODI Studio available for developer tasks

• No DAC - functionality now handled by ODI, Configuration

Manager and FSM

• Option to use GoldenGate for trickle-feed loading into staging

area, remove issue of load windows


� Role Based Dashboards

� Analytic Workflow

� Guided Navigation

� Security / Visibility

� Alerts & Proactive Delivery

� Logical to Physical Abstraction Layer

� Calculations and Metrics Definition

� Visibility & Personalization

� Dynamic SQL Generation

� Highly Parallel

� Multistage and Customizable

� Deployment Modularity

� Abstracted Data Model

� Conformed Dimensions

� Heterogeneous Database support

� Database specific indexing

Oracle BI Applications Architecture

Adm

inis

tration

Meta

data

Oracle BI

Presentation

ServicesDashboards by Role

Reports, Analysis / Analytic

Workflows

Metrics / KPIs

Logical Model / Subject Areas

Physical Map

Oracle BI

Server

Direct

Access to

Source

Data

Data Warehouse /Data Model

ETL

Load Process

Staging Area

Extraction Process

Federated Data Sources

SiebelOracle JDE PSFT EDW

Other


Adm

inis

tration

Meta

data

Oracle BI

Presentation



Workflows

Metrics / KPIs


Physical Map

Oracle BI

Server

Direct

Access to

Source

Data




Other

ETL

Load Process

Staging Area

Extraction Process

ETL - Extract and Load

Load

Extract

Source Independent Load

Staging Tables

Source Dependent Extract

OtherSiebel

OLTP Oracle

SQL

SQL

SQL

Business AnalyticsWarehouse

JDE

SQL

PSFT

SQL


Server Repository Overview

Adm

inis

tration

Meta

data

Oracle BI

Presentation



Workflows

Direct

Access to

Source

Data


ETL

Load Process

Staging Area

Extraction Process

DA

C



Other

Metrics / KPIs


Physical Map

Oracle BI

Server

� Multi-layered Abstraction

� Pre-built Metrics/Dimensions

� Pre-built hierarchy drills and cross dimensional

drills

� Pre-built Aggregate navigation

� Multi-pass complex calculated Metrics / KPIs

� Federation of queries

� Visibility & Personalization

� Pre-built Security inherited from Oracle EBS,

PeopleSoft, Siebel CRM


Web Catalog Overview

Adm

inis

tration

Meta

data

Metrics / KPIs


Physical Map

Oracle BI

Server

Direct

Access to

Source

Data


ETL

Load Process

Staging Area

Extraction Process

DA

C



Other

Oracle BI

Presentation



Workflows

� Role based dashboards

� Pre-built Reports/Dashboards

� Guided Navigation

� Conditional navigational links

� Analytic Workflows

� Alerts

� Highlighting

� Action Links to Oracle EBS, PeopleSoft, JD Edwards

EnterpriseOne, and Siebel CRM


ETL Component Architecture


Optimized for Oracle Engineered Systems

� ODI scales with Exadata

– Loads increase linearly as Exadata scales

– No new hardware required as data sets grow

� Optimized bulk loads, Leverages Infiniband (up to

40Gib/s), Smart Storage

� No data transfer to/from separate ETL server

� Transformations use Exadata optimized SQL

� Native Batch And Real-Time integration capability

� Zero down-time migrations to Exadata

� Tightly integrated with Exadata, Exalytics


Oracle BI Apps Security IntegrationTight security integration with Oracle Applications

Oracle BI

Foundation

Right content shown to the right user

Supports iPlanet, Novell, MSFT AD,

Oracle Identity Directory (OID), and others

Tightly integrated security model ObjectSecurity

UserSecurity

Data Security

Sales MarketingService /

Contact CenterFinancials

Procurement& Spend

Supply Chain& Order Mgmt

Loyalty PriceHuman

ResourcesProjects


BI Applications Security Types

� User-Level Security – Authentication

� Object-Level Security – Visibility of Subject Areas, Reports and

Dashboards

� Data-Level Security – Visibility of Data


User SecurityHow do I get in?

� Oracle BI EE Security Based Authentication (For Development)

– Defines and stores user information in the internal WLS domain

� LDAP Authentication

– Stores information from the LDAP server in session variables

� External Table Authentication

– Maintains list of users in an external database

� Database Authentication

– Authenticates users through database logins

� Single Sign-On (SSO)

– Provides an open interface to enable web integration with SSO products


Object SecurityWhat parts of the application can you see?

� Business Logic Object Security

– Subject Areas, Tables, Columns

� Web Object Security

– Dashboards, Reports, Web Folders

� Query Blocking

– Specified combinations of columns

can be blocked from running and the

user is notified of the illegal query

Presentation Layer

Physical Layer

Semantic Object Layer


Data Level Security Row Level

RPD (Metadata) Security VPD (Database) Security

BI Administrator Database Administrator

Applied at metadata layer Closest to the data

BI application only Multi-application

Applies to multiple sources Single physical source

‘Where’ clause by database Same SQL query

Shared connection pool Individual user context

Best applied by role Best applied by user

Leverages cache Back to source, or cache

OBIEE supports the following types of data level security

� BI Applications include this and inherit these data level rights from

the source application (e.g., Managers vs. Employees)


Oracle Business Intelligence Applications 11g: ETL Overview & Demo


ODI Agent is similar to an HTTP

ServerPlow CPU load, orchestrates work

requests, network connections and

execution summary data responses

• ODI Agent on the BI Server performs 3 primary functions• SQL Code Generator

• Scheduler

• Network Traffic Cop for JDBC Connections

• Other Notes• Communication generally via JDBC

• Connections to DBs created in ODI Topology

• ODI Metadata kept in “ODI Repository”

• SQL code generated by the Agent is sent to and runs in the

Target DB

• At runtime, ODI is just another user in the database target

executing SQL code (no intermediary files). There is no

“ODI Server” – only an Agent. All the heavy lifting is done by

the Database engine itself (running the generated SQL)

• ODI architecture whitepaper -

http://www.oracle.com/technetwork/middleware/data-

integrator/overview/oracledi-architecture-1-129425.pdf

How ODI Works

ODI Repository

Configuration Manager

OD

I A

gen

t

Source

Target

ODI Agent tells DB

what to do

OBIA 11g with ODI


Adm

inis

tration

Meta

data

Oracle BI

Presentation



Workflows

Metrics / KPIs


Physical Map

Oracle BI

Server

Direct

Access to

Source

Data




Other

ETL

Load Process

Staging Area

Extraction Process

ETL - Extract and Load

Load

Extract


Staging Tables


OtherSiebel

OLTPOracle

SQL

SQL

SQL


JDE

SQL

PSFT

SQL


Data Extract and Load Process

Load

Extract


Staging Tables


OtherSiebel

OLTPOracle

SQL

SQL

SQL


JDE

SQL

PSFT

SQL

Extract

� Source-specific and Universal Business

Adapters

� Expose simplified business entities

from complex source systems

� Converts source-specific data to

universal staging table format

� Lightweight and designed for

performance, parallelism

� Extensible


Data Extract and Load Process

Load

Extract


Staging Tables


OtherSiebel

OLTPOracle

SQL

SQL

SQL


JDE

SQL

PSFT

SQL

Extraction Modes� Direct Database Access

� Oracle EBS

� Siebel CRM

� JD Edwards

� PowerExchange technology

� PeopleSoft Enterprise

� Universal Business Adapters

� Used for sources with no pre-packaged

business adapter

� Transforms and loads data from universal

sources through a flat file interface

� Supply flat file(s) or tables meeting a

defined standard format

� Reduces implementation and

maintenance significantly compared to

building full ETL solution from scratch


ODI provides flexible architecture for

optimized performance

Benefits

� Leverage Set-based transformations

� Improved performance for loading, no

network hop

� Takes advantage of existing hardware

Next Generation Architecture

“E-LT”“E-LT”Load

TransformTransform

Extract

ODI is Simple and FastThe Key to Improved Performance and Reduced Costs

Environment Setup (ex: BI Apps)

33-50% Less Complex

Category Old New

Number of

Setup Steps

10 7

Number of

Servers

3 1

Number of

connections

7 3


Why Does ODI Win?

ODI is Fast• Fastest E-LT Bulk/Batch Performance

• Faster Real Time integration (sub-second) with CDC, Replication, SOA

• Faster Project Setup, Design and Delivery

ODI is Simple• Simpler Setup, Configuration, Management, and Monitoring

• Simpler way to do Mapping using Declarative SQL Interfaces

• Simpler Deployment with Fewer Hardware Devices

• Simpler extensibility with Knowledge Module code templates

ODI Saves Money (Lower TCO, Higher ROI)• Less Hardware & Energy Costs with E-LT Architecture

• Less Time Wasted on Unnecessary ETL Mappings & Scripting

• Less Integration Overhead with Applications, SOA, and Management


Source Dependent Data Store (SDS) Option: GoldenGate


Default ETL Architecture for DW


Introducing the BI Apps SDS Architecture

‘Source Dependent Data Store (SDS)’ - a separate schema on the

BI Apps DW database that is a replication of the source OLTP

systems tables + deletes + additional optimizations for incremental

ETL

GoldenGate – a service on both database systems that performs:

1. On the source database system - continuous asynchronous change

data capture 'CDC' at a low level in the database, then compresses and

ships the changed data across the network toP

2. On the target database system - receives the changed data from one

or more source systems and loads them into the target database (into

the SDS schemas, 1 per source).


Offering Source Dependent Data Store (SDS)

� SDS optional for a customer

� One BI Apps code line that serves both SDS and non SDS.

� Modular control on a Fact by Fact / Dimension by Dimension basis.

Use Cases Supported

– Customer upgrading later to an SDS architecture without needing to restart

their ETL

– Customer deploying one module using the SDS and switching other

modules to using the SDS as they go along

– Customer switching back an incremental to the OLTP for sourcing data (for

whatever reason) even as a one off.


BI Apps DW ETL Architecture + SDS

Optimized ETL for local SDS

Optimized for

Incremental ETLGenerated based on a customers

BI Apps deployment


Features and BenefitsGolden Gate SDS Option

Drastically Reduced Impact on Source System

BI Applications with Golden

Gate

Drastically Reduced ETL

Runtimes

More Reliable Change Data Capture and

Delete Support

Dedicated Copy of Source

Tables in BI Apps DW

• Near-zero impact of

ongoing extraction

• No ETL batch load

windows required

• Full reload without

touching the source

• Consistent CDC

approach regardless

of source

• Hard deletes in

source generate

Golden Gate events

• Transformations and

star loads all local in

BI Apps DW schema

• Near real time ETL

possible

• 24/7 deployments

• Ability to change

indexes, add views

• Perfect source for

real-time reporting

requirements


Summary


Value of OBIA 11g Pre-built, proven, and improved

� Pre-built

– ETL & Security mapped to source systems – stays in sync with upgrades/changes

– Data warehouse with best practice analytic data model and conformed dimensions

– Business Intelligence metadata, reports, dashboards, and more

� Proven

– Over 4000 customers

– Turns an effort that takes months/years into weeks

� Improved

– Simplified architecture, better performance, more flexible data loads

– New content, easier configuration, & guided functional setup


Q&A

Documents

1 Copyright © 2013, Oracle and/or its affiliates. All ... › ... › 4-oracle-bi-app-architecture-2241442-zh… · 5 Copyright © 2013, Oracle and/or its affiliates. All rights