BI Applications Integration with ODI and GoldenGate · ODI is cost effective compared to ... Optional Feature for 11g Challenge: Customers with geographically distributed source systems

© Copyright 2014. Apps Associates LLC. 1

BI Applications Integration with ODI and GoldenGate

July 22, 2014

Narasimha Rao Madhuvarsu L V Sr. Principal Architect Apps Associates LLC

Julian Troake Marketing Director Apps Associates LLC


Confidentiality Statement

The content of this document is proprietary, confidential information pertaining to Apps Associates’ products, services, solutions and methods. Information herein is intended for use by the client or prospective client only and must not be shared

with any third party without consent from Apps Associates.

For any questions with this proposal, please contact

Julian Troake

Email: [email protected]

Phone: (978) 399-0230

mailto:[email protected]


Agenda

• Introduction

• Customer Benefits

– Infrastructural

– TCO

– Productivity

– Additional Content

– Data Lineage

• BI Apps 7.9.x vs. 11g

• ODI BI Apps Architecture

• Oracle Data Integrator

• Licensing and Supported Platforms

• Migration Options from 7.9.x Versions

• Real-Time Data Refresh Using GoldenGate

• Demo

– Configuration Manager

– Functional Setup Manager

– Web-Based ODI Console


Introduction

• Most significant BI Applications release

• Completely re-architected solution

• Expansion of content and new products

• Released on the latest version of OBIEE 11.1.1.7


Customer Benefits

• Leverages the database tier power for ELT

• No need of separate ETL tier – significant cost reduction

• Number of new out-of-the-box tools to increase productivity and drive

down TCO

– Configuration Manager

– Functional Setup Manager

• Additional modules and content expansion

• Reduced functional configuration time

• Complete data lineage from source to analysis


Customer Benefits

• Integrated FMW security across components

• Easy near real time incremental refresh of data warehouse


BI Applications 11g Features Over 7.9.x

• Significant release with multiple enhancements

• Additional content and new products

• New architecture leveraging the power of ODI

• Content built on latest version of OBIEE

• Tools to increase productivity and drive down TCO

• Near real time option for customers that have significant ETL time pressures


New Features


New Content in BI Apps 11g Over 7.9.x

• Financials

– Commitment Control & Public Sector Financial / Budget Analysis (EBS & PSFT)

– Fixed Assets (EBS & PSFT)

• HR

– Time & Labor (EBS & PSFT)

– Global Payroll (PSFT)

– Transfers (EBS & PSFT)

• Projects

– Resource Management (EBS & PSFT)

– Cross Charge (EBS & PSFT)

– Forecasting Enhancements & Commitments (PSFT)

– GL Reconciliation (EBS & PSFT)


New Content in BI Apps 11g Over 7.9.x

• CRM

‒ Service Analytics Enhancements (EBS)

‒ Price Analytics (EBS)

• Procurement & Spend

‒ Sourcing Analytics

‒ Enhancements to Change Orders and Agreements

• Supply chain & Order Management

‒ Costing

‒ Inventory Cycle Count and Other Enhancements

• Student Information Analytics

‒ Admissions, Recruiting, Records, partial Financials (PSFT)

• Indirect Spend Planning


Extended Connectivity Over 7.9.x

• Application Adapters for SAP ERP and SAP BW

• Application Adapters for Endeca, Hadoop

• Oracle OLAP

• Hyperion Planning, Financial Management and Essbase

• Real-Time CDC with GoldenGate

• Oracle DB multi-table insert

• Optimizations for IBM DB2, Microsoft SQL Server, Teradata, Netezza


Bulk Data Processing & Data Transformation

BI Apps 11.1.1.7.1 supports more source systems over 7.9.6.4


ODI BI Apps Architecture


ETL

• BI Apps 7.9.6.4 with Informatica

• BI Applications 11.1.1.7.1 with Oracle Data Integrator and GoldenGate


Data Loading

The Key to Improved Performance and Reduced Costs

E-LT provides flexible architecture for optimized performance

Benefits

• Leverage set-based transformations

• Improved performance for loading, no network hop

• Takes advantage of existing hardware


ETL Architecture

Informatica

• Is an ETL tool (Extract, Transform, Load)

• Has dedicated ETL engine

• Transformation is the core part of ETL

• Integration service handles the transformation part, resulting in better performance

• File based transformation operations


ETL Architecture

ODI

• Is an ELT tool (Extract, Load, Transform)

• Does not have dedicated ETL engine

• Relies on database capabilities of the source / target database i.e. first loads the data in some staging tables in the target database and later inserts / updates the data into the final target tables based on the data transformation has to perform

• Performance is primarily based on Source and Target Tables and Database


ETL Architecture

• In-database E-L-T Transformation vs. E-T-L.

• Best in class performance, scalability, availability

• Lightweight deployment for lower TCO

• Faster time-to-value through declarative design

• Heterogeneous, open and standards-based

• Set based transformation


Components

Informatica


Components

ODI


GUI

7.9.6.4 11.1.1.7.1

Connecting to the ETL Repository We need to have client tool installed in the machine to access repository

Connecting to the ETL Repository No separate Client tools is involved. We can connect to repositories using ODI console or by web based URL

ETL Repositories It has only one repository, so we have one set of connection entries

ETL Repositories We have two Repositories. Master and Work Repositories. So we need two Independent connection entries

Cost ODI is cost effective compared to Informatica


GUI

Hardware Informatica tool utilize its own engine to implement the ETL process. So investment in additional hardware to implement the tool’s ETL engine.

Hardware Utilizes existing hardware. ODI can run on the same hardware as the database engine underpinning the data warehouse, using the existing hardware deployed.


Implementation

Domain Files We need to configure manually

Domain Files No need to configure Domain files. It is automatically configured by using Configuration Manager.

Time It takes more time for configurations

Time It takes less time for configurations

ETL Customization In order to load data to custom column we need to edit the Mapping

ETL Customization In order to load data to custom column we need to edit the interface

ETL Troubleshooting Features like backtracking, dependencies and debugger

ETL Troubleshooting Features like Simulation to debug


Declarative Design

Improved Developer Productivity and Lower Maintenance Costs

Informatica ETL Design • Developer must define every step of Complex ETL

Flow Logic • And significant development and maintenance

efforts

ODI Declarative Design • Simplifies the number of steps • Automatically generates the Data Flow whatever

the sources and target DB

Benefits • Reduces the learning curve • Shorter implementation times • Streamline access to non-IT pros


Benchmarking


Tools for Accelerating Deployment

BI Applications 7.9.6.4

• DAC

– Another tool to install

BI Applications 11.1.1.7.1

• Configuration Manager

– Administrative UI to manage system configuration for BI Applications

• Functional Setup Manager

– Administrative UI to track and manage implementation projects and functional setup steps


BI Applications Configuration Manager

A centralized (thin client/web application) console to

– Simplify configuration process

– Minimize manual setups and configurations

– Generate list of necessary configurations based on BI Application being configured and user selections

– Provide check lists and validations of all necessary tasks

– Reduce dependency on documentation

– Configuration migration capabilities


Edit Dialog


Functional Setup Manager

• Domains ETL execution to extract configuration data from source

• Ability to track configuration progress for project management

• Enable / disable a functional area from a module

• Ability to create load plans with extract only

• Define, generate, execute and monitor load plan

• Scheduling for load plan for data refresh


BI Applications OLTP Coverage


Migration Path

• No formal migration path from 7.9.x to 11g

• Ideal for implementations with minimal customizations

• Upon implementation of BI Apps 11g, manually migrate the customizations on a case by case basis as needed


Enhanced ETL Architecture Using GoldenGate

Optional Feature for 11g

Challenge:

Customers with geographically distributed source systems are increasingly being challenged by rapidly expanding data sizes and shorter ETL windows

Solution:

Optimize ETL load and reduce impact on OLTP system leveraging the strengths of GoldenGate

– Completely prepackaged solution

– Creation of Source Dependent Data Store (SDS)

– Ability to complete all extraction tasks while in source system availability window


Real-Time Data Refresh Using GoldenGate

• Built in integration with GoldenGate

• No need for batch load windows

• ODS/SDS near real time refresh from distributed source databases

• Ability to add/change indexes and views on SDS

• Source for real time reporting needs

• Recommended for customers with pressing ETL times

• Suitable for 24 x 7 deployments


Demo

• Configuration Manager

• Functional Setup Manager

• ODI Console


Why ODI BI Apps?

Faster

– Fastest E-LT Bulk/Batch Performance

– Faster Real Time integration (sub-second) with CDC, Replication, and SOA

– Faster Project Setup, Design and Delivery

Simpler

– Simpler Setup, Configuration, Management, and Monitoring

– Simpler way to do Mapping using Declarative SQL Interfaces

– Simpler Deployment with Fewer Hardware Devices

– Simpler extensibility with Knowledge Module code templates


Why ODI BI Apps?

Saves Money (Lower TCO, Higher ROI)

– Less Hardware & Energy Costs with E-L-T Architecture

– Less Time spent on Unnecessary ETL Mappings, Scripting, and Training

– Less Integration Overhead Integrating with Applications, SOA, and Management


Connect with Us

Web: www.appsassociates.com

Email: [email protected] | [email protected]

YouTube: www.youtube.com/user/AppsAssociates

LinkedIn: www.us.linkedin.com/company/Apps-Associates

Twitter: @AppsAssociates

Facebook: www.facebook.com/AppsAssociatesGlobal

Google+: www.plus.google.com/+AppsAssociatesGlobal/

http://www.appsassociates.com/



http://www.youtube.com/user/AppsAssociates

http://www.us.linkedin.com/company/Apps-Associates



https://twitter.com/AppsAssociates

http://www.facebook.com/AppsAssociatesGlobal

http://www.plus.google.com/+AppsAssociatesGlobal/

Thank You!

Documents

BI Applications Integration with ODI and GoldenGate · ODI is cost effective compared to ... Optional Feature for 11g Challenge: Customers with geographically distributed source systems