Upload
nareshreddyguntaka
View
222
Download
0
Embed Size (px)
Citation preview
8/10/2019 P.19 PTS ODI11g GoldenGate
1/17
Copyright 2010, Oracle. All rights reserved.
8/10/2019 P.19 PTS ODI11g GoldenGate
2/17
Oracle Data IntegratorODI and GoldenGate
PTS Workshop: ODI 11g
8/10/2019 P.19 PTS ODI11g GoldenGate
3/17
Copyright 2010, Oracle. All rights reserved.
Insert Picture Here
Agenda
GoldenGate Overview
ODI JKM for GoldenGate
Lab Overview
Q&A
8/10/2019 P.19 PTS ODI11g GoldenGate
4/17
Copyright 2010, Oracle. All rights reserved.
GoldenGate Overview
8/10/2019 P.19 PTS ODI11g GoldenGate
5/17
Copyright 2010, Oracle. All rights reserved.
Oracle GoldenGateThe Solution for Enterprise-wide Real Time Data Needs
Real-time
information
Oracle GoldenGate delivers real-t ime access of real-t ime information, enablin g
com panies to dramat ical ly imp rove the avai labi l i ty , rel iabi li ty , and performance
of cr i t ical data across enterpr ise systems.
Database and
appl icat ions, Mixed
sourc es, dist r ibu ted
sys tems, legacy,OLTP, OLAP
Mission Cri t ica l
App l ica t ions &
Data, Bu sin ess
Intell igence,Report ing for
Customers,
Partners &
Employees
Real-time Access
8/10/2019 P.19 PTS ODI11g GoldenGate
6/17
Copyright 2010, Oracle. All rights reserved.
Oracle GoldenGate SolutionsEnterprise-wide Solution for Real Time Data Needs
Standardize on Single
Technologyfor MultipleRequirements
Deploy for ContinuousAvailability andReal-time Data
Access for Reporting / BI
Highly Flexible
Fast Deployments
Lower TCO & Improved ROI
Log Based, Real-Time Change Data
Capture
HeterogeneousSource Systems
EDWODS
EDW
Standby
(Open & Active)
ReportingDatabase
OGG
ETL
ETL
Operational
Reporting
Real-time BI
QueryOffloading
DataDistribution
Zero DowntimeMigration and
Upgrades
DisasterRecovery, Data
Protection
8/10/2019 P.19 PTS ODI11g GoldenGate
7/17
Copyright 2010, Oracle. All rights reserved.
How Oracle GoldenGate Works
Modular De-Coupled Architecture
LAN/WAN
InternetTCP/IP
Bi-directional
CaptureTrail
Pump DeliveryTrail
SourceDatabase(s)
TargetDatabase(s)
Capture: committed transactions are captured (and can befiltered) as they occur by reading the transaction logs.
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed,encrypted for routing to target(s).
Delivery: applies data with transactionintegrity, transforming the data as required.
8/10/2019 P.19 PTS ODI11g GoldenGate
8/17
Copyright 2010, Oracle. All rights reserved.
EMP
Oracle Real Time Data Integration
Oracles Unique Offering for Real Time Business Intelligence
Oracle
GoldenGate
Oracle DataIntegrator
EMP DEPT
DIM
FACT
DIM
DIMDIM
ODS Schema DW Schema
On-Disk Logs
Source 1
On-Disk Logs
Source 2
Oracle
GoldenGate
Oracle GoldenGate
Real time extracts from
transactional systems
Non-invasive on sources
Continuous streaming load
into ODS Schema of target
Latency in seconds
Oracle Data Integrator EE
High Performance E-LT on
target data warehouse
Periodic mini-batches (15 min)
Transform in the Database
Never go back to sources
EMP DEPT
DEPT
8/10/2019 P.19 PTS ODI11g GoldenGate
9/17
Copyright 2010, Oracle. All rights reserved.
ODI JKM for GoldenGate
8/10/2019 P.19 PTS ODI11g GoldenGate
10/17
Copyright 2010, Oracle. All rights reserved.
Transactional
RDBMS
Source Systems ODI Staging & TargetSource DBs
ODI J$Tables Target
EDW
ReplicatedSource Tables
TargetTablesReplicated
Source Tables
SourceTables
J$
ODI-EE Integration with GoldenGateNon-invasive Data Capture combined with ODI ELT strengths
Key Benefits:
1. Eliminate Overheadno need for DB API overhead on the Source, or the
invasiveness of the ODI J$ objects on the Source system,2. Automate GoldenGateautomation of GG deployment directly fromODI GUI
3. Provide Common DW Patternsupplies a common pattern for mini-batch style(non-real-time) DW aggregate loads
Key Consideration: not recommended for hard real-time requirements (use GG only)
ODI(w/GG JKM Consistent)
Generate all GG deployment files
Generate all ODI CDC infrastructure Execute end-to-end CDC
ODI CDCFramework
8/10/2019 P.19 PTS ODI11g GoldenGate
11/17
Copyright 2010, Oracle. All rights reserved.
Data Integrator-GoldenGate
Journalizing Knowledge Module
Combines best-of-breed CDC from GoldenGate withbest EL-T from Data Integrator
Automates generation of GoldenGate configurationbased on ODI metadata
GoldenGate JKM adheres to ODI Journalizingframework
First release supports Oracle-to-Oracle loading with
ODI Consistent CDC
8/10/2019 P.19 PTS ODI11g GoldenGate
12/17
Copyright 2010, Oracle. All rights reserved.
GG ODI JKM Setup
Staging Target
OGGExtract
OGGReplicat
ODI +
GG JKM
Source Server
Oracle DB
Generate
Conf igurat ion
Files
CDCTrans-
format ion
Source
Oracle DB
Target Server
8/10/2019 P.19 PTS ODI11g GoldenGate
13/17
Copyright 2010, Oracle. All rights reserved.
Lab Overview
8/10/2019 P.19 PTS ODI11g GoldenGate
14/17
Copyright 2010, Oracle. All rights reserved.
Lab Objectives
In this lab, you will learn how to :
Use Journalizing Knowledge Module for Oracle GoldenGate to manage OracleData Integrator CDC infrastructure and automatically generate the configurationfor Oracle GoldenGate
Part 1: Enable Staging model for CDC
Part 2: Configure Oracle GoldenGate using generated files Staging tables are enabled for CDC and generate OGG scripts to perform
replication from source to staging
Part 3: Initialize load to Staging and Target tables Initialize both staging and target areas with pre-existing source data by performing
1-to-1 copy from source table to staging table and bulk load & transformation fromstaging to target table
Part 4: Initialize CDC process and perform change operations OGG detects changes in the source and replicates them to the staging table in
real-time ODI is informed of changes arriving in the staging table through its standard CDC
framework ODI CDC module for GoldenGate picks up the change and moves the data to
target by performing a CDC-triggered load & transformation from staging to target
8/10/2019 P.19 PTS ODI11g GoldenGate
15/17
Copyright 2010, Oracle. All rights reserved.
GG ODI JKM Demo Setup
Source Staging Target
GGExtract
GGReplicat
ODI +
GG JKM
Workshop Machine (Linux)
Oracle DB
Generate
Conf igurat ionFiles
CDC Transformat ion
8/10/2019 P.19 PTS ODI11g GoldenGate
16/17
Copyright 2010, Oracle. All rights reserved.
8/10/2019 P.19 PTS ODI11g GoldenGate
17/17
Copyright 2010, Oracle. All rights reserved.