Copyright © 2013, Oracle and/or its affiliates. All rights ...Oracle GoldenGate Capture Oracle GoldenGate Delivery Oracle 10.2 on Linux Oracle 10.2 Clone ÆOracle Database 11g Linux

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

Zero Downtime Migrations using Oracle GoldenGateThomas NiewelPrincipal Sales Consultant


The following is intended to outline our general product direction. It is intended for information purposes only, and

may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality,

and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products

remains at the sole discretion of Oracle.


Agenda

GoldenGate Architecture

GoldenGate 11.2 Classic Capture vs. Integrated Capture

Zero Downtime Migrations

Instantiation Methods for the Target Database

Sizing Aspects

Setup of Oracle GoldenGate Including a Failback Environment


Oracle GoldenGate Low-Impact Real-Time Data Integration & Transactional Replication

New DB/HW/OS/APP

Fully Active Distributed DB

Reporting Database

Data Warehouse

Global Data Centers

ODSData Integrator

Zero Downtime Upgrade & Migration

Query Offloading, Disaster Recovery

Data Synchronization across the Enterprise

Real-time BI, Operational Reporting, MDM

Highly Available / Disaster Recovery

Log-based, changed data

Database

Message Bus

Legacy

Message Bus

Event Driven Architecture, SOA


UnidirectionalQuery OffloadingZero-Downtime Migration

Bi-DirectionalHot Standby orActive-Active for HA

Peer-to-PeerLoad BalancingMulti-Master

BroadcastData Distribution

Integration/ConsolidationData Warehouse

BPM

BAM

CEP

Data Distributionvia Messaging

Oracle GoldenGate Topologies

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7 7

Oracle GoldenGate Documentation

Documentation: http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html

Certification Matrixhttp://www.oracle.com/technetwork/middleware/ias/downloads/fusion-certification-100350.html



Source: Oracle GoldenGate Windows and UNIX Administrator’s Guide


GoldenGate DDL Replication

DDL Replication is a trigger based solutionTable structure on source and target environment must be identicalDDL Replication only possible in a homogenous environment Setup

marker_setup.sqlddl_setup.sql


How GoldenGate Works



Agenda





Sizing Aspects



GoldenGate 11.2 – Classic Capture



GoldenGate 11.2 – Integrated Capture


Integrated Capture: See note 1411356.1 for Oracle 11.2.0.3 required patches


GoldenGate 11.2 Classic Capture or Integrated Capture ?

Classic CaptureMost data types supported

Restricted support for complex data types

GoldenGate Profiling ScriptsNote 1298562.1 (Database)Note 1296168.1 (Schema)


GoldenGate 11.2 Classic Capture or Integrated Capture ?

Integrated CaptureFully integrated with the database, no additional setup is required to work with Oracle RAC, ASM, and TDEEasier Integration into RACIntegrated Log Management, because of Logminer usageClassic Capture Restrictions abandoned (see next slides)Downstream Capture


Some important Features Classic Capture Integrated Capture

Compression (Basic, OLTP, EHCC) X

XML Partially

Mutithreaded X

RAC with PDML With Restrictions

RAC with XA With Restrictions

GoldenGate 11.2 Integrated Capture vs. Classic Capture

More details: Oracle GoldenGate for Oracle Installation and Setup Guide – Chapter 1.4


GoldenGate 11.2 Integrated Capture vs. Classic Capture

Database Version Classic Capture Integrated Capture

10.2 Supported Supported *

11.1.0.7TDE/TSE, Fetch support for

SecureFiles, ADTs, VARRAYS, Nested Tables, Object Tables

Supports TDE/TSE *

11.2.0.2TDE/TSE, Fetch support for


TDE/TSE, XA-RAC, Compression, SecureFiles, Fetch support for

ADTs, VARRAYS, Nested Tables, Object Tables *

11.2.0.3TDE/TSE Fetch support for


TDE/TSE, XA-RAC, Compression, XML Object Relational, XML

Binary, SecureFiles,Fetch support for ADTs, VARRAYS, Nested

Tables, Object Tables* Supported for Downstream Capture model onlySource: http://www.oracle.com/us/products/middleware/data-integration/goldengate-11gr2-new-features-wp-1736116.pdf


Agenda





Sizing Aspects



Zero Downtime Migration with Oracle GoldenGateExample 1: near-zero-downtime upgrade with GoldenGate

extract

Old environment

+Diskgroup

+ ASM

Linux guest new

+ ASM

replicat

+Diskgroup

pump



Old environment

+Diskgroup

Linux guest new

replicat

+Diskgroup

pump

SCN=4711

SCN on source is 4711Step 1: Start extract and pump process

SCN=4711......+ ASM + ASM

extract


Zero Downtime Migrationwith Oracle GoldenGateExample 1: near-zero-downtime upgrade with GoldenGate

extract

Old environment

+Diskgroup

Linux guest new

replicat

+Diskgroup

pump

SCN=4750

Step 2: export/import with consistent SCN 4750

SCN=4711 .....

export/import

SCN 4750

+ ASM + ASM



extract

Old environment

+Diskgroup

Linux guest new

replicat

+Diskgroup

pump

SCN=4790

Step 3: Start replicat with SCN 4750replicat process applies changes until databases are in sync

SCN=4711.....

SCN 4750

+ ASM + ASM


Zero Downtime Migrationwith Oracle GoldenGateExample 1: near-zero-downtime upgrade with GoldenGate

Extractfailback

Old environment

+Diskgroup

Linux guest new

+Diskgroup

Pumpfailback

Step 4: Application can be stopped Replication can be stopped and started in the opposite directionApplication can be started on the new database

replicatfailback

+ ASM + ASM


Oracle GoldenGate Capture

Oracle GoldenGate Delivery

Oracle 10.2 on Linux

Oracle 10.2 Clone Oracle Database 11gLinux

Oracle 11g onLinux for z

Zero Downtime MigrationOracle 10.2 Oracle 11g Cross-Platform (Linux x86 to Linux for z)Example 2: near-zero-downtime upgrade with GoldenGate

1. Start of the Oracle GoldenGate capture process2. Create of a clone database; after that upgrade to Oracle 11g 3. Cross platform transportable tablespace metadata export4. Use of a “full database NOROWS export” (Views, Packages, etc)

of the Clone DB5. Installation of a new Oracle 11g Database on Linux for z

6. Cross platform transportable tablespacesmetadata Import and transfer of the datafiles with conversion of the endianess

7. Full Import with IGNORE option8. Start Oracle GoldenGate Delivery on Linux for z


9. Wait until source and target database are in sync10. Stop the application and wait until all data is processed

Failback option

Oracle 10.2 Linux

Oracle 10.2 Clone Oracle 11g Linux

Oracle Database 11gLinux for z

Zero Downtime Migration Oracle 10.2 Oracle 11g Cross-Platform (Linux x86 to Linux for z)Example 2: near-zero-downtime upgrade with GoldenGate

11. Start Oracle GoldenGate Capture on the z/Linux platform12. Start Oracle GoldenGate Delivery on the Linux platform13. **SWITCHOVER** of the application


Things to Consider

TriggerDisable triggers Replicat parameter DBOPTIONS SUPPRESSTRIGGERS

Referential integrityDisable cascading delete constraints on targetReplicat parameter DBOPTIONS DEFERREFCONST


Things to Consider

Sequences

Supported with uni-directional active-passive topology

Target sequence value always higher (or equal, if the cache is 0) than source sequence value


Agenda





Sizing Aspects



Methods for an Instantiation of the Target Database

expdp/impdp expdp/impdp via a database link(Cross platform) Transportable Tablespaces CTAS (Create Table As Select)Export / ImportBackup / Restore (see Note 369644.1 and 1079563.1)Instantiation with GoldenGate…..


Methods for an Instantiation of the Target Database - Examples

1. SELECT DBMS_FLASHBACK.GET_SYSTEM_CHANGE_NUMBER FROM DUAL;

a) Insert into target select * from scott.emp as of scn 3488839

b) expdp strmadmin SCHEMAS=hr DIRECTORY=DPUMP_DIR DUMPFILE=hr_schema_dp.dmp FLASHBACK_SCN=3488839

c) RMAN> backup database plus archivelog ; RMAN> duplicate target database to <databasename>

nofilenamecheck until scn <value returned from “RMAN restore database preview summary” command> (see Notes 369644.1 and 1079563.1)

2. Start of the replicat process (depending on instantiation method) START REPLICAT <name> AFTERCSN <3488839>

START REPLICAT <name> ATCSN <3488839>


Instantiation without the Determination of an SCN

HANDLECOLLISIONS (Replicat Parameter) has to be used

Works fine if Primary Key / Unique Index availableTables without Primary Key / Unique Index

Duplicate rows in case of insert statementsDescribed in Oracle GoldenGate Installation and Setup Guide

Use the HANDLECOLLISIONS and NOHANDLECOLLISIONS parameters to control whether or not Replicat tries to resolve duplicate-record and missing-record errors when applying SQL on the target. These errors can occur during an initial load, when data from source tables is being loaded to target tables while Oracle GoldenGate is replicating transactional changes that are being made to those tables. When Oracle GoldenGate applies the replicated changes after the load is finished, HANDLECOLLISIONS causes Replicat to overwrite duplicate records in the target tables and provides alternate handling of errors for missing records


Instantiation with GoldenGate


Agenda





Sizing Aspects



Determine the Resource Usage of the Source Environment

Oracle– Oracle Enterprise Manager– AWR reports

Unix– sar– iostat– vmstat


Example:I/O Determined by AWR Report

Load profile

~~~~~~~~~~~~ Per Second Per Transaction

--------------- ---------------

Redo size: 18,884,730.34 72,451.84

Logical reads: 26,685.24 102.38

Block changes: 16,810.84 64.50

Physical reads: 272.99 1.05

Physical writes: 2,170.07 8.33

User calls: 2,597.49 9.97

Parses: 521.30 2.00

Hard parses: 0.05 0.00

Sorts: 1.37 0.01

Logons: 0.05 0.00

Executes: 523.53 2.01

Transactions: 260.65


Example:Avg CPU Usage Determined by AWR Report

Statistic Total per Second per Trans

-------------------------------- ------------------ -------------- -------------

CPU used by this session 40,637 44.0 0.2

CPU used when call started 40,431 43.7 0.2

CR blocks created 6 0.0 0.0

Cached Commit SCN referenced 476 0.5 0.0

Commit SCN cached 1 0.0 0.0

DB time 572,703 619.5 2.4

DBWR checkpoint buffers written 83,867 90.7 0.4

DBWR checkpoints 33 0.0 0.0

DBWR fusion writes 2,253 2.4 0.0

DBWR object drop buffers written 0 0.0 0.0

DBWR thread checkpoint buffers w 19,530 21.1 0.1


PGA Memory Advisory DB/Inst: TEST/TEST1 Snap: 8315

-> When using Auto Memory Mgmt, minimally choose a pga_aggregate_target valuewhere Estd PGA Overalloc Count is 0

Estd Extra Estd PGA Estd PGAPGA Target Size W/A MB W/A MB Read/ Cache OverallocEst (MB) Factr Processed Written to Disk Hit % Count

---------- ------- ---------------- ---------------- -------- ----------13 0.1 552.6 13.2 98.0 525 0.3 552.6 13.2 98.0 550 0.5 552.6 0.0 100.0 075 0.8 552.6 0.0 100.0 0100 1.0 552.6 0.0 100.0 0120 1.2 552.6 0.0 100.0 0140 1.4 552.6 0.0 100.0 0160 1.6 552.6 0.0 100.0 0180 1.8 552.6 0.0 100.0 0200 2.0 552.6 0.0 100.0 0300 3.0 552.6 0.0 100.0 0400 4.0 552.6 0.0 100.0 0600 6.0 552.6 0.0 100.0 0

Example:PGA Usage Determined by AWR Report


Example:SGA Usage Determined by AWR Report

SGA Target Advisory DB/Inst: ORA1/ORA1P5 Snap: 8315

SGA Target SGA Size Est DB Est Physical

Size (M) Factor Time (s) Reads

---------- ---------- ------------ ----------------

150 0.5 7,535 139,852

225 0.8 7,416 123,298

300 1.0 7,381 118,408

375 1.3 7,356 117,413

450 1.5 7,339 115,022

525 1.8 7,339 115,022

600 2.0 7,339 115,022

-------------------------------------------------------------


Example:Buffer Pool Usage Determined by AWR Report

Buffer Pool Advisory DB/Inst: ORA1/ORA1P5 Snap: 8315

-> Only rows with estimated physical reads >0 are displayed

-> ordered by Block Size, Buffers For Estimate

Est

Phys

Size for Size Buffers for Read Estimated

P Est (M) Factor Estimate Factor Physical Reads

--- -------- ------ ---------------- ------ ------------------

D 112 .6 13,636 1.1 124,799

D 128 .7 15,584 1.0 122,965

D 144 .8 17,532 1.0 121,753

D 160 .8 19,480 1.0 120,741

D 176 .9 21,428 1.0 119,683

D 192 1.0 23,376 1.0 118,657

D 208 1.1 25,324 1.0 117,740

D 224 1.2 27,272 1.0 116,939


Dedicated Server ProcessesThe storage used by dedicated server threads can be calculated as follows:

Max(logons current) multiplied by storage used per thread

Storage used per thread is 5MB (Calculated on an idle system by opening a sqlplus session. The storage usage was monitored with the Linux free command


Agenda





Sizing Aspects



Example – Zero Downtime Migration with Oracle GoldenGateSimple Example of a zero downtime migration

– Installation/configuration of GoldenGate on source and

target environment

– Classic Capture is used

– No DDL replication is performed


Zero Downtime Migration with Oracle GoldenGateReplication Environment

ExtractCapt01

Schema srcusr

ReplicatApply01

Schema trgtusr

Expdp/impdp

Trail Filert

PAZXXT09PAZXXT08


Zero Downtime Migration with Oracle GoldenGateFailback Environment

Extractcaptf01

PAZXXT08

Trail filesft

replicatapplyf01

PAZXXT09

Schema srcusr Schema trgtusr


Example – Zero Downtime Migration with Oracle GoldenGateOracle GoldenGate Command Interpreter for OracleVersion 11.2.1.0.2 OGGCORE_11.2.1.0.2T3_PLATFORMS_120724.2205

Linux, s390x, 64bit (optimized), ......

GGSCI (PAZXXT08) 3> dblogin userid gg112, password gg112

Successfully logged into database.

GGSCI (PAZXXT08) 4> add trandata srcusr.*

2013-01-15 03:40:29 WARNING OGG-00869 No unique key is defined for table 'DEPT'. All viable columns will

be used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.

Logging of supplemental redo data enabled for table SRCUSR.DEPT.

Logging of supplemental redo data enabled for table SRCUSR.EMP.


Example – Zero Downtime Migration with Oracle GoldenGateGGSCI (PAZXXT08) 3> EDIT PARAMS capt01

Extract capt01

Userid gg112, password gg112

Rmthost pazxxt09.us.oracle.com , mgrport 1960

Rmttrail /home/oracle/GG_TRGT/rt

Table srcusr.*;

GGSCI (PAZXXT08) 4> add extract capt01,tranlog,begin now

EXTRACT added.

GGSCI (PAZXXT08) 5> add rmttrail /home/oracle/GG_TRGT/rt, EXTRACT capt01

RMTTRAIL added


Example – Zero Downtime Migration with Oracle GoldenGate

GGSCI (PAZXXT09) 2> dblogin userid gg112 password gg112


GGSCI (PAZXXT09) 3> add checkpointtable gg112.chkptab

Successfully created checkpoint table gg112.chkptab.

GGSCI (PAZXXT09) 1> edit params ./GLOBALS

checkpointtable gg112.chkptab

GGSCI (PAZXXT09) 1> add replicat apply01, exttrail /home/oracle/GG_TRGT/rt


Example – Zero Downtime Migration with Oracle GoldenGateGGSCI (PAZXXT09) 1> EDIT PARAMS APPLY01

REPLICAT apply01

setenv (ORACLE_SID = "trgt")

SETENV (NLS_LANG = "AMERICAN_AMERICA.WE8MSWIN1252")

assumetargetdefs

userid gg112, password gg112

MAP srcusr.*, target trgtusr.*;



GGSCI (PAZXXT09) 22> edit params captf01

extract captf01

Userid gg112, password gg112

Rmthost pazxxt08.us.oracle.com , mgrport 1860

Rmttrail /home/oracle/GG_SRC/ft

Table trgtusr.*;

GGSCI (PAZXXT09) 4> add extract captf01,tranlog,begin now

EXTRACT added.

GGSCI (PAZXXT09) 5> add rmttrail /home/oracle/GG_SRC/ft, EXTRACT captf01

RMTTRAIL added

Preparation of the failback environment



Oracle GoldenGate Command Interpreter for Oracle

Version 11.2.1.0.2 OGGCORE_11.2.1.0.2T3_PLATFORMS_120724.2205

Linux, s390x, 64bit (optimized), ......

GGSCI (PAZXXT09) 2> dblogin userid gg112, password gg112


GGSCI (PAZXXT09) 3> add trandata trgtusr.*

2013-01-24 04:21:27 WARNING OGG-00869 No unique key is defined for table 'DEPT'. All viable columns will be

used to represent the key, but may not guarantee uniqueness. KEYCOLS may be used to define the key.

Logging of supplemental redo data enabled for table TRGTUSR.DEPT.

Logging of supplemental redo data enabled for table TRGTUSR.EMP.




GGSCI (PAZXXT08) 8> edit params applyf01

REPLICAT applfy01

setenv (ORACLE_SID = "orcl")

SETENV (NLS_LANG = "AMERICAN_AMERICA.WE8MSWIN1252")

assumetargetdefs

userid gg112, password gg112

mAP trgtusr.*, target srcusr.*;




GGSCI (PAZXXT08) 2> dblogin userid gg112 password gg112


GGSCI (PAZXXT08) 3> add checkpointtable gg112.chkptab

Successfully created checkpoint table gg112.chkptab.

GGSCI (PAZXXT08) 1> edit params ./GLOBALS

checkpointtable gg112.chkptab

GGSCI (PAZXXT08) > add replicat applyf01, exttrail /home/oracle/GG_SRC/ft, checkpointtable gg112.chkptab




Step 1 Start capture processGGSCI (PAZXXT08) 22> start capt01

Sending START request to MANAGER ...

EXTRACT CAPT01 starting

Step 2 - Instantiate the target database SQL> SELECT DBMS_FLASHBACK.GET_SYSTEM_CHANGE_NUMBER FROM DUAL;

GET_SYSTEM_CHANGE_NUMBER

------------------------

33301382

expdp gg112 SCHEMAS=srcusr DIRECTORY=DUMP_DIR DUMPFILE=src_usr_schema_dp.dmp FLASHBACK_SCN=33301382



Step 2 - Instantiate the target database (continued)

On Target:

impdp gg112 DIRECTORY=DUMP_DIR DUMPFILE=src_usr_schema_dp.dmp remap_schema=srcusr:trgtusr

Step 3 – Start apply processGGSCI (PAZXXT09) 22> start apply01 aftercsn 33301382



Step 4 – Wait until source and target database are in sync

On Target:

GGSCI (PAZXXT09) 24> lag apply01

Sending GETLAG request to REPLICAT APPLY01 ...

Last record lag: 2 seconds.

At EOF, no more records to process.



Step 5 – Stop the applicationWait until all changes are processed (check statistics)

GGSCI (PAZXXT08) 1> lag capt01

Sending GETLAG request to EXTRACT CAPT01 ...

Last record lag: 2 seconds.

At EOF, no more records to process.



Step 5a – Stop the GoldenGate pocessesGGSCI (PAZXXT08) 4> stop extract capt01

Sending STOP request to EXTRACT CAPT01 ...

Request processed.

Repeat those steps (5+5a) for all capture, pump and apply processes



GGSCI (PAZXXT09) 30> alter captf01 begin now

EXTRACT altered.

GGSCI (PAZXXT09) 31> alter extract captf01 etrollover

2013-01-24 04:35:35 INFO OGG-01520 Rollover performed.

For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO

for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not happen automatically.

EXTRACT altered.

Step 6 – Start the GoldenGate processes for the failback Set starting point of failback apply process



GGSCI (PAZXXT09) 32> info captf01 detail

EXTRACT CAPTF01 Initialized 2013-01-24 04:34 Status STOPPED

Checkpoint Lag 00:01:10 (updated 00:00:18 ago)

Log Read Checkpoint Oracle Redo Logs

2013-01-24 04:34:25 Seqno 0, RBA 0

SCN 0.0 (0)

Target Extract Trails:

Remote Trail Name Seqno RBA Max MB

/home/oracle/GG_SRC/ft 2 0 100

Target:

GGSCI (PAZXXT08) 33> alter applyf01 extseqno 2

REPLICAT altered.

GGSCI (PAZXXT08) 34> alter applyf01 extrba 0

REPLICAT altered.



Step 6 (continued)– Start captf01 („new“ environment)– Start Applyf01

Step 7 – Switch the application



Things to consider

Before starting the instantiation of the target database,no long running transactions should be active, because of possible data loss. Long running transactions can be monitored with the v$transaction view.


More InformationGeneral information

http://www.oracle.com/us/products/middleware/data-integration/ goldengate/overview/index.htmlhttp://www.oracle.com/technetwork/middleware/goldengate/overview/index.html

Oracle GoldenGate Zero Downtime Migrationshttp://www.oracle.com/technetwork/middleware/goldengate/overview/ggzerodowntimedatabaseupgrades-174928.pdf

Oracle GoldenGate Statement of Directionhttp://www.oracle.com/technetwork/middleware/goldengate/overview/statement-of-direction-gg-132120.pdf



Documents

Copyright © 2013, Oracle and/or its affiliates. All rights ...Oracle GoldenGate Capture Oracle GoldenGate Delivery Oracle 10.2 on Linux Oracle 10.2 Clone ÆOracle Database 11g Linux