Upload
others
View
10
Download
0
Embed Size (px)
Citation preview
Enterprise Manager Snap Clone Snapshot your data without snapping your storage
David Wolf Director of Product Management Fabio Batista Sales Consultant June 25, 2015
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
2
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Session Abstract SES16172
Are database refresh challenges causing you to miss projects deadlines? Is your storage cost for dev/test environments spiraling out of control? In this session, you will learn how the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database
• Can refresh production databases after masking and subsetting
• Can enable instant cloning of large databases (TBs) while saving more than 90 percent on storage costs
• Fits perfectly with your existing investments in storage, servers, and engineered systems
• Is being used by other customers for large-scale environments
3
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Program Agenda
1
2
3
4
Current Challenges
EM 12c Solution
Demo
Summary
4
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
A Large Financial Institution – Storage Challenges
1 - 3 Years SPARC x86
3 – 5 Years
Storage Cost / GB = $6.6/year
Estimated Annual Storage OPX
Cost “$198M/year” for Oracle
Environments
Applications Team: “1300 Apps
are utilizing private Cloud”
Storage Team: “We have 50 PB SAN.
Annual growth has ranged from 20-35%”
Database Team: “delivering
test data for UAT is a focus for private Cloud
this year ”
NonProductionEnvironments
AverageCostPerEnvironmentPerApplication
VerySmall(less<1TB) 1,400 300 5 2,100,000 $13,860,000 $9,900Small(1TBto5TB) 500 3,000 5 7,500,000 $49,500,000 $99,000Medium(5TBto10TB) 75 7,500 7 3,937,500 $25,987,500 $346,500Large(10TBto15TB) 25 12,500 7 2,187,500 $14,437,500 $577,500VeryLarge(>15TB) 20 20,000 7 2,800,000 $18,480,000 $924,000
Total: 2,020 18,525,000 $122,265,000 $60,527
OracleDBSize
EstimatedStorage(GB)Requirements
AverageNumberofNon-prod
Environments
AverageDBSize(GB)
Numberof
Applications
EstimatedAnnualOPXCosts
5 to 7 non-prod clones per production database
18 of 30 PB for non-prod Oracle environments
$122M of $198M for non-prod clones
5
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Process Challenges
“Database Refresh is a
necessary evil!”
60000 refresh/year
2000+
Dev/Test DB
3 – 5 TB
Typical DB size
RMAN full clones
10 - 20 issues/day
EMC & NetApp storage
- Christian Bilien, Global Head of Database Team
6
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Evolution of Solutions
Point Features Point Tools EM Solution
Storage level: snapshot, volume/lun thin clone, dedupe, compression, etc
× Lacked DB or application context
× Does not solve process problem
VM cloning
DB cloning using smart file systems
× Limited focus on just cloning
× Lacked lifecycle management of clones
Technology agnostic
End-to-End automation from prod to test/dev
Designed for DBAs
Complete mgmt of clones - masking, performance, patch/upgrade, etc
7
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
EM Solution – Data Lifecycle Management (DLM)
Supports full and thin database clones
Technology Agnostic
End-to-End Automation – Prod to Test/Dev
Designed for DBAs
Integrated Masking, Patch, etc
Available via Admin Flows and Self Service portal
EMCLI and REST API for integrations
8
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Strong Investment in EM’s Data Cloning Solution
EM 12c R2 EM 12c R3 EM 12c R4 EM 12c R4 PG
• Snap Clone for NAS
storage – NetApp &
Sun ZFSSA
• RMAN backup based
clones
• Snap Clone Analyzer
to show storage
savings
• Snap Clone using
CloneDB
• Data Guard Standby
as a Test Master
• NetApp Ontap 8.x
cluster mode
• Certification for Eng.
systems, I/O over IB
• Support for NFSv4
• Snap Clone using
Solaris File System
(ZFS)
• Snap Clone for PDBs
(Admin Flows)
• Data Lifecycle
Management
• Snap Clone using
EMC SAN and ASM
• Admin flows for test
master creation
• Integration with
masking, patching,
upgrades, etc
EM 12c R5
• Exadata Sparse
Clones for DB and
Multitenant
• PDB Thin clone using
ACFS Snapshot
9
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Data Cloning Options
Software Solution [Vendor Agnostic]
Hardware Solution [Vendor Specific]
Full Clones Snap (Thin) Clones
NAS SAN
Database Native [Storage Agnostic]
RMAN Restore
RMAN Duplicate
Data Pump
• Leverage your existing investments • Cater to both functional and stress testing needs • Maximize for best performance
Use Snap Clone whenever you need >1 clones!
ACFS
10
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Snap Clone using Solaris File System (ZFS)
• Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the Sun ZS3 Appliance ]
• Supports any kind storage – NAS or SAN
• For SAN, mount luns as raw disk and format with ZFS filesystem
• Does NOT require the snapshot/clone licenses from the storage vendor, these features are available for free
• Additional features include compression, deduplication, IO caching, etc
• HA has to be handled externally either via Solaris Clusters, or by using HA features of the underlying hypervisor
11
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
CloneDB using DNFS • Ability to create thin databases from
RMAN image copies
• Uses NFS v3 client embedded in database
• Supported configurations
– Single instance databases
– Note: Only file system support for this setup (No ASM)
• Supported Versions: 11.2.0.3+, 12.1
• Advantages
– Easy to setup
– No special storage software needed
– Works on all platforms
– Time efficient: Instantaneous cloning
– Space efficient: Create multiple clones based on one backup
– Uses dNFS to improve performance, high availability, and scalability of NFS storage
12
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Snap Clone on ASM + EMC Storage
• Ability to create ‘live’ thin clones of databases on ASM
• Live Clone: NOT snapshot based, but a live clone of DB
• Clone can be within the same or on a different cluster
• EMC VMAX (with Time Finder VPSnap) and VNX storage appliances
• Supported configurations: SI and RAC
• Supported Versions: DB = 10.2.0.5 or higher; GI = 11.2 and higher
13
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
New Rapid Database Snapshots for Dev/Test
• Fast space-efficient Snapshot database creation
– Create sparse diskgroup on Exadata storage
– Then create snapshot database or snapshot PDB that reads from base read-only copy of DB and writes to sparse diskgroup
• Integration with pluggable database enables creation of DB snapshot with single Click.
• All Exadata features work on Snapshots (smart scans, smart flash cache, resource management …)
14
Sparse Snap
Base DB
Sparse Snap
CDB
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Snap Clone on Exadata Single Click – Rapid Database snapshots using sparse technology
15
Time to create new snap clone ~1min
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Snap Clone on Exadata Snap Clone aka Snapshot Databases for both Multitenant & regular Databases
16
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
End to End Automation Data Lifecycle Management
17
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Data Movement
Test Master Database
NAME SSN SALARY
MILLER 112-23-4567 40,000
SMITH 111-22-3333 60,000
Masking & Config Mutation
Production Database
010110011
101001010
000111010
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
BENSON 323-22-2943 60,000
Prod DB Backups Mask / Mutate Test Master Clones
Refresh
Data Guard Standby
Refresh
18
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
DB Clone and Refresh – Admin Flow
Mask
Subset
Update [Patch – PSU]
Change Configuration [SI / RAC]
Snap Clone
Use as Test Master
Version: 11.2.0.4
Config: 3 Node RAC
Data: RMAN Backup1
Version: 11.2.0.4.4
Config: Single Instance
Data: RMAN Backup1
t0 t1 t2 …. tN
Production Database Clone / Test Master
RMAN Backup / Data Pump / Storage Snapshot
19
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Test Master t0 t1 t2 …. tN
Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles
Private backups
Clones
• Clones can be created from any profile
• Each user gets a personal read-write
database clone
Test master is
regularly
refreshed with
current data
from production Data Refresh
Agile ‘Data Refresh’ Time Travel – Refresh, Rewind across Snapshots
20
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Self Service Provisioning and Service Catalog
• Out-of-box self service portal
• Catalog of different database configuration with varied datasets
• Resource quota based on role
• Integrated monitoring, snapshot/rollback, etc
21
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Demo
22
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 23
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 24
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 25
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 26
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 27
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 28
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 29
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 30
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 31
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 32
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Complete APIs for Automation or Integration
DBaaS Providers: • CRUD on Zones / Pools / Service templates / Profiles / Quota / etc
List
DBaaS Portal & API
Deploy
Delete Manage
List Zones
List Service Templates
List Service Instances
Request DBs
Request PDBs
Request Schemas
Track request progress
Service Control (start/stop)
Backup
Restore
Snapshot
Get Chargeback info
Delete Service
Extend reservation
33
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Complete REST API for Automation or Custom Portals
OR
Out of box Self Service Portal
POST : https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18
3C99D138FF8065F19
Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=
Content-Type:
application/oracle.com.cloud.common.DbPlatformInstance+json
Accept:
application/oracle.com.cloud.common.DbPlatformInstance+json
Body:
{
"based_on":
"/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF
252456",
"name": "<Request name>",
"description": "<Request Description>",
"params":
{ "username": "Master Account username for the DB",
"password": "Password for the Master Account on the DB"
}
}
34
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Data Lifecycle Management for Multitenant Databases EM – Single tool to Provision, Migrate , Clone , and Snap Clone
35
GL OE AP
GL-2 GL-1 AP-1 AP-2 PO-1
PO
• Clone across CDBs
(remote CDB)
• Clone within the CDBs
• Create snap clones in
seconds.
• Migrate non CDB into
PDB
• Supported both On
Premise and Oracle
Cloud Databases
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
EM offers PDB Thin Cloning & beyond…
36
Mu
ltit
enan
t C
lon
ing
Full Clones Supported on all platforms
Snapshot clones
Source in Read-only if child exists
File System Agnostic (CloneDB=TRUE)
Exadata Sparse clones
Copy-on-write - Source opened in read write after
clone is created
ACFS
ZFSSA / ZS3
Netapp
Configuration mutation from n-Node RAC -> SI
In-line PSU patch application
Integrated Data Masking
Advanced PDB Create options Max Size. Max Shared Tbsp Size. Logging options.
Customization hooks…
Pre-Create Script Post-Create Script Custom Sql Script
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Summary
37
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Test Master Database
010110011
101001010
000111010
Snap Clone with Oracle Engineered Systems
Enterprise Manager 12c
Exadata
• Compute nodes are used to run snap
clone databases
• The storage is external to Exadata
and served over NFS
• In case of ZS3 storage, all traffic over
infiniband
SuperCluster
• Solaris Zones or LDOMS used to run
snap clone databases
• Embedded ZS3-ES storage served
over infiniband
Oracle Virtual Compute Appliance
• Oracle VMs used to run snap clone
databases
• Embedded ZS3-ES storage served
over infiniband
/source [nfs]
.. more
/clone1 [nfs]
External Storage
/clone2 [nfs]
38
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Cloud Management Pack for Oracle Database Summary
Metering, Chargeback
Supports Databases, Schema, and PDBs
Database Cloning Full clones and Snap Clones (thin clones)
Quota and Policy based Management
Self-Service Provisioning
Enforces governance and control
Supports Database, Schema, and PDBs
Comprehensive REST and EMCLI APIs For all self service and admin functions
Enterprise-wide Service Catalog Role based, Single catalog, to enforce standardization across the DB estate
39
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
References
• Enterprise Manager Page on O.com
• Cloud Management Page on OTN
• Cloud Administration Guide (Documentation)
• MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS (1549855.1)
40