Enterprise Manager 12c Snap Clone, Storage Management and … · Enterprise Manager 12c Snap Clone,...

Enterprise Manager 12c Snap Clone,Storage Management and Provisioningwith Oracle ZFS Storage Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

April 3, 2015

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.

The following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.

2

Session Agenda

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Database Cloning

• Cloning Requirements– Critical for delivering high-quality, production applications

• Development, Testing, QA– Facilitates faster time to market

• Cloning Challenges– Complicated Process

• Multiple admins – e.g. system, storage administrators– Time Consuming– Resource intensive– Expensive – especially for large multi-terabyte databases.

• As a result of these challenges, DB Copies and Clones may not be created as often as required

Business Challenges

• Cloning Requirements– Critical for delivering high-quality, production applications

• Development, Testing, QA– Facilitates faster time to market

• Cloning Challenges– Complicated Process

• Multiple admins – e.g. system, storage administrators– Time Consuming– Resource intensive– Expensive – especially for large multi-terabyte databases.

• As a result of these challenges, DB Copies and Clones may not be created as often as required

What is Snap Clone?DBaaS approach to creating clones of large (~TB) databases

Space EfficientSignificantly reduce thestorage footprint

Time EfficientClone DBs in minutes notdays/weeks

Storage AgnosticSupports ALL storage

vendors (NAS & SAN)

Self ServiceEmpower the user to makeadhoc clones

5

Oracle Enterprise Manager 12c Snap CloneLeverage capabilities of the Oracle ZFS Storage Appliance

• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-

on-write capabilities of storage device– New databases provisioned within minutes

instead of hours

• Included with Cloud Management Packfor Oracle Database

• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-

on-write capabilities of storage device– New databases provisioned within minutes

instead of hours

• Included with Cloud Management Packfor Oracle Database

Eliminating DB Storage Overhead Costs for Dev/TestBusiness Value: 90%+ reduction in storage overhead via ‘Snap Clone’

• Substantial DB storage overhead exists tosupport operations– For every DB in prod, 8-12 copies exist– Uses: Development, Test, Back-up, Archive

• DBaaS Snap Clone benefits:– 95% reduction in storage overhead, impact

easily quantified– Storage growing 35-40% / year– Delivery time cut from 2 weeks to > 1 hour

• Substantial DB storage overhead exists tosupport operations– For every DB in prod, 8-12 copies exist– Uses: Development, Test, Back-up, Archive

• DBaaS Snap Clone benefits:– 95% reduction in storage overhead, impact

easily quantified– Storage growing 35-40% / year– Delivery time cut from 2 weeks to > 1 hour

7

Test MasterDatabase

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking &Sub setting

SourceDatabase

010110011101001010000111010

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Cloning and Data RefreshSnap Clone and Full Cloning

Source DB Backups Mask / Subset Test Master Clones

Refresh

Data Guard Standby

Refresh

DB Clone and Refresh – Admin Flow

Mask

Update [Patch or Upgrade]

Change Configuration [SI / RAC]

Snap Clone

Use as Test Master

Production Database Clone / Test Master

Use as Test Master

Version: 11.2.0.4

Config: 3 Node RAC

Data: RMAN Backup1

Version: 11.2.0.4.2

Config: Single Instance

Data: RMAN Backup1

t0 t1 t2 …. tN

RMAN Backup / Storage Snapshot

SCN or Time

Integrated Data Masking

Production

Dev

Test

Clone

Test Master

Mask

DEPT LAST_NAME SSN SALARY

10 SMITH 111—23-1111 40,000

Data Masking Template

• Supports use of EM Data Masking template (requires Oracle Data Masking and SubsetPack), or running custom sql scripts

• Mask sensitive data as part of one-off clone or test master creation• For Snap Clone, it is recommended to only mask the test master, so as to retain

storage savings post snap clone

Oracle Confidential –Internal

10 SMITH 111—23-1111 40,000

10 JOHNSON 222-34-1345 60,000

Test MasterDatabase

010110011101001010000111010

Snap Clone with Oracle Engineered SystemsExadata• Compute nodes are used to run snap

clone databases• The storage is external to Exadata and

served over NFS• In case of ZS storage, all traffic over

Infiniband

SuperCluster• Solaris Zones or LDOMS used to run snap

clone databases• Embedded ZS-ES storage served over

Infiniband

Oracle Virtual Compute Appliance• Oracle VMs used to run snap clone

databases• Embedded ZS-ES storage served over

Infiniband

/source [nfs]

External Storage

010110011101001010000111010

Enterprise Manager12c

Exadata• Compute nodes are used to run snap

clone databases• The storage is external to Exadata and

served over NFS• In case of ZS storage, all traffic over

Infiniband

SuperCluster• Solaris Zones or LDOMS used to run snap

clone databases• Embedded ZS-ES storage served over

Infiniband

Oracle Virtual Compute Appliance• Oracle VMs used to run snap clone

databases• Embedded ZS-ES storage served over

Infiniband

/clone1 [nfs]

/clone2 [nfs]

Snap Clone Vs Competition

Scale, Scale, Scale Supports 1 to 1000s of clones

Protects your existing investments Choice between hardware and software solution Use of trusted technologies like data guard for test master refresh

Part of Enterprise Manager 12c Oracle’s flagship management product for all your database needs In sync with DB releases (support for PDBs on day 1) Secure and role based access control; used by Fortune 1000 customers Protection from unnecessary point tools; reduce TCO

Scale, Scale, Scale Supports 1 to 1000s of clones

Protects your existing investments Choice between hardware and software solution Use of trusted technologies like data guard for test master refresh

Part of Enterprise Manager 12c Oracle’s flagship management product for all your database needs In sync with DB releases (support for PDBs on day 1) Secure and role based access control; used by Fortune 1000 customers Protection from unnecessary point tools; reduce TCO

Session Agenda

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Oracle ZS Storage ApplianceEngineered for optimizing database storage

• Storage Related Challenges– Server to storage roadblocks lower software ROI– Slow, inflexible storage increases complexity and cost– Inefficient development & test slows time-to-market

• Oracle ZS Storage Appliance– Optimized Oracle Database efficiency with HCC– Optimized RMAN backup and recovery– Optimized data reuse in development and test– DBAs manage snapshots and clones directly

• Storage Related Challenges– Server to storage roadblocks lower software ROI– Slow, inflexible storage increases complexity and cost– Inefficient development & test slows time-to-market

• Oracle ZS Storage Appliance– Optimized Oracle Database efficiency with HCC– Optimized RMAN backup and recovery– Optimized data reuse in development and test– DBAs manage snapshots and clones directly

ZS: Engineered for Extreme PerformanceUnique Architecture for Optimal Storage Tiering

• Automated Data Placement over Tiered Caches– Adapts to workload changes, using fastest media– Read performance optimization from DRAM cache– Write performance optimization with write flash SSD

• Customer Benefits– Automatic optimization, no involvement required– Best Application Performance, $/IOP, $/GB in its class

Adaptive Throttle AlgorithmDetermines Pipe Size

Hybrid Storage Pool

AdaptiveI/O Staging

2TB

DR

AM

SAS-2(15K, 10K, 7K)

WRITE FLASH

LRU MRU

SLC NANDSync I/O Only

• Automated Data Placement over Tiered Caches– Adapts to workload changes, using fastest media– Read performance optimization from DRAM cache– Write performance optimization with write flash SSD

• Customer Benefits– Automatic optimization, no involvement required– Best Application Performance, $/IOP, $/GB in its class

Adaptive Throttle AlgorithmDetermines Pipe Size

Automated, real-time data migration from DRAMto multi-class flash, to multi-class disk storage

Software specifically engineered for multi-levelflash and disk storage

2TB

DR

AM

MLC NANDL2ARC

READ FLASH

LRU MRU

LFU MFU

(Evicted)

ZS is a DRAM-basedStorage System

DRAM is 1000x Fasterthan Flash

Up to 90% of IO fromDRAM

DRAM

not to scale

ZS is a DRAM-basedStorage System

DRAM is 1000x Fasterthan Flash

Up to 90% of IO fromDRAM

16

Disk

Flash

What is the Hybrid Storage Pool?Performance meets TCO

• Hottest/most recent data cached inmemory– Up to 3TB of DRAM available

• As data cools and is less active, cachedcopy is migrated to flash/SSD– Warm data response times identical to all-flash

array

• All data stored and protected on disk– Mirrored or RAID-protected

Active Data inMemory/DRAM

• Hottest/most recent data cached inmemory– Up to 3TB of DRAM available

• As data cools and is less active, cachedcopy is migrated to flash/SSD– Warm data response times identical to all-flash

array

• All data stored and protected on disk– Mirrored or RAID-protected

Oracle Confidential –Internal/Restricted/HighlyRestricted

1717

All Data Protectedon HDDs

Recent Dataon Flash/SSD

Understanding the Hybrid Storage Pool (HSP)

Latency

First read request

Subsequent read request

Cold data on disk only

… and the cycle repeats

18

Latency

Database HostLater read request

Much later read request

Cached in DRAM

Cached in SSD

Cold data on disk only

Data starts to cool …

Data becomes cold …

• Snapshots– Provide a read-only point-in-time copy of file

system– Practically unlimited maximum number of

maximum snapshots– Only changes tracked – near-zero space

consumption and near instantaneous

• Clones– Writeable copy of a snapshot– Nearly instantaneous creation, practically

unlimited number– Ideal for storing many private copies of

mostly-shared data

ZFS Data Distribution: Snapshots and Clones• Snapshots

– Provide a read-only point-in-time copy of filesystem

– Practically unlimited maximum number ofmaximum snapshots

– Only changes tracked – near-zero spaceconsumption and near instantaneous

• Clones– Writeable copy of a snapshot– Nearly instantaneous creation, practically

unlimited number– Ideal for storing many private copies of

mostly-shared data

Base Image1TB Data Files

Traditional ClonesFull copy of the original database

3TB for original + clones

Thin ClonesOnly changed blocks in new clone space

1.015TB for original + clones

ZFS Data Reduction: Thin Clones

Base Image1TB Data Files

Clone A1TB Data Files

Clone B1TB Data Files

Clone A5GB Data Files

Clone B10GB Data Files

Pointers toexisting blocks

Pointers toexisting blocks

New data

New data

Traditional File SystemFull copy duplicates all data blocks

my_file

my_file_copy

• File is collection of data blocks• And headers• Copy duplicates header & data blocks

– Effective & simple, but expensive!

cp my_file my_file_copy

• File is collection of data blocks• And headers• Copy duplicates header & data blocks

– Effective & simple, but expensive!

Copy-on-Write Basics

• File is collection of data blocks• And headers• Copy file requires only copy of header

– Much more efficient storage– Minimal IO to create copy

• Only copy block when changed

Much more efficient storage of substantially similar filesmy_file

• File is collection of data blocks• And headers• Copy file requires only copy of header

– Much more efficient storage– Minimal IO to create copy

• Only copy block when changedmy_file_copy

cp my_file my_file_copy

Accelerate Development and Test EnvironmentsLeveraging ZS for development and testing

• Accelerate deployment of patches,upgrades, and applications– Effectively and efficiently give each developer

their own database– ID changes in code that affect storage system

performance

• Nearly no procedural changes• Add value to Data Guard DR copies of

database with included snapshot andclone features

• Tested, validated, and supported by Oracle

Database Server

Primary Array

RMAN DUPLICATE

Clone Database Server

RMAN MERGE

• Accelerate deployment of patches,upgrades, and applications– Effectively and efficiently give each developer

their own database– ID changes in code that affect storage system

performance

• Nearly no procedural changes• Add value to Data Guard DR copies of

database with included snapshot andclone features

• Tested, validated, and supported by Oracle

ZS Storage Appliance

Integrate Oracle ZFS Storage ApplianceMonitor and Manage ZFS Storage Appliances through Oracle Enterprise Manager

• Plug-in for Enterprise Manager– Enables n-way monitoring and managing

of multiple ZFS Storage Appliancesthrough Enterprise Manager interface

• You can– Monitor key ZFS Storage Appliance

metrics with deep analytics– Provision LUNs and shares; adjust

tunable parameters

• Plug-in for Enterprise Manager– Enables n-way monitoring and managing

of multiple ZFS Storage Appliancesthrough Enterprise Manager interface

• You can– Monitor key ZFS Storage Appliance

metrics with deep analytics– Provision LUNs and shares; adjust

tunable parameters

24

Device Summary View Simplifies Monitoring TasksUses powerful analytics to provide intuitive displays of key metrics

• Share reservations and utilization at aglance

• Graphs of disk I/O and networkperformance for quick review of recentactivity

• System alert notifications displayed inthe summary view

• Link to launch appliance GUI fordetailed analytics and devicemanagement

• Share reservations and utilization at aglance

• Graphs of disk I/O and networkperformance for quick review of recentactivity

• System alert notifications displayed inthe summary view

• Link to launch appliance GUI fordetailed analytics and devicemanagement

25

ASR Alerts: Critical, Major

Found the Problem. Now What?Take the reins yourself

• Manage your ZFS Storage Appliance through Enterprise Manager– No new interfaces to learn

• Access a full set of provisioning capabilities– Create or tune the storage to your database needs

• Don’t blindly accept that the storage given to you will meet your needs– You know best what the database needs from the underlying storage

• Manage your ZFS Storage Appliance through Enterprise Manager– No new interfaces to learn

• Access a full set of provisioning capabilities– Create or tune the storage to your database needs

• Don’t blindly accept that the storage given to you will meet your needs– You know best what the database needs from the underlying storage

26

Modify Storage Allocation to RespondOnly Oracle ZFS Storage Appliance can be provisioned from Enterprise Manager

• Access a full set of provisioningcapabilities– Create or tune the storage your

database needs– Adjust write bias, database record size– Make snapshots visible for RMAN

• Manage your ZFS Storage Appliancethrough Enterprise Manager– No new interfaces to learn

• Access a full set of provisioningcapabilities– Create or tune the storage your

database needs– Adjust write bias, database record size– Make snapshots visible for RMAN

• Manage your ZFS Storage Appliancethrough Enterprise Manager– No new interfaces to learn

27

What Would a DBA Need to Change?RMAN backup use case

• Backup I/O characteristics for RMAN workload– Tune SSD write flash accelerator bias to send data straight to disk spindles– Matching 1MB storage record size to 1MB backup I/O record size shows a significant

improvement in restore performance

• Backup I/O characteristics for RMAN workload– Tune SSD write flash accelerator bias to send data straight to disk spindles– Matching 1MB storage record size to 1MB backup I/O record size shows a significant

improvement in restore performance

28

• Enterprise Manager enables theDBA to set the same parameters forearlier database versions– Simple steps to take through Enterprise

Manager

• Oracle Intelligent Storage Protocol(OISP) in 12c does this automatically– Database passes information directly to

the ZFS Storage Appliance to setparameters

Write Bias Provisioned from Enterprise Manager

• Option selected from dropdown list– Latency– Throughput

• Option selected from dropdown list– Latency– Throughput

Oracle Confidential –Internal/Restricted/HighlyRestricted

29

Record Size Provisioned from Enterprise Manager

• Option selected from dropdown list– Values from 8k to 1MB– Match to workflow

• Option selected from dropdown list– Values from 8k to 1MB– Match to workflow

Oracle Confidential –Internal/Restricted/HighlyRestricted

30

Session Agenda

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Demo: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

DemonstrationDemonstrationSnap Clone on ZFS Storage Appliance – via Enterprise Manager 12c Self Service PortalSnap Clone on ZFS Storage Appliance– Administration and Storage Setup

Customer Success: SnapClone + ZFS Storage Appliance• Company Background

– Large mobile phone company in MEA in terms of active subscribers

• Business Challenges– Average 5 days to provision UAT Database(s) for Dev Team.– Provisioning of new dev/test env uses in-house scripts and no automation is involved.– Sprawl Computing Resources.– No metering/chargeback capabilities.– Limited floor space in Data center.

CaseStudy

• Company Background– Large mobile phone company in MEA in terms of active subscribers

• Business Challenges– Average 5 days to provision UAT Database(s) for Dev Team.– Provisioning of new dev/test env uses in-house scripts and no automation is involved.– Sprawl Computing Resources.– No metering/chargeback capabilities.– Limited floor space in Data center.

Oracle Confidential – 33

Solution ComparisonTask Business as usual

Oracle CloudSolution

Difference

Total Provisioning Time assuming no resources aremade available (250GB/1TB DB size - 32GB logs)+ DataMasking

5 Days 2hrs:06 mins Almost 118 hrs57X Fatser

On demand Self Service No Yes

Resource Pooling No Yes

Rapid Elasticity (Service De-commissioning) No YesRapid Elasticity (Service De-commissioning) No Yes

Metering and Chargeback No Yes

• The provisioning time doesn’t really depend on the DB size, yet theamount of redo/standby logs to be cleared to activate the Cloned standbydatabase. So, with larger DBs the provisioning time would only increaseseveral mins as opposed to the traditional way, where the same timewould increase by factor of days.

Session Agenda

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Case Study: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Snap Clone OverviewMartin Pena

ZFS Storage Appliance Advantages for Snap CloneDoug Chamberlain

Case Study: Snap Clone + ZFS Storage ApplianceMartin Pena

Closing

Total Cloud ControlIdeal N-way Management Framework

Complete Cloud LifecycleManagement

Integrated Cloud StackManagement

Business-Driven ApplicationManagement

Self-Service IT Simple and Automated Business Driven| |

40

Oracle Enterprise Manager 12c Snap CloneLeverage capabilities of the Oracle ZFS Storage Appliance

• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-

on-write capabilities of storage device– New databases provisioned within minutes

instead of hours

• Included with Cloud Management Packfor Oracle Database

• Allows database administrators tocreate fully functional copies ofdatabases– Performed at the storage layer using copy-

on-write capabilities of storage device– New databases provisioned within minutes

instead of hours

• Included with Cloud Management Packfor Oracle Database

Oracle ZS Storage addresses key pain points

• Automated caching keep the right things in thefastest media (DRAM) to support performanceSLAs

• True Symmetric Multiprocessing (SMP) managesVM boot storms, bottlenecks, hot spots, and I/Osaturation to eliminate filer sprawl

• Advanced storage analytics allow you to find andeliminate issues 73% faster for maximumuptime*

Your storage admin should look to add it to the mix…

• Automated caching keep the right things in thefastest media (DRAM) to support performanceSLAs

• True Symmetric Multiprocessing (SMP) managesVM boot storms, bottlenecks, hot spots, and I/Osaturation to eliminate filer sprawl

• Advanced storage analytics allow you to find andeliminate issues 73% faster for maximumuptime*

*Source: Strategic Focus. https://go.oracle.com/LP=4206/?elqCampaignId=6667